Human Generated Data

Title

Untitled (middle-aged couple posed in living room with man in chair and woman standing)

Date

1951

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9349

Human Generated Data

Title

Untitled (middle-aged couple posed in living room with man in chair and woman standing)

People

Artist: Martin Schweig, American 20th century

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.5
Person 99.5
Person 97.2
Furniture 90.5
Chair 82.2
Face 74.5
Plant 67.2
Clinic 66.8
Clothing 65.5
Apparel 65.5
Blossom 63.6
Flower 63.6
Bed 61.4
Portrait 60.6
Photo 60.6
Photography 60.6
Female 59.7
Home Decor 57.9
Hospital 56.1
Couch 55.8
Indoors 55.6
Room 55.6
Living Room 55.6
Linen 55

Imagga
created on 2022-01-23

barbershop 47.2
nurse 41.2
man 38.3
people 36.3
coat 36.1
shop 36
professional 34.1
patient 33.3
person 33.1
male 32.7
adult 32.3
lab coat 32
medical 30
hospital 30
mercantile establishment 28.6
clinic 28.1
room 24.1
indoors 22.9
doctor 22.6
men 21.5
smiling 21
pharmacist 20.9
sitting 19.8
health 19.5
place of business 19
happy 18.8
home 18.4
office 17.7
women 17.4
senior 16.9
mature 16.7
medicine 16.7
occupation 16.5
work 16.5
health professional 16
care 15.6
team 15.2
smile 15
couple 14.8
clothing 14.3
table 13.9
worker 13.7
illness 13.4
bed 13.3
working 13.3
businessman 13.2
portrait 13
computer 12.8
business 12.8
colleagues 12.6
laboratory 12.5
job 12.4
talking 12.4
cheerful 12.2
two 11.9
color 11.7
lab 11.7
garment 11.7
sick 11.6
happiness 11
lifestyle 10.8
scientist 10.8
businesspeople 10.4
desk 10.4
teamwork 10.2
20s 10.1
indoor 10.1
businesswoman 10
family 9.8
old 9.8
40s 9.7
interior 9.7
two people 9.7
group 9.7
30s 9.6
mother 9.6
research 9.5
uniform 9.5
establishment 9.5
biology 9.5
day 9.4
casual 9.3
student 9.3
face 9.2
case 9.2
laptop 9.1
together 8.8
assistant 8.8
chemistry 8.7
chemical 8.7
profession 8.6
elderly 8.6
chair 8.5
meeting 8.5
instrument 8.4
sick person 8.4
inside 8.3
science 8
looking 8
specialist 8
caring 7.9
casual clothing 7.8
scientific 7.8
check 7.7
enjoying 7.6
horizontal 7.5
treatment 7.4
suit 7.2
bright 7.2
to 7.1
attractive 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.2
house 85.1
drawing 67.8
furniture 62.8
table 62.8
old 52.9
person 51.9
clothing 51.1
vase 51

Face analysis

Amazon

Google

AWS Rekognition

Age 47-53
Gender Male, 96.6%
Calm 34%
Confused 25.4%
Surprised 20.2%
Sad 7.3%
Happy 6.3%
Fear 3.1%
Angry 2%
Disgusted 1.7%

AWS Rekognition

Age 39-47
Gender Female, 97.5%
Calm 72.3%
Sad 14.4%
Surprised 8.2%
Fear 1.8%
Confused 1.4%
Happy 0.8%
Disgusted 0.6%
Angry 0.5%

AWS Rekognition

Age 21-29
Gender Male, 77.1%
Happy 59.3%
Calm 15.6%
Angry 12.6%
Sad 6.5%
Confused 2.4%
Disgusted 1.9%
Surprised 0.9%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 82.2%
Bed 61.4%

Captions

Microsoft

an old photo of a man 88%
an old photo of a man in a kitchen 87.6%
old photo of a man 87.5%

Text analysis

Amazon

ЕГГИ
DUSCO
DUSCO SALETA ЕГГИ
SALETA

Google

0M
MJIA YT33A2 0M
YT33A2
MJIA