Human Generated Data

Title

Untitled (group portrait in living room around elderly woman)

Date

1937

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5725

Human Generated Data

Title

Untitled (group portrait in living room around elderly woman)

People

Artist: Durette Studio, American 20th century

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Human 99.6
Person 99.6
Person 99.5
Person 99
Person 98.7
Person 98.7
Person 98.4
People 95
Person 94.7
Apparel 93.3
Clothing 93.3
Chair 82.5
Furniture 82.5
Sleeve 80.9
Family 74.3
Home Decor 72.4
Indoors 69.9
Room 65
Long Sleeve 62.4
Face 60.5
Photo 60.5
Photography 60.5
Portrait 60.5
Shirt 56.2

Clarifai
created on 2019-06-01

people 99.9
adult 98.5
group 97.6
group together 96.3
man 95.4
wear 94.4
many 94
several 93.7
woman 91.5
medical practitioner 90.8
leader 85
administration 80.3
five 78.1
monochrome 77.6
four 77.1
child 73.9
uniform 73.6
portrait 71.7
outfit 71
veil 70.8

Imagga
created on 2019-06-01

kin 76.5
nurse 64.6
man 37
people 34
happy 32.6
male 31.9
person 29.1
professional 27.8
adult 27.6
coat 25.1
smiling 24.6
medical 23.8
doctor 23.5
lab coat 22.9
hospital 22.4
portrait 22
business 21.9
job 21.2
mature 20.5
group 20.1
standing 20
men 19.7
team 19.7
businessman 19.4
occupation 19.2
smile 19.2
confident 18.2
women 18.2
health 18.1
happiness 18
couple 16.6
looking 16
senior 15.9
medicine 15.9
camera 15.7
businesswoman 15.5
30s 15.4
uniform 15.3
businesspeople 15.2
indoors 14.9
cheerful 14.6
colleagues 14.6
worker 14.5
elderly 14.4
profession 14.4
teamwork 13.9
lifestyle 13.7
patient 13.6
together 13.1
doctors 12.8
two 12.7
day 12.6
stethoscope 12.5
clinic 12.5
clothing 12.4
care 12.3
corporate 12
casual 11.9
old 11.8
mother 11.8
40s 11.7
family 11.6
working 11.5
confidence 11.5
staff 11.5
illness 11.4
clinical 10.7
face 10.7
mid adult 10.6
office 10.4
inside 10.1
20s 10.1
aged 10
suit 9.9
handsome 9.8
black 9.6
four 9.6
home 9.6
love 9.5
meeting 9.4
work 9.4
successful 9.2
attractive 9.1
consultant 8.8
sick 8.7
husband 8.7
diversity 8.6
bright 8.6
wife 8.5
walking 8.5
holding 8.3
human 8.2
friendly 8.2
healthy 8.2
fifties 7.9
discussing 7.9
forties 7.8
good mood 7.8
50s 7.8
discussion 7.8
color 7.8
thirties 7.8
expertise 7.8
practice 7.7
partnership 7.7
formal 7.6
daughter 7.6
walk 7.6
adults 7.6
specialist 7.5
indoor 7.3
lady 7.3
success 7.2
building 7.1
father 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

person 98.9
clothing 96
wedding dress 86
standing 84.7
dress 77.2
smile 77.1
posing 76.2
bride 72
group 72
black 71.5
old 69.9
woman 67

Face analysis

Amazon

AWS Rekognition

Age 38-59
Gender Male, 54.3%
Sad 45.7%
Happy 46.4%
Confused 45.4%
Angry 45.4%
Surprised 45.5%
Disgusted 45.6%
Calm 51%

AWS Rekognition

Age 20-38
Gender Male, 54.6%
Happy 45.5%
Calm 52.8%
Angry 45.5%
Confused 45.2%
Surprised 45.3%
Sad 45.5%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.6%
Sad 46.3%
Surprised 45.5%
Disgusted 45.4%
Angry 46.5%
Calm 50.2%
Happy 45.9%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Happy 45.8%
Disgusted 45.3%
Sad 46.9%
Surprised 45.5%
Angry 45.5%
Calm 50.6%
Confused 45.4%

AWS Rekognition

Age 26-44
Gender Male, 53.8%
Happy 45.4%
Disgusted 45.2%
Sad 45.3%
Surprised 45.3%
Angry 45.1%
Calm 53.5%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Sad 45.4%
Surprised 45.5%
Happy 45.5%
Angry 45.2%
Calm 53%
Confused 45.3%
Disgusted 45.1%

AWS Rekognition

Age 38-57
Gender Female, 50%
Confused 49.5%
Surprised 49.5%
Calm 49.6%
Sad 50.2%
Happy 49.6%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 17-27
Gender Female, 51.2%
Disgusted 45.3%
Sad 46.6%
Happy 45.6%
Confused 45.3%
Surprised 45.6%
Angry 45.3%
Calm 51.3%

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 93.4%
a group of people posing for the camera 93.3%
a group of people posing for a picture 93.2%