Human Generated Data

Title

Untitled (two photographs: studio portrait of two girls in white dresses, one seated; studio portrait of two young women sharing a chair)

Date

c. 1935, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6071

Human Generated Data

Title

Untitled (two photographs: studio portrait of two girls in white dresses, one seated; studio portrait of two young women sharing a chair)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-30

Human 99.7
Person 99.7
Person 99.6
Person 99.3
Person 98.9
Sitting 78.6
Apparel 69.4
Clothing 69.4
Shoe 69.4
Footwear 69.4
Hairdresser 66.3
Worker 66.3
Photo 60.5
Photography 60.5
Nurse 57.4
People 56.2
Performer 55.5

Clarifai
created on 2019-05-30

people 99.9
group 98.7
woman 98.6
adult 97.6
wear 97.5
group together 95.5
actress 94.5
man 94.4
child 93.3
four 92
music 92
furniture 90.9
offspring 90.6
three 90
room 89.9
family 89.2
two 85.9
theater 85.9
several 85.3
five 84.3

Imagga
created on 2019-05-30

kin 65.5
man 34.9
couple 32.2
people 31.2
nurse 29.1
male 27.8
person 26.7
adult 25.5
happy 25.1
groom 24.9
happiness 23.5
bride 22.9
family 22.2
mother 21
home 20.7
wedding 20.2
smile 19.2
dress 19
portrait 18.8
two 18.6
love 18.1
smiling 18.1
men 17.2
businessman 16.8
women 15.8
together 15.8
attractive 15.4
bouquet 15.1
new 14.6
husband 14.3
professional 14.1
father 13.6
married 13.4
marriage 13.3
daughter 13.1
room 13
patient 13
job 12.4
lifestyle 12.3
cheerful 12.2
business 12.1
worker 11.7
couch 11.6
wife 11.4
pretty 11.2
celebration 10.4
sitting 10.3
elegance 10.1
romance 9.8
handsome 9.8
interior 9.7
outdoors 9.7
affectionate 9.7
group 9.7
black 9.6
talking 9.5
corporate 9.4
day 9.4
businesswoman 9.1
fashion 9
human 9
suit 9
clothing 9
son 8.9
wed 8.8
office 8.8
casual clothing 8.8
indoors 8.8
ceremony 8.7
future 8.4
mature 8.4
old 8.4
house 8.4
sick person 8.3
indoor 8.2
children 8.2
case 8.1
success 8
romantic 8
looking 8
holiday 7.9
brown hair 7.8
gown 7.8
color 7.8
sofa 7.7
loving 7.6
casual 7.6
child 7.6
adults 7.6
care 7.4
executive 7.4
20s 7.3
building 7.1
chair 7.1
modern 7

Google
created on 2019-05-30

Microsoft
created on 2019-05-30

wall 97.3
clothing 93.5
person 93
standing 88.5
woman 80.3
dress 74
footwear 73.9
smile 62.8
posing 45.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 53.3%
Disgusted 45.1%
Happy 45.1%
Confused 45.3%
Surprised 45.2%
Calm 53.5%
Angry 45.3%
Sad 45.6%

AWS Rekognition

Age 14-25
Gender Female, 54.9%
Angry 45.6%
Calm 50.9%
Disgusted 45.2%
Sad 47.8%
Surprised 45.1%
Confused 45.2%
Happy 45.2%

AWS Rekognition

Age 17-27
Gender Female, 54.8%
Sad 47.2%
Happy 45.2%
Angry 45.2%
Confused 45.1%
Surprised 45.1%
Disgusted 45.2%
Calm 52%

AWS Rekognition

Age 10-15
Gender Female, 54.8%
Angry 45.5%
Disgusted 48.4%
Surprised 45.3%
Confused 45.6%
Happy 45.3%
Sad 47.7%
Calm 47.2%

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 69.4%

Captions

Microsoft

a couple of people that are standing in a room 92.4%
a person standing in front of a group of people posing for a photo 78.8%
a group of people posing for a photo 78.7%