Human Generated Data

Title

Untitled (studio portrait of six women against painted backdrop)

Date

c. 1931, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5804

Human Generated Data

Title

Untitled (studio portrait of six women against painted backdrop)

People

Artist: Durette Studio, American 20th century

Date

c. 1931, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.4
Person 99.4
Person 99.3
Person 98.8
Person 98.7
Person 98.2
Clothing 97.9
Apparel 97.9
Person 97.5
Shoe 90.8
Footwear 90.8
People 90.1
Shoe 81.3
Female 73.9
Family 66.7
Overcoat 64.5
Evening Dress 57.5
Gown 57.5
Robe 57.5
Fashion 57.5
Shoe 57.2
Woman 56.2
Sleeve 55.9
Long Sleeve 55.9
Coat 50.2

Clarifai
created on 2019-11-16

people 100
group 99.7
woman 98.8
group together 98.6
wear 96.9
many 96.7
actress 96.2
adult 96.1
child 95.2
outfit 94.7
music 94.5
dancer 93.3
man 93.1
dancing 91.3
musician 90.4
portrait 90.2
dress 90
singer 89.3
actor 88
several 88

Imagga
created on 2019-11-16

kin 46.6
people 31.2
adult 26.9
person 26.6
black 24.6
man 24.2
fashion 21.8
male 20.6
portrait 19.4
sexy 19.3
attractive 18.9
women 18.2
model 17.9
couple 17.4
silhouette 16.5
dress 16.2
group 16.1
dark 15.9
style 15.6
happiness 14.1
clothing 14
lifestyle 13.7
youth 13.6
business 13.4
posing 13.3
pretty 13.3
pose 12.7
businessman 12.4
men 12
happy 11.9
hair 11.9
face 11.4
love 11
world 10.8
photographer 10.7
dance 10.7
room 10.6
lady 10.5
human 10.5
gorgeous 10
modern 9.8
office 9.6
brunette 9.6
party 9.5
elegant 9.4
passion 9.4
clothes 9.4
two 9.3
elegance 9.2
girls 9.1
sensuality 9.1
night 8.9
together 8.8
expression 8.5
casual 8.5
studio 8.4
fun 8.2
one 8.2
sensual 8.2
performer 8.1
dancer 8
romance 8
boy 7.8
standing 7.8
vogue 7.7
corporate 7.7
musical instrument 7.7
wind instrument 7.6
hand 7.6
groom 7.4
indoor 7.3
stylish 7.2
body 7.2
family 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

person 99.5
clothing 98.2
smile 98.2
dress 96.1
posing 92.6
woman 92.4
text 88.4
group 81.2
footwear 66.1
human face 64.9
people 59.6
dressed 32.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-40
Gender Female, 99%
Calm 4.1%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%
Sad 0.1%
Happy 95%
Surprised 0.3%
Confused 0.2%

AWS Rekognition

Age 29-45
Gender Female, 54.9%
Angry 45%
Sad 45%
Confused 45%
Surprised 45%
Happy 54.9%
Disgusted 45%
Calm 45%
Fear 45%

AWS Rekognition

Age 25-39
Gender Female, 98.9%
Calm 69.3%
Sad 1.5%
Confused 2.1%
Happy 21.3%
Angry 2.3%
Disgusted 2.6%
Fear 0.4%
Surprised 0.7%

AWS Rekognition

Age 22-34
Gender Female, 54.9%
Fear 45.1%
Happy 53.5%
Calm 46%
Sad 45.2%
Angry 45.1%
Surprised 45.1%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 21-33
Gender Female, 54.5%
Fear 45.2%
Happy 45.3%
Calm 53.4%
Sad 45.3%
Angry 45.2%
Surprised 45.4%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 23-37
Gender Male, 84.6%
Surprised 0.6%
Confused 0.9%
Calm 95.2%
Happy 0.1%
Sad 1.1%
Angry 1.6%
Disgusted 0.4%
Fear 0.1%

Microsoft Cognitive Services

Age 49
Gender Female

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 31
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 41
Gender Female

Microsoft Cognitive Services

Age 37
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Shoe 90.8%
Coat 50.2%

Captions

Microsoft

Rose Kennedy et al. posing for a photo 97.2%
Rose Kennedy et al. posing for a picture 97.1%
Rose Kennedy et al. posing for the camera 97%