Human Generated Data

Title

Untitled (two photographs: studio portrait of woman in elaborate hat and shawl; studio portrait of young boy in white outfit standing next to chair)

Date

c. 1935, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6107

Human Generated Data

Title

Untitled (two photographs: studio portrait of woman in elaborate hat and shawl; studio portrait of young boy in white outfit standing next to chair)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clothing 100
Apparel 100
Human 99.5
Person 99.5
Shoe 99.3
Footwear 99.3
Person 97
Shoe 94.5
Shorts 93.7
Stage 77.7
Hat 71.5
Robe 67.3
Fashion 67.3
Evening Dress 67.3
Gown 67.3
Leisure Activities 65.3
Sleeve 57.2
Sun Hat 57
Screen 55.6
Electronics 55.6
Flooring 55.1

Clarifai
created on 2019-11-16

people 99.9
woman 96.8
adult 96.6
room 95.2
group 94.7
child 94
man 93.5
movie 93.1
wear 90.9
two 90.9
actress 89.9
group together 89.5
music 87.5
furniture 87.2
three 86.3
actor 85.1
wedding 84.7
administration 83.5
family 82.8
education 82.5

Imagga
created on 2019-11-16

groom 29
people 19.5
dress 18.1
fashion 16.6
bride 16.5
old 16
couple 15.7
window 15.7
person 15.1
man 14.8
male 14.2
adult 13.4
interior 13.3
wedding 12.9
pretty 12.6
happiness 12.5
happy 12.5
room 12.3
style 11.9
love 11.8
black 11.7
elegance 10.9
sexy 10.4
portrait 10.4
attractive 9.8
posing 9.8
lady 9.7
statue 9.6
elegant 9.4
tradition 9.2
clothing 9.2
indoor 9.1
vintage 9.1
family 8.9
building 8.9
standing 8.7
model 8.6
bouquet 8.5
traditional 8.3
new 8.1
child 8
hair 7.9
together 7.9
holiday 7.9
bridal 7.8
ceremony 7.8
men 7.7
married 7.7
marriage 7.6
human 7.5
future 7.4
historic 7.3
sensuality 7.3
home 7.2
celebration 7.2
romantic 7.1
smile 7.1
performer 7.1
businessman 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

clothing 96.9
wall 95.1
person 94.5
dress 90.2
text 86.8
footwear 78.6
black and white 76
white 65.1
woman 56.3
human face 54
old 48.8
posing 46

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Female, 98%
Disgusted 0.1%
Confused 1.8%
Angry 0.3%
Sad 0.2%
Happy 0.1%
Surprised 6%
Calm 91.1%
Fear 0.4%

AWS Rekognition

Age 12-22
Gender Male, 53.5%
Confused 45.1%
Surprised 45.1%
Fear 45%
Happy 47.9%
Disgusted 45%
Angry 45.1%
Sad 45.1%
Calm 51.7%

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Shoe 99.3%

Captions

Microsoft

a person standing in front of a window 94.6%
a man and a woman standing in front of a window 80.2%
a person standing next to a window 80.1%