Human Generated Data

Title

Untitled (two photographs: two nuns and family standing outside a house)

Date

c. 1935, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6103

Human Generated Data

Title

Untitled (two photographs: two nuns and family standing outside a house)

People

Artist: Durette Studio, American 20th century

Date

c. 1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clothing 99.7
Apparel 99.7
Human 99
Person 99
Person 98.9
Person 98.5
Person 97.8
Person 97.6
Person 97.2
Person 93.6
Person 93
Sleeve 92.1
Long Sleeve 90.4
Person 90.3
Person 89.5
Advertisement 87.5
Poster 87.5
Collage 87.5
Person 84.6
Person 82.1
Suit 81.9
Overcoat 81.9
Coat 81.9
Evening Dress 77.8
Gown 77.8
Robe 77.8
Fashion 77.8
Female 74.8
People 68.6
Woman 63.7
Accessories 58.6
Tie 58.6
Accessory 58.6
Skirt 57.5
Military 56.9
Military Uniform 56.9
Silhouette 56.8
Plaid 55.7
Tartan 55.7

Clarifai
created on 2019-11-16

people 100
group 99
woman 97.5
adult 97
wear 97
many 93.2
group together 90.6
child 90.5
man 89.8
actress 86.5
dress 86.3
leader 85.8
portrait 85.6
administration 85.2
movie 85
outfit 85
several 84.9
street 82
room 80.2
wedding 79.1

Imagga
created on 2019-11-16

black 35.8
robe 26.8
clothing 26
garment 23.8
musical instrument 22.4
man 22.2
person 21.3
people 19.5
adult 19.4
male 18.5
dress 18.1
accordion 18
wind instrument 16
portrait 15.5
sexy 15.2
fashion 15.1
window 14.8
keyboard instrument 14.7
silhouette 14.1
model 14
pretty 13.3
kin 13.2
attractive 12.6
couple 12.2
hair 11.9
style 11.9
pose 11.8
covering 10.8
bride 10.8
posing 10.7
elegance 10.1
body 9.6
happy 9.4
face 9.2
dark 9.2
vintage 9.1
human 9
one 9
lady 8.9
happiness 8.6
elegant 8.6
dance 8.5
youth 8.5
business 8.5
groom 8.5
consumer goods 8.5
wedding 8.3
world 8
family 8
love 7.9
men 7.7
grunge 7.7
fashionable 7.6
clothes 7.5
suit 7.4
sensual 7.3
looking 7.2
night 7.1
glass 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

clothing 98.6
suit 97.9
dress 97.7
wedding dress 96.4
bride 92.6
person 92.6
text 91.7
woman 91.5
man 90
people 82.9
smile 82.9
group 61.2
wedding 57.8
old 44
clothes 15

Face analysis

Amazon

AWS Rekognition

Age 51-69
Gender Male, 54%
Sad 45.3%
Fear 45%
Angry 45.1%
Surprised 45.1%
Calm 54.4%
Disgusted 45%
Confused 45.1%
Happy 45%

AWS Rekognition

Age 31-47
Gender Female, 54%
Confused 45.1%
Surprised 45.1%
Calm 45.8%
Fear 45.1%
Disgusted 45.2%
Happy 45.1%
Sad 45.2%
Angry 53.5%

AWS Rekognition

Age 44-62
Gender Male, 54.1%
Angry 49.3%
Disgusted 45.1%
Surprised 45.1%
Confused 45.2%
Fear 45.5%
Calm 45.9%
Sad 48.9%
Happy 45%

AWS Rekognition

Age 32-48
Gender Male, 54.8%
Calm 52.8%
Surprised 45%
Happy 45%
Sad 45.1%
Confused 45%
Angry 47.1%
Fear 45%
Disgusted 45%

AWS Rekognition

Age 31-47
Gender Female, 54.7%
Disgusted 46%
Happy 45.4%
Confused 45.3%
Angry 46%
Fear 45.1%
Sad 49.6%
Calm 47.5%
Surprised 45.1%

AWS Rekognition

Age 45-63
Gender Female, 54.5%
Calm 54.5%
Surprised 45%
Happy 45.1%
Sad 45.1%
Confused 45%
Angry 45.2%
Fear 45%
Disgusted 45.1%

AWS Rekognition

Age 32-48
Gender Female, 54.9%
Confused 45%
Fear 45%
Sad 54.7%
Disgusted 45%
Happy 45%
Angry 45%
Calm 45.2%
Surprised 45%

AWS Rekognition

Age 39-57
Gender Female, 54.8%
Disgusted 45.1%
Sad 46.4%
Happy 45.1%
Surprised 45%
Calm 53.1%
Fear 45%
Confused 45.1%
Angry 45.2%

AWS Rekognition

Age 40-58
Gender Female, 51.8%
Calm 45.4%
Disgusted 45%
Sad 45.5%
Happy 45%
Angry 54%
Fear 45%
Surprised 45%
Confused 45%

AWS Rekognition

Age 29-45
Gender Male, 54.8%
Happy 45%
Disgusted 45.1%
Sad 45.5%
Angry 47.7%
Surprised 45.1%
Fear 45.1%
Calm 48.9%
Confused 47.5%

AWS Rekognition

Age 39-57
Gender Female, 54.8%
Fear 45%
Surprised 45%
Angry 45%
Sad 45.1%
Disgusted 45%
Happy 45%
Calm 54.9%
Confused 45%

AWS Rekognition

Age 30-46
Gender Female, 52.1%
Happy 45%
Angry 45%
Disgusted 45%
Calm 47%
Fear 45%
Surprised 45%
Confused 45%
Sad 52.9%

AWS Rekognition

Age 36-54
Gender Male, 53%
Angry 45%
Surprised 45.1%
Sad 45%
Happy 50.9%
Calm 48.8%
Fear 45%
Confused 45.1%
Disgusted 45%

AWS Rekognition

Age 32-48
Gender Male, 53.3%
Calm 45.7%
Fear 45.1%
Confused 45%
Happy 53.7%
Angry 45.1%
Disgusted 45%
Sad 45.2%
Surprised 45.1%

Feature analysis

Amazon

Person 99%
Tie 58.6%

Captions

Microsoft

a group of people standing in front of a window 92.2%
a group of people standing next to a window 92.1%
a group of people posing for a photo 92%