Human Generated Data

Title

Untitled (large group of women and children gathered around picnic table and tree for enrollment in swim class)
Date

1954
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3286

Human Generated Data

Title

Untitled (large group of women and children gathered around picnic table and tree for enrollment in swim class)

People

Artist: Harry Annas, American 1897 - 1980

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.8
Apparel 99.8
Person 99.7
Human 99.7
Person 99.6
Person 98.8
Person 98.6
Person 97.5
Person 97.4
Female 96.4
Dress 93.8
Skirt 91.4
Person 90.7
Woman 88
Person 87.5
Shoe 84.8
Footwear 84.8
Person 81.5
Shoe 76.7
People 74.9
Person 73.2
Crowd 72.3
Person 67.8
Person 63.1
Party 62
Portrait 60.5
Photography 60.5
Face 60.5
Photo 60.5
Shoe 60.2
Girl 56.4
Shorts 55.5
Robe 55.3
Fashion 55.3
Shoe 50.8

Imagga
created on 2022-01-22

musical instrument 33.2
accordion 26.7
wind instrument 23.9
people 22.9
keyboard instrument 21.7
person 18.9
performer 18.1
musician 14.5
adult 14.4
singer 14.3
man 13.4
dress 11.7
religion 11.6
entertainer 11.6
teacher 11.2
celebration 11.2
love 11
dancer 11
holiday 10.7
male 10.6
art 10.5
couple 10.4
old 10.4
men 10.3
life 10.3
stage 9.9
portrait 9.7
black 9.7
scene 9.5
women 9.5
architecture 9.4
two 9.3
groom 9.3
church 9.2
kin 9.1
business 9.1
history 8.9
group 8.9
happy 8.8
party 8.6
culture 8.5
building 8.4
educator 8.4
color 8.3
fashion 8.3
lady 8.1
happiness 7.8
world 7.8
room 7.7
crowd 7.7
bride 7.7
god 7.6
traditional 7.5
silhouette 7.4
vintage 7.4
tradition 7.4
wedding 7.4
decoration 7.2
night 7.1
face 7.1
professional 7.1
travel 7

Google
created on 2022-01-22

Black-and-white 84.6
Style 83.9
Art 80.9
Adaptation 79.3
Hat 76.6
Event 72.8
Plant 72.7
Monochrome 72.1
Monochrome photography 71.9
Vintage clothing 71.5
Room 71.3
Photo caption 68.1
Visual arts 67.7
History 67.2
Font 67
Stock photography 63.1
Illustration 60.8
Suit 59.6
Photographic paper 59
Umbrella 58.7

Microsoft
created on 2022-01-22

dance 98.3
person 97.1
clothing 96.7
text 94.3
outdoor 90.5
woman 88.3
footwear 82.5
people 80.9
black and white 73.8
group 70.6
dress 68.7
dancer 50.2
crowd 20.4

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 80.5%
Calm 99.8%
Surprised 0.1%
Confused 0%
Happy 0%
Disgusted 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Female, 70.5%
Happy 67.4%
Sad 26.4%
Fear 2%
Surprised 1.4%
Calm 1.3%
Confused 0.6%
Disgusted 0.5%
Angry 0.4%

AWS Rekognition

Age 48-54
Gender Female, 62.8%
Calm 61%
Happy 23.9%
Disgusted 7.4%
Sad 2.6%
Confused 2.1%
Surprised 1.2%
Angry 0.9%
Fear 0.8%

AWS Rekognition

Age 23-31
Gender Male, 72.4%
Calm 92.1%
Happy 5.1%
Disgusted 1.6%
Fear 0.6%
Surprised 0.2%
Sad 0.2%
Angry 0.1%
Confused 0.1%

AWS Rekognition

Age 33-41
Gender Female, 50.7%
Calm 98.7%
Happy 0.5%
Angry 0.3%
Surprised 0.2%
Sad 0.1%
Disgusted 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Female, 65.3%
Calm 98.5%
Sad 0.8%
Fear 0.5%
Confused 0.1%
Happy 0.1%
Disgusted 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 12-20
Gender Female, 95.4%
Calm 35.6%
Confused 14.9%
Happy 12.4%
Sad 11.5%
Fear 9.7%
Surprised 8.1%
Disgusted 4.7%
Angry 3.1%

AWS Rekognition

Age 23-31
Gender Male, 86.7%
Happy 87.3%
Calm 6.7%
Sad 1.8%
Fear 1.6%
Surprised 0.9%
Disgusted 0.8%
Confused 0.5%
Angry 0.4%

AWS Rekognition

Age 28-38
Gender Female, 83.8%
Calm 89.4%
Happy 3.8%
Sad 3.5%
Surprised 1.5%
Angry 0.7%
Disgusted 0.5%
Confused 0.5%
Fear 0.2%

AWS Rekognition

Age 21-29
Gender Female, 50%
Happy 56.5%
Calm 31%
Angry 3.6%
Disgusted 3.5%
Confused 2%
Surprised 1.5%
Sad 1.3%
Fear 0.6%

AWS Rekognition

Age 43-51
Gender Female, 86.2%
Calm 99.9%
Surprised 0.1%
Confused 0%
Happy 0%
Sad 0%
Disgusted 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 24-34
Gender Female, 59.7%
Happy 63.2%
Calm 14.8%
Fear 10.3%
Sad 5.6%
Disgusted 2%
Angry 1.9%
Confused 1.3%
Surprised 1%

AWS Rekognition

Age 4-10
Gender Female, 80.2%
Calm 55.1%
Sad 22.6%
Happy 17.5%
Confused 2%
Angry 1%
Surprised 0.9%
Disgusted 0.5%
Fear 0.4%

AWS Rekognition

Age 20-28
Gender Female, 93.9%
Happy 84.7%
Calm 8.8%
Sad 5.4%
Angry 0.4%
Confused 0.2%
Surprised 0.2%
Fear 0.2%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.7%
Shoe 84.8%

Captions

Microsoft

a group of people standing in front of a crowd 90.8%
a group of people standing in front of a building 90.7%
a group of people standing in front of a crowd posing for the camera 86.6%

Text analysis

Amazon

11
KODAK
SAFETY KODAK
SAFETY
PELE