Human Generated Data

Title

Untitled (large group of women and children gathered around picnic table and tree for enrollment in swim class)
Date

1954
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3285

Human Generated Data

Title

Untitled (large group of women and children gathered around picnic table and tree for enrollment in swim class)

People

Artist: Harry Annas, American 1897 - 1980

Date

1954

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 100
Apparel 100
Dress 99.3
Female 99
Human 99
Person 99
Person 98.3
Person 98
Person 94.7
Woman 94.6
Person 94.3
Person 92.7
Skirt 91.6
Person 91
Person 88.4
Crowd 86.7
Person 86.1
Person 85.9
Face 77.4
Person 77.4
Shoe 76.6
Footwear 76.6
Person 75
Suit 71.9
Coat 71.9
Overcoat 71.9
People 69.6
Person 69
Gown 69
Fashion 69
Girl 68.1
Portrait 68.1
Photography 68.1
Photo 68.1
Party 67.4
Robe 64.8
Dog 60.5
Mammal 60.5
Animal 60.5
Canine 60.5
Pet 60.5
Stage 59.8
Person 58.8
Kid 57.9
Child 57.9
Festival 55.8
Shoe 51.3

Imagga
created on 2022-01-22

carousel 16.6
art 16
chandelier 15.5
old 14.6
people 13.9
architecture 13.3
ride 13
light 12.7
religion 12.5
party 12
black 12
world 11.3
style 11.1
glass 11
building 10.7
night 10.6
boutique 10.5
decoration 10.3
culture 10.2
man 10.1
lighting fixture 10
dark 10
mechanical device 10
dress 9.9
gold 9.9
interior 9.7
celebration 9.6
holiday 9.3
music 9.1
symbol 8.7
love 8.7
water 8.7
crowd 8.6
grunge 8.5
religious 8.4
color 8.3
church 8.3
inside 8.3
silhouette 8.3
vintage 8.3
stall 8.2
group 8.1
history 8
design 7.9
couple 7.8
rock 7.8
ancient 7.8
holy 7.7
wall 7.7
bride 7.7
god 7.6
kin 7.5
fixture 7.5
bass 7.5
city 7.5
place 7.4
tradition 7.4
historic 7.3
metropolitan 7.3
window 7.1

Google
created on 2022-01-22

Photograph 94.1
Plant 82.2
Art 80.9
Adaptation 79.2
Tree 75.4
Snapshot 74.3
Painting 74.2
Event 73.2
Room 69.3
Monochrome photography 69.2
Vintage clothing 69
Monochrome 68.6
Visual arts 67.9
History 65.5
Stock photography 63
Classic 58.8
Photographic paper 58.2
Illustration 57.9
Pole 55.6
Photography 51.9

Microsoft
created on 2022-01-22

text 97.3
clothing 87.3
dance 85.8
person 81
people 78.4
woman 54.1
crowd 22.9
clothes 15.3

Face analysis

Amazon

Google

AWS Rekognition

Age 53-61
Gender Female, 89.7%
Calm 99.8%
Happy 0.1%
Sad 0%
Surprised 0%
Disgusted 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 80.1%
Calm 88.5%
Happy 9.1%
Sad 0.7%
Fear 0.4%
Angry 0.4%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%

AWS Rekognition

Age 28-38
Gender Female, 96.8%
Happy 42.2%
Sad 32.2%
Calm 14.5%
Fear 3.6%
Surprised 2.4%
Confused 1.9%
Angry 1.8%
Disgusted 1.5%

AWS Rekognition

Age 30-40
Gender Female, 87.6%
Calm 82.1%
Surprised 7.6%
Sad 7.2%
Confused 1.5%
Disgusted 1.1%
Happy 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 95.4%
Sad 83.4%
Calm 6.7%
Angry 2.8%
Happy 2.7%
Disgusted 1.8%
Fear 1.4%
Confused 0.7%
Surprised 0.4%

AWS Rekognition

Age 41-49
Gender Female, 71.1%
Calm 90.3%
Surprised 6.6%
Happy 1.5%
Fear 0.7%
Confused 0.3%
Disgusted 0.3%
Sad 0.2%
Angry 0.1%

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Calm 65.9%
Happy 18.4%
Sad 11%
Confused 1.5%
Surprised 1%
Fear 0.9%
Disgusted 0.7%
Angry 0.6%

AWS Rekognition

Age 13-21
Gender Male, 99.8%
Calm 41.1%
Surprised 21.9%
Happy 19.8%
Sad 6%
Fear 4.6%
Disgusted 3.6%
Confused 2%
Angry 1%

AWS Rekognition

Age 21-29
Gender Female, 67.5%
Calm 42.8%
Happy 42.1%
Sad 7.8%
Surprised 3%
Disgusted 1.6%
Angry 1.1%
Confused 1%
Fear 0.6%

AWS Rekognition

Age 36-44
Gender Female, 99.6%
Calm 96.1%
Sad 2.6%
Happy 0.6%
Fear 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 23-31
Gender Male, 96.1%
Calm 97.6%
Sad 0.9%
Surprised 0.7%
Happy 0.3%
Disgusted 0.2%
Angry 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 42-50
Gender Female, 78.9%
Happy 84.9%
Calm 7.1%
Surprised 5.3%
Disgusted 0.7%
Fear 0.6%
Sad 0.6%
Confused 0.5%
Angry 0.3%

AWS Rekognition

Age 45-53
Gender Male, 97.7%
Calm 70.3%
Surprised 27.3%
Happy 1.9%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Sad 0%

AWS Rekognition

Age 27-37
Gender Female, 69.5%
Calm 56%
Fear 22.2%
Happy 10.8%
Disgusted 2.9%
Sad 2.1%
Surprised 2.1%
Confused 2%
Angry 1.9%

AWS Rekognition

Age 24-34
Gender Female, 70%
Happy 62%
Calm 18.2%
Sad 9.6%
Fear 4.3%
Confused 2.6%
Disgusted 1.3%
Angry 1.2%
Surprised 0.8%

AWS Rekognition

Age 42-50
Gender Male, 97.6%
Happy 56.3%
Calm 40.6%
Surprised 1.6%
Disgusted 0.5%
Angry 0.4%
Fear 0.2%
Confused 0.2%
Sad 0.2%

AWS Rekognition

Age 37-45
Gender Female, 97.8%
Calm 90%
Happy 7.7%
Sad 1.6%
Fear 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%

AWS Rekognition

Age 25-35
Gender Female, 63.3%
Calm 69.5%
Happy 13%
Confused 5.9%
Fear 5.6%
Sad 2.4%
Surprised 2.4%
Disgusted 0.6%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Shoe 76.6%
Dog 60.5%

Captions

Microsoft

a group of people standing in front of a crowd 80.4%
a group of people standing in front of a crowd of people 79.3%
a group of people standing in front of a building 79.2%

Text analysis

Amazon

12
KODAK
SAFETY
PILLA