Human Generated Data

Title

Untitled (older boy’s football team, Friends School)

Date

1939

People

Artist: Harris & Ewing, American 1910s-1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22269

Human Generated Data

Title

Untitled (older boy’s football team, Friends School)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Human 99.8
Person 99.8
Person 99.5
Boy 99
Person 98.7
Person 98.5
Person 97.4
Person 97.1
Clothing 97.1
Apparel 97.1
Person 96.9
Person 96.3
Person 95.9
Helmet 95.2
Person 95
Person 94.4
Person 93.9
Person 92.4
Shorts 90.9
Person 90.2
Helmet 89.9
Helmet 89.8
Kid 84.7
Child 84.7
Face 84
Person 82.9
Person 82.5
Person 82.3
Grass 81.9
Plant 81.9
Person 78.6
People 75
Person 74.2
Helmet 73.4
Helmet 63
Photo 62.5
Photography 62.5
Girl 60.4
Female 60.4
Chair 59.8
Furniture 59.8
Sport 58.6
Sports 58.6
Play 55.3
Person 43.6

Imagga
created on 2022-03-11

negative 63.6
film 51.3
photographic paper 39.6
photographic equipment 26.4
dancer 25
performer 18.8
art 16.6
black 14.4
grunge 13.6
entertainer 13.5
water 13.3
person 12.8
dance 12.4
man 12.1
pattern 10.9
dark 10.8
cool 10.6
people 10.6
silhouette 9.9
old 9.7
style 9.6
design 9.6
body 9.6
modern 9.1
dirty 9
texture 9
model 8.5
decoration 8.5
fashion 8.3
smooth 8.2
retro 8.2
dress 8.1
wet 8
light 8
text 7.8
male 7.8
creation 7.7
outdoor 7.6
vintage 7.4
symbol 7.4
aged 7.2
sexy 7.2
adult 7.2
river 7.1
night 7.1
graffito 7.1

Google
created on 2022-03-11

Black 89.7
People 78.2
Crew 78.1
Player 73.8
Vintage clothing 73.3
Uniform 72.6
Team sport 72.3
Monochrome 71.6
Team 69.6
Fun 64.5
Competition event 63.5
Monochrome photography 61.6
Font 60.6
Room 59.9
Sports 58.4
History 58.4
Football 53.2
Photo caption 52.8
Illustration 52.7
Class 52

Microsoft
created on 2022-03-11

text 95.5
outdoor 86
posing 78.2
soccer 66.8
player 65.7
team 62.9
old 42.1

Face analysis

Amazon

AWS Rekognition

Age 18-26
Gender Male, 86.8%
Calm 99.7%
Sad 0.1%
Fear 0%
Happy 0%
Confused 0%
Disgusted 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 25-35
Gender Female, 62.6%
Surprised 46.7%
Fear 24.4%
Calm 10.3%
Happy 10.2%
Disgusted 2.9%
Sad 2.5%
Confused 1.6%
Angry 1.4%

AWS Rekognition

Age 16-22
Gender Male, 64.1%
Calm 68.4%
Happy 8.2%
Angry 5.9%
Surprised 5.4%
Sad 4.1%
Disgusted 3.6%
Fear 3.1%
Confused 1.2%

AWS Rekognition

Age 24-34
Gender Male, 88.2%
Calm 83.7%
Sad 4.3%
Surprised 4.2%
Confused 2.4%
Disgusted 1.8%
Happy 1.7%
Angry 1.4%
Fear 0.6%

AWS Rekognition

Age 28-38
Gender Male, 99%
Happy 98.2%
Disgusted 0.6%
Confused 0.4%
Surprised 0.3%
Angry 0.2%
Sad 0.2%
Fear 0.1%
Calm 0.1%

AWS Rekognition

Age 36-44
Gender Male, 99.7%
Calm 93.4%
Fear 2.3%
Angry 1.3%
Happy 1.1%
Surprised 0.9%
Sad 0.5%
Confused 0.3%
Disgusted 0.3%

AWS Rekognition

Age 26-36
Gender Female, 81.4%
Calm 53.6%
Disgusted 20.1%
Surprised 10.7%
Happy 9.8%
Sad 2%
Confused 1.7%
Angry 1.4%
Fear 0.7%

AWS Rekognition

Age 21-29
Gender Male, 96.6%
Sad 84.1%
Calm 9.1%
Disgusted 2.3%
Confused 1.8%
Surprised 1%
Angry 0.7%
Fear 0.5%
Happy 0.4%

AWS Rekognition

Age 18-26
Gender Male, 97.5%
Calm 87.4%
Angry 5.3%
Confused 3.7%
Surprised 1.2%
Sad 0.7%
Disgusted 0.7%
Happy 0.6%
Fear 0.3%

AWS Rekognition

Age 26-36
Gender Female, 55%
Fear 53.9%
Angry 16.2%
Sad 9.5%
Confused 8.9%
Calm 5.5%
Happy 2.5%
Disgusted 2%
Surprised 1.5%

AWS Rekognition

Age 14-22
Gender Female, 78%
Calm 33.5%
Angry 21.5%
Sad 14.9%
Fear 9.3%
Disgusted 6.3%
Surprised 6%
Confused 5.8%
Happy 2.8%

AWS Rekognition

Age 30-40
Gender Male, 51.4%
Sad 53.5%
Surprised 12.8%
Calm 12.5%
Fear 9.5%
Disgusted 8.3%
Happy 1.2%
Confused 1.1%
Angry 1.1%

AWS Rekognition

Age 23-33
Gender Male, 94.8%
Calm 94.2%
Sad 1.4%
Fear 1.4%
Happy 1.3%
Confused 0.8%
Disgusted 0.4%
Angry 0.3%
Surprised 0.2%

AWS Rekognition

Age 23-33
Gender Male, 89.4%
Calm 51.2%
Angry 31.8%
Happy 6.8%
Sad 4.3%
Disgusted 2.5%
Surprised 1.8%
Confused 0.9%
Fear 0.7%

AWS Rekognition

Age 23-33
Gender Male, 97.8%
Calm 45.7%
Happy 19.2%
Fear 13.1%
Surprised 10.8%
Sad 5%
Angry 2.5%
Disgusted 2%
Confused 1.8%

AWS Rekognition

Age 25-35
Gender Male, 97.7%
Calm 97%
Sad 1.4%
Happy 0.6%
Surprised 0.3%
Confused 0.2%
Fear 0.2%
Angry 0.2%
Disgusted 0.1%

AWS Rekognition

Age 35-43
Gender Female, 76.4%
Happy 88.6%
Surprised 7%
Calm 2.2%
Angry 1%
Sad 0.5%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Male, 92.1%
Calm 22.7%
Angry 18.5%
Fear 16.3%
Surprised 15.3%
Sad 9%
Disgusted 8%
Happy 7.6%
Confused 2.6%

Feature analysis

Amazon

Person 99.8%
Helmet 95.2%

Captions

Microsoft

a group of people posing for a photo 92.3%
a group of people posing for a picture 92.2%
a group of people posing for the camera 92.1%

Text analysis

Amazon

Friends
47
-36
'39
Jr
Use

Google

YT3TA2-HAMTRAS
HAGON
HAGON YT3TA2-HAMTRAS