Human Generated Data

Title

Untitled (football team, young boys, helmets)
Date

1939
People

Artist: Harris & Ewing, American 1910s-1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.22273

Human Generated Data

Title

Untitled (football team, young boys, helmets)

People

Artist: Harris & Ewing, American 1910s-1940s

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-11

Apparel 99.2
Shorts 99.2
Clothing 99.2
Person 99.1
Human 99.1
Person 98.9
Person 98.8
Person 97.8
Person 97.4
Person 96.6
Person 95.9
Person 94.4
Person 94.2
Person 92.9
Person 92.1
Person 90.6
Person 86.5
Person 85.9
Helmet 85.8
Boy 85.1
Face 84.5
Person 83.7
Person 80.3
Child 79.3
Kid 79.3
Outdoors 79
Person 77.3
People 73
Nature 72.6
Helmet 70.2
Person 65.4
Building 65.1
Helmet 62.1
Urban 58.5
Helmet 57.2
Dress 57.1
Audience 57
Crowd 57
Play 56.8
Sand 55.6
Person 52.9

Imagga
created on 2022-03-11

grunge 23
old 18.8
dirty 16.3
vintage 15.7
wall 15.2
structure 15.1
light 14.7
texture 14.6
dark 14.2
decoration 14.1
black 13.2
art 12.8
fountain 11.5
building 11.4
textured 11.4
antique 11.2
industrial 10.9
man 10.2
world 10.1
landscape 9.7
urban 9.6
pattern 9.6
outdoor 9.2
city 9.1
negative 9.1
aged 9
design 9
ride 8.9
water 8.7
stone 8.6
weathered 8.5
industry 8.5
grungy 8.5
tree 8.5
travel 8.4
power 8.4
house 8.3
carousel 8.2
rough 8.2
retro 8.2
graffito 8.1
rock 7.8
scene 7.8
ancient 7.8
factory 7.7
modern 7.7
concrete 7.6
newspaper 7.5
glass 7.5
effect 7.3
film 7.3
people 7.2
paint 7.2
color 7.2
resort area 7.2
surface 7
architecture 7

Google
created on 2022-03-11

Standing 86.4
Style 83.9
Black-and-white 83.7
Font 82.4
Monochrome photography 72.8
Monochrome 72.1
Event 69.4
Symmetry 67.5
Team 67.4
Crew 66.6
Room 64.4
Pattern 64.4
Chair 63.7
Visual arts 63.7
T-shirt 62.5
Uniform 61.1
Shorts 59.4
Illustration 56.3
Fun 54.4
Glass 54

Microsoft
created on 2022-03-11

person 93.2
text 89.2
posing 87.4
soccer 74.4
group 66.6
team 56.8

Face analysis

Amazon

AWS Rekognition

Age 47-53
Gender Male, 95.1%
Fear 73.8%
Happy 18.5%
Sad 4%
Calm 0.9%
Angry 0.9%
Disgusted 0.8%
Surprised 0.6%
Confused 0.6%

AWS Rekognition

Age 23-31
Gender Male, 98.7%
Calm 99.2%
Surprised 0.3%
Sad 0.2%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%
Happy 0.1%
Confused 0%

AWS Rekognition

Age 28-38
Gender Female, 64.1%
Calm 81.7%
Happy 7.7%
Surprised 5.3%
Disgusted 2.3%
Sad 1.4%
Angry 0.7%
Confused 0.5%
Fear 0.4%

AWS Rekognition

Age 28-38
Gender Female, 95.1%
Calm 67.6%
Happy 21.3%
Surprised 3.8%
Sad 2.9%
Fear 2.5%
Angry 0.9%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 23-33
Gender Male, 51.8%
Happy 40.2%
Fear 24.5%
Calm 21.6%
Surprised 5%
Angry 3.1%
Sad 2.7%
Disgusted 1.5%
Confused 1.4%

AWS Rekognition

Age 22-30
Gender Male, 91.9%
Calm 49.3%
Happy 15.6%
Angry 11.1%
Sad 7.5%
Confused 6.3%
Surprised 4.5%
Disgusted 4.1%
Fear 1.7%

AWS Rekognition

Age 31-41
Gender Female, 84.4%
Happy 98.3%
Calm 0.9%
Sad 0.3%
Surprised 0.2%
Fear 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 41-49
Gender Male, 80.2%
Happy 91.3%
Calm 2.3%
Sad 1.8%
Surprised 1.5%
Fear 1.2%
Disgusted 0.8%
Angry 0.6%
Confused 0.4%

AWS Rekognition

Age 26-36
Gender Female, 83.9%
Happy 84.4%
Surprised 7.8%
Calm 3.1%
Angry 1.6%
Fear 1%
Disgusted 1%
Sad 0.8%
Confused 0.4%

AWS Rekognition

Age 43-51
Gender Male, 99%
Happy 65.9%
Calm 26.9%
Sad 2%
Surprised 1.6%
Disgusted 1.3%
Angry 1.1%
Fear 0.7%
Confused 0.5%

AWS Rekognition

Age 35-43
Gender Male, 88.3%
Sad 42.6%
Happy 21.6%
Calm 10%
Disgusted 7.4%
Confused 6.3%
Surprised 5.2%
Fear 4.4%
Angry 2.6%

AWS Rekognition

Age 30-40
Gender Male, 94.2%
Calm 68.9%
Happy 25.8%
Sad 2.4%
Fear 0.8%
Confused 0.6%
Disgusted 0.6%
Surprised 0.6%
Angry 0.3%

AWS Rekognition

Age 31-41
Gender Male, 98%
Calm 99.7%
Happy 0.1%
Surprised 0.1%
Sad 0%
Fear 0%
Angry 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 43-51
Gender Female, 57.1%
Sad 49%
Happy 19.7%
Fear 14.1%
Calm 10.6%
Angry 2.2%
Surprised 1.9%
Disgusted 1.5%
Confused 1%

AWS Rekognition

Age 35-43
Gender Male, 99.5%
Happy 70.1%
Calm 23.5%
Surprised 2.1%
Sad 1.4%
Confused 1.2%
Fear 0.7%
Angry 0.5%
Disgusted 0.5%

AWS Rekognition

Age 23-33
Gender Male, 94.2%
Calm 99.7%
Surprised 0.1%
Happy 0.1%
Sad 0%
Disgusted 0%
Confused 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 42-50
Gender Female, 84.1%
Calm 70.4%
Happy 10.4%
Surprised 8.6%
Disgusted 3.3%
Sad 2.8%
Fear 2.2%
Angry 2%
Confused 0.4%

AWS Rekognition

Age 30-40
Gender Male, 94.8%
Calm 96.5%
Happy 1.6%
Sad 0.6%
Surprised 0.5%
Confused 0.2%
Angry 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 31-41
Gender Male, 69%
Sad 98.7%
Calm 0.9%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 39-47
Gender Male, 94%
Calm 43.8%
Happy 21.4%
Sad 17.2%
Disgusted 10.1%
Confused 2.9%
Angry 2%
Surprised 1.6%
Fear 0.9%

Feature analysis

Amazon

Person 99.1%
Helmet 85.8%

Captions

Microsoft

a group of people posing for a photo 92.2%
a group of men posing for a photo 87.6%
a group of kids posing for a photo 68.6%

Text analysis

Amazon

F
4

Google

F
F