Human Generated Data

Title

Untitled (Lockhart High School football team)
Date

1940
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2213

Human Generated Data

Title

Untitled (Lockhart High School football team)

People

Artist: Harry Annas, American 1897 - 1980

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.8
Human 99.8
Person 99.7
Person 99.7
Person 99.6
Person 99.6
Person 99.5
Clothing 99.4
Shorts 99.4
Apparel 99.4
Boy 99.2
Person 99.1
Person 99
Person 98.9
Person 98
Person 96.1
Person 94.6
People 93.8
Person 79.3
Child 70.5
Kid 70.5
Team Sport 68.8
Team 68.8
Sport 68.8
Sports 68.8
Helmet 62.4
Text 61.1
Troop 55.4
Military 55.4
Military Uniform 55.4
Army 55.4
Armored 55.4
Person 50.1
Person 42.4

Imagga
created on 2021-12-14

gymnasium 34.2
night 33.7
city 29.1
athletic facility 27.6
architecture 23.4
picket fence 23.3
facility 22.3
sky 18.5
dark 18.4
urban 18.3
structure 18.3
building 18.3
fence 18.2
water 16
barrier 14.1
silhouette 14.1
lights 13.9
scene 13.8
tower 13.4
travel 13.4
fountain 13.2
evening 13.1
black 12.6
light 12
old 11.8
sunset 11.7
history 11.6
skyline 11.4
landscape 11.2
man 10.6
person 10.6
downtown 10.6
cityscape 10.4
buildings 10.4
kin 10.3
stall 10.1
people 10
tree 10
river 9.8
house 9.5
obstruction 9.4
sun 8.9
flag 8.6
famous 8.4
business 7.9
sea 7.8
winter 7.7
illuminated 7.6
clouds 7.6
beach 7.6
ocean 7.6
outdoors 7.5
vintage 7.4
tourism 7.4
industrial 7.3
landmark 7.2
summer 7.1

Google
created on 2021-12-14

Football equipment 88.5
Shorts 88.1
Player 86.9
Jersey 86.2
Sports jersey 86.1
American football 86
Ball game 83.9
Sports uniform 82.7
Team sport 81.5
People 78.2
Font 77.6
Crew 77.1
Sports 76.9
Sports gear 76.8
Personal protective equipment 75.4
Uniform 74.4
Football gear 73.7
Helmet 73.5
Team 69.9
Suit 66.8

Microsoft
created on 2021-12-14

posing 96.8
text 96.6
clothing 94.3
outdoor 92.1
person 91.3
group 85.6
standing 81.6
baseball 75.4
white 62.4
old 53.1

Face analysis

Amazon

Google

AWS Rekognition

Age 38-56
Gender Male, 91.3%
Calm 47.9%
Happy 47.4%
Surprised 1.7%
Angry 1.5%
Sad 0.5%
Confused 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 27-43
Gender Female, 89.4%
Calm 80.9%
Happy 9.2%
Surprised 3.2%
Angry 2.2%
Sad 1.6%
Fear 1.3%
Confused 0.9%
Disgusted 0.8%

AWS Rekognition

Age 40-58
Gender Female, 82.3%
Calm 66%
Happy 25.9%
Angry 2.7%
Surprised 1.7%
Sad 1.5%
Confused 1.1%
Disgusted 0.7%
Fear 0.5%

AWS Rekognition

Age 46-64
Gender Male, 98%
Calm 97.1%
Happy 1.3%
Surprised 0.4%
Angry 0.3%
Sad 0.3%
Confused 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Female, 57.2%
Calm 47.8%
Happy 45.6%
Surprised 1.9%
Angry 1.3%
Disgusted 1.3%
Sad 0.9%
Confused 0.7%
Fear 0.5%

AWS Rekognition

Age 31-47
Gender Female, 54.3%
Surprised 57.1%
Calm 20.3%
Confused 8.9%
Happy 7.1%
Sad 2.6%
Fear 2.1%
Angry 1.3%
Disgusted 0.5%

AWS Rekognition

Age 48-66
Gender Male, 98.2%
Calm 87.4%
Happy 9.3%
Sad 2.4%
Surprised 0.3%
Angry 0.3%
Confused 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 45-63
Gender Female, 73.4%
Happy 55.1%
Calm 43%
Sad 0.6%
Surprised 0.4%
Angry 0.3%
Confused 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 28-44
Gender Female, 68.1%
Calm 88.4%
Happy 6.9%
Angry 1.8%
Sad 0.9%
Surprised 0.8%
Confused 0.5%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 46-64
Gender Female, 77.8%
Calm 98%
Happy 0.7%
Surprised 0.3%
Sad 0.3%
Angry 0.2%
Confused 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 49-67
Gender Female, 55.2%
Calm 74.5%
Angry 10.4%
Surprised 5.1%
Disgusted 3.3%
Fear 2.7%
Happy 1.8%
Sad 1.5%
Confused 0.8%

AWS Rekognition

Age 41-59
Gender Female, 95.2%
Happy 58.9%
Calm 33.2%
Surprised 4.7%
Confused 0.8%
Angry 0.8%
Fear 0.6%
Sad 0.5%
Disgusted 0.5%

AWS Rekognition

Age 47-65
Gender Male, 89.5%
Calm 95.4%
Angry 2.4%
Surprised 0.7%
Sad 0.6%
Happy 0.5%
Disgusted 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 27-43
Gender Male, 94.6%
Calm 70.4%
Happy 22.7%
Surprised 2.8%
Angry 1.2%
Confused 1%
Sad 0.8%
Disgusted 0.8%
Fear 0.4%

AWS Rekognition

Age 22-34
Gender Male, 89.3%
Calm 78.4%
Happy 9.5%
Surprised 7.2%
Angry 2.1%
Confused 1%
Fear 0.7%
Sad 0.6%
Disgusted 0.5%

AWS Rekognition

Age 45-63
Gender Male, 90.5%
Calm 80.6%
Happy 6%
Angry 5.7%
Surprised 2.7%
Fear 2.2%
Sad 1.1%
Disgusted 1%
Confused 0.7%

AWS Rekognition

Age 45-63
Gender Male, 53.8%
Calm 65.2%
Happy 30%
Surprised 2.1%
Sad 0.9%
Angry 0.7%
Fear 0.5%
Confused 0.5%
Disgusted 0.2%

AWS Rekognition

Age 16-28
Gender Female, 71.1%
Calm 49.3%
Happy 29.6%
Surprised 9.8%
Fear 5.6%
Angry 3.9%
Sad 1%
Confused 0.6%
Disgusted 0.3%

AWS Rekognition

Age 26-40
Gender Female, 58.1%
Surprised 30.9%
Fear 24.4%
Calm 23.4%
Angry 15.5%
Happy 3.5%
Confused 0.9%
Sad 0.7%
Disgusted 0.6%

AWS Rekognition

Age 22-34
Gender Female, 87.1%
Calm 88%
Surprised 5.5%
Happy 4.4%
Confused 0.6%
Fear 0.5%
Sad 0.4%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 26-40
Gender Male, 51.9%
Calm 52.8%
Surprised 22.8%
Angry 8.3%
Happy 8.2%
Confused 3.6%
Disgusted 2%
Sad 1.3%
Fear 1%

AWS Rekognition

Age 49-67
Gender Female, 87.1%
Calm 46.8%
Fear 20.2%
Happy 14.9%
Surprised 12.4%
Sad 1.8%
Angry 1.8%
Confused 1.3%
Disgusted 0.8%

AWS Rekognition

Age 23-35
Gender Male, 61.2%
Calm 58.2%
Surprised 33.7%
Happy 4.3%
Fear 1.3%
Angry 0.9%
Sad 0.7%
Confused 0.6%
Disgusted 0.4%

AWS Rekognition

Age 51-69
Gender Male, 95.7%
Happy 63.6%
Calm 26%
Angry 7.4%
Sad 1.9%
Surprised 0.5%
Fear 0.3%
Confused 0.2%
Disgusted 0.1%

AWS Rekognition

Age 51-69
Gender Female, 90.9%
Calm 79%
Surprised 15%
Fear 1.9%
Happy 1.4%
Angry 1%
Sad 0.8%
Confused 0.5%
Disgusted 0.4%

AWS Rekognition

Age 23-35
Gender Male, 57.2%
Calm 98.3%
Happy 0.5%
Surprised 0.4%
Sad 0.3%
Confused 0.3%
Angry 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 38-56
Gender Male, 84.2%
Calm 74.5%
Happy 10.6%
Surprised 9.4%
Angry 2%
Confused 1.7%
Disgusted 1%
Sad 0.5%
Fear 0.3%

AWS Rekognition

Age 26-40
Gender Female, 50.3%
Calm 37.6%
Angry 25.6%
Happy 21.4%
Surprised 6.6%
Disgusted 3.6%
Sad 2.3%
Confused 2.1%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Helmet 62.4%

Captions

Microsoft

a group of people posing for a photo 96.9%
a group of people posing for a picture 96.8%
a group of people posing for the camera 96.7%

Text analysis

Amazon

17
14
23
16
22
15
13
27
6
20
2
11
30
12
32
35
8
29
36
19
O
OC
1
RYLETA

Google

835 22 27 15 2 20 2 29 23 12 A 16 13 22 32 14 19 11 17 36 30
15
2
11
16
13
17
30
20
12
A
19
36
835
29
23
32
14
22
27