Human Generated Data

Title

Untitled (Lockhart high school football team on bleachers)

Date

1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11208

Human Generated Data

Title

Untitled (Lockhart high school football team on bleachers)

People

Artist: Harry Annas, American 1897 - 1980

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.7
Person 99.7
Person 99.7
Person 99.6
Person 99.6
Person 99.3
Person 99.2
Person 99.2
Person 99
People 99
Person 98.9
Person 98.8
Person 98.6
Sports 98.3
Athlete 98.3
Sport 98.3
Team Sport 96.4
Team 96.4
Person 89.3
Apparel 88.2
Clothing 88.2
Ballplayer 87.2
Baseball 87.2
Softball 87.2
Person 72.4
Helmet 69.5
Person 65.3
Person 55.5
Person 49.7
Person 46
Person 44.1
Person 43

Imagga
created on 2022-01-23

cemetery 78.4
gravestone 43
memorial 37.3
stone 33
people 20.6
structure 18.7
silhouette 17.4
old 15.3
group 15.3
man 15
travel 14.8
male 14.2
tourism 14
sky 13.4
architecture 13.3
landscape 11.9
history 11.6
men 11.2
landmark 10.8
black 10.8
sand 10.4
outdoors 10.4
tourist 10.4
ancient 10.4
person 10.1
beach 10.1
city 10
summer 9.6
kin 9.6
crowd 9.6
culture 9.4
sunset 9
dusk 8.6
building 8.5
walking 8.5
friends 8.4
adult 8.4
world 8.3
uniform 8.1
women 7.9
business 7.9
couple 7.8
military 7.7
outdoor 7.6
dark 7.5
monument 7.5
famous 7.4
water 7.3
art 7.2
portrait 7.1
night 7.1
sea 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

posing 99.8
group 98.1
baseball 98.1
clothing 89.9
standing 89.5
person 86
old 84.6
team 77.9
text 63.1
man 62.4
bunch 56.6
lined 37.4
crowd 0.7

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Female, 88.4%
Calm 99.8%
Angry 0.1%
Sad 0%
Surprised 0%
Confused 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Female, 52.2%
Calm 94.8%
Angry 3.1%
Sad 1.2%
Surprised 0.4%
Confused 0.3%
Happy 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 98.7%
Happy 99.2%
Calm 0.3%
Sad 0.2%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 90.3%
Angry 4.6%
Sad 1.4%
Happy 1.4%
Confused 0.7%
Disgusted 0.7%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 16-24
Gender Male, 99.8%
Happy 99.9%
Angry 0%
Surprised 0%
Calm 0%
Confused 0%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 97.7%
Angry 0.8%
Sad 0.5%
Confused 0.4%
Happy 0.3%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Male, 100%
Happy 99.8%
Calm 0.1%
Angry 0%
Surprised 0%
Confused 0%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 99.6%
Calm 97%
Happy 1.9%
Sad 0.5%
Angry 0.3%
Confused 0.1%
Fear 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 99.7%
Happy 0.1%
Sad 0.1%
Angry 0.1%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 40-48
Gender Male, 98.4%
Calm 86.2%
Happy 10.9%
Angry 0.7%
Sad 0.7%
Surprised 0.6%
Confused 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 99.4%
Angry 0.2%
Sad 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Male, 96.3%
Happy 89.2%
Calm 10.5%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 99.5%
Happy 99%
Calm 0.6%
Surprised 0.1%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 94.6%
Sad 2.3%
Happy 0.9%
Confused 0.8%
Angry 0.8%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 98.2%
Sad 1%
Angry 0.6%
Confused 0.1%
Happy 0.1%
Fear 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 99.9%
Sad 0.1%
Angry 0%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 13-21
Gender Male, 100%
Happy 63.4%
Calm 24.2%
Sad 10.5%
Angry 0.5%
Fear 0.5%
Disgusted 0.4%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Happy 51.5%
Calm 47.4%
Surprised 0.3%
Confused 0.2%
Fear 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.7%
Happy 99.3%
Calm 0.3%
Fear 0.1%
Surprised 0.1%
Angry 0.1%
Sad 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 30-40
Gender Male, 99.7%
Calm 76%
Sad 10.7%
Angry 7.4%
Fear 2.9%
Happy 1.1%
Confused 0.7%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 25-35
Gender Female, 81.4%
Happy 99.1%
Calm 0.5%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 83.1%
Happy 10.6%
Angry 2.2%
Sad 1.9%
Confused 1.1%
Surprised 0.4%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 89.9%
Happy 4.4%
Confused 1.5%
Angry 1.5%
Sad 1.1%
Disgusted 0.7%
Surprised 0.5%
Fear 0.5%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 94.7%
Angry 2.2%
Confused 1.1%
Happy 0.9%
Surprised 0.4%
Sad 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 27.7%
Happy 25.1%
Angry 24.1%
Sad 13.4%
Surprised 3.7%
Confused 2.9%
Disgusted 1.6%
Fear 1.5%

AWS Rekognition

Age 25-35
Gender Male, 100%
Happy 90.1%
Calm 2.2%
Angry 2%
Confused 1.8%
Fear 1.4%
Sad 1.3%
Surprised 0.8%
Disgusted 0.5%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 98.1%
Sad 0.8%
Angry 0.4%
Confused 0.3%
Happy 0.3%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 99.2%
Calm 99.6%
Happy 0.1%
Angry 0.1%
Sad 0%
Confused 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 99.4%
Happy 93.9%
Calm 2.4%
Surprised 0.9%
Angry 0.9%
Fear 0.6%
Sad 0.5%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 25-35
Gender Male, 99.6%
Calm 74.5%
Happy 20.3%
Angry 1.8%
Confused 1.4%
Sad 1.1%
Fear 0.3%
Surprised 0.3%
Disgusted 0.3%

AWS Rekognition

Age 19-27
Gender Female, 93.4%
Calm 96.8%
Sad 1.2%
Angry 0.9%
Confused 0.5%
Surprised 0.3%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Happy 50.4%
Calm 43.8%
Sad 2.5%
Fear 0.9%
Confused 0.7%
Angry 0.7%
Surprised 0.5%
Disgusted 0.5%

AWS Rekognition

Age 22-30
Gender Female, 98.5%
Happy 99.3%
Calm 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 97.8%
Confused 0.8%
Sad 0.7%
Angry 0.5%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 92.4%
Angry 5.3%
Sad 1.1%
Confused 0.5%
Surprised 0.2%
Fear 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 27-37
Gender Male, 84.8%
Happy 99.3%
Calm 0.4%
Surprised 0.1%
Angry 0.1%
Fear 0%
Confused 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 75.8%
Happy 12%
Sad 5.3%
Angry 3.2%
Confused 1.6%
Disgusted 1%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 99.9%
Angry 0.1%
Sad 0.1%
Surprised 0%
Confused 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 30-40
Gender Male, 100%
Happy 82.8%
Calm 9.9%
Angry 1.5%
Fear 1.4%
Confused 1.4%
Sad 1%
Surprised 1%
Disgusted 0.9%

AWS Rekognition

Age 18-24
Gender Female, 59.8%
Calm 99.9%
Happy 0%
Confused 0%
Sad 0%
Angry 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 95.1%
Sad 4.4%
Angry 0.2%
Confused 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 96.6%
Happy 99.5%
Calm 0.1%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Sad 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Happy 50.7%
Calm 22.4%
Sad 17.9%
Angry 5%
Fear 1.5%
Disgusted 1%
Surprised 0.8%
Confused 0.7%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 99.6%
Happy 0.2%
Angry 0%
Confused 0%
Sad 0%
Surprised 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Helmet 69.5%

Captions

Microsoft

a group of people posing for a photo 97.8%
a group of men posing for a photo 97%
a group of people posing for the camera 96.9%

Text analysis

Amazon

16
23
17
22
12
8
6
2
30
32
35
19
14
15
11
20
27
13
36
1
10
28

Google

27
8
15
283
12
13
14
E
g
23
32
36
35
22
11
17
30
16
8 35 27 E g 8 22 15 283 23 2 20 21 12 13 22 32 14 19 11 17 36 30 16
20
19
2
21