Human Generated Data

Title

Untitled (Lockhart high school football team on bleachers)

Date

1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11208

Human Generated Data

Title

Untitled (Lockhart high school football team on bleachers)

People

Artist: Harry Annas, American 1897 - 1980

Date

1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11208

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.7
Human 99.7
Person 99.7
Person 99.6
Person 99.6
Person 99.3
Person 99.2
Person 99.2
Person 99
People 99
Person 98.9
Person 98.8
Person 98.6
Athlete 98.3
Sport 98.3
Sports 98.3
Team Sport 96.4
Team 96.4
Person 89.3
Clothing 88.2
Apparel 88.2
Ballplayer 87.2
Baseball 87.2
Softball 87.2
Person 72.4
Helmet 69.5
Person 65.3
Person 55.5
Person 49.7
Person 46
Person 44.1
Person 43

Clarifai
created on 2023-10-27

people 99.8
group together 97.6
adult 96.6
uniform 96.5
many 95.5
man 95.2
school 95.1
portrait 95.1
boy 94.3
group 90.2
woman 88.9
child 88.3
victory 87.9
wear 87.1
competition 86.9
veil 86.9
outfit 86.8
monochrome 86.5
athlete 85.9
girl 82.4

Imagga
created on 2022-01-23

cemetery 78.4
gravestone 43
memorial 37.3
stone 33
people 20.6
structure 18.7
silhouette 17.4
old 15.3
group 15.3
man 15
travel 14.8
male 14.2
tourism 14
sky 13.4
architecture 13.3
landscape 11.9
history 11.6
men 11.2
landmark 10.8
black 10.8
sand 10.4
outdoors 10.4
tourist 10.4
ancient 10.4
person 10.1
beach 10.1
city 10
summer 9.6
kin 9.6
crowd 9.6
culture 9.4
sunset 9
dusk 8.6
building 8.5
walking 8.5
friends 8.4
adult 8.4
world 8.3
uniform 8.1
women 7.9
business 7.9
couple 7.8
military 7.7
outdoor 7.6
dark 7.5
monument 7.5
famous 7.4
water 7.3
art 7.2
portrait 7.1
night 7.1
sea 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

posing 99.8
group 98.1
baseball 98.1
clothing 89.9
standing 89.5
person 86
old 84.6
team 77.9
text 63.1
man 62.4
bunch 56.6
lined 37.4
crowd 0.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Female, 88.4%
Calm 99.8%
Angry 0.1%
Sad 0%
Surprised 0%
Confused 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Female, 52.2%
Calm 94.8%
Angry 3.1%
Sad 1.2%
Surprised 0.4%
Confused 0.3%
Happy 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 98.7%
Happy 99.2%
Calm 0.3%
Sad 0.2%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 90.3%
Angry 4.6%
Sad 1.4%
Happy 1.4%
Confused 0.7%
Disgusted 0.7%
Fear 0.5%
Surprised 0.4%

AWS Rekognition

Age 16-24
Gender Male, 99.8%
Happy 99.9%
Angry 0%
Surprised 0%
Calm 0%
Confused 0%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 97.7%
Angry 0.8%
Sad 0.5%
Confused 0.4%
Happy 0.3%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 21-29
Gender Male, 100%
Happy 99.8%
Calm 0.1%
Angry 0%
Surprised 0%
Confused 0%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 99.6%
Calm 97%
Happy 1.9%
Sad 0.5%
Angry 0.3%
Confused 0.1%
Fear 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Calm 99.7%
Happy 0.1%
Sad 0.1%
Angry 0.1%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 40-48
Gender Male, 98.4%
Calm 86.2%
Happy 10.9%
Angry 0.7%
Sad 0.7%
Surprised 0.6%
Confused 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 99.4%
Angry 0.2%
Sad 0.1%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Male, 96.3%
Happy 89.2%
Calm 10.5%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 99.5%
Happy 99%
Calm 0.6%
Surprised 0.1%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 94.6%
Sad 2.3%
Happy 0.9%
Confused 0.8%
Angry 0.8%
Surprised 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 98.2%
Sad 1%
Angry 0.6%
Confused 0.1%
Happy 0.1%
Fear 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 99.9%
Sad 0.1%
Angry 0%
Confused 0%
Surprised 0%
Fear 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 13-21
Gender Male, 100%
Happy 63.4%
Calm 24.2%
Sad 10.5%
Angry 0.5%
Fear 0.5%
Disgusted 0.4%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.8%
Happy 51.5%
Calm 47.4%
Surprised 0.3%
Confused 0.2%
Fear 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.7%
Happy 99.3%
Calm 0.3%
Fear 0.1%
Surprised 0.1%
Angry 0.1%
Sad 0.1%
Confused 0%
Disgusted 0%

AWS Rekognition

Age 30-40
Gender Male, 99.7%
Calm 76%
Sad 10.7%
Angry 7.4%
Fear 2.9%
Happy 1.1%
Confused 0.7%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 25-35
Gender Female, 81.4%
Happy 99.1%
Calm 0.5%
Angry 0.1%
Sad 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 83.1%
Happy 10.6%
Angry 2.2%
Sad 1.9%
Confused 1.1%
Surprised 0.4%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 89.9%
Happy 4.4%
Confused 1.5%
Angry 1.5%
Sad 1.1%
Disgusted 0.7%
Surprised 0.5%
Fear 0.5%

AWS Rekognition

Age 19-27
Gender Male, 100%
Calm 94.7%
Angry 2.2%
Confused 1.1%
Happy 0.9%
Surprised 0.4%
Sad 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 27.7%
Happy 25.1%
Angry 24.1%
Sad 13.4%
Surprised 3.7%
Confused 2.9%
Disgusted 1.6%
Fear 1.5%

AWS Rekognition

Age 25-35
Gender Male, 100%
Happy 90.1%
Calm 2.2%
Angry 2%
Confused 1.8%
Fear 1.4%
Sad 1.3%
Surprised 0.8%
Disgusted 0.5%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 98.1%
Sad 0.8%
Angry 0.4%
Confused 0.3%
Happy 0.3%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 99.2%
Calm 99.6%
Happy 0.1%
Angry 0.1%
Sad 0%
Confused 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 99.4%
Happy 93.9%
Calm 2.4%
Surprised 0.9%
Angry 0.9%
Fear 0.6%
Sad 0.5%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 25-35
Gender Male, 99.6%
Calm 74.5%
Happy 20.3%
Angry 1.8%
Confused 1.4%
Sad 1.1%
Fear 0.3%
Surprised 0.3%
Disgusted 0.3%

AWS Rekognition

Age 19-27
Gender Female, 93.4%
Calm 96.8%
Sad 1.2%
Angry 0.9%
Confused 0.5%
Surprised 0.3%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Happy 50.4%
Calm 43.8%
Sad 2.5%
Fear 0.9%
Confused 0.7%
Angry 0.7%
Surprised 0.5%
Disgusted 0.5%

AWS Rekognition

Age 22-30
Gender Female, 98.5%
Happy 99.3%
Calm 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Sad 0.1%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 97.8%
Confused 0.8%
Sad 0.7%
Angry 0.5%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 29-39
Gender Male, 100%
Calm 92.4%
Angry 5.3%
Sad 1.1%
Confused 0.5%
Surprised 0.2%
Fear 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 27-37
Gender Male, 84.8%
Happy 99.3%
Calm 0.4%
Surprised 0.1%
Angry 0.1%
Fear 0%
Confused 0%
Disgusted 0%
Sad 0%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 75.8%
Happy 12%
Sad 5.3%
Angry 3.2%
Confused 1.6%
Disgusted 1%
Surprised 0.6%
Fear 0.5%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 99.9%
Angry 0.1%
Sad 0.1%
Surprised 0%
Confused 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 30-40
Gender Male, 100%
Happy 82.8%
Calm 9.9%
Angry 1.5%
Fear 1.4%
Confused 1.4%
Sad 1%
Surprised 1%
Disgusted 0.9%

AWS Rekognition

Age 18-24
Gender Female, 59.8%
Calm 99.9%
Happy 0%
Confused 0%
Sad 0%
Angry 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 95.1%
Sad 4.4%
Angry 0.2%
Confused 0.1%
Happy 0.1%
Fear 0.1%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Female, 96.6%
Happy 99.5%
Calm 0.1%
Fear 0.1%
Confused 0.1%
Angry 0.1%
Sad 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 22-30
Gender Male, 99.8%
Happy 50.7%
Calm 22.4%
Sad 17.9%
Angry 5%
Fear 1.5%
Disgusted 1%
Surprised 0.8%
Confused 0.7%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 99.6%
Happy 0.2%
Angry 0%
Confused 0%
Sad 0%
Surprised 0%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Helmet
Person 99.7%
Person 99.7%
Person 99.6%
Person 99.6%
Person 99.3%
Person 99.2%
Person 99.2%
Person 99%
Person 98.9%
Person 98.8%
Person 98.6%
Person 89.3%
Person 72.4%
Person 65.3%
Person 55.5%
Person 49.7%
Person 46%
Person 44.1%
Person 43%
Helmet 69.5%

Text analysis

Amazon

16
23
17
22
12
8
6
2
30
32
35
19
14
15
11
20
27
13
36
1
10
28

Google

8 35 27 E g 8 22 15 283 23 2 20 21 12 13 22 32 14 19 11 17 36 30 16
8
35
27
E
g
22
15
283
23
2
20
21
12
13
32
14
19
11
17
36
30
16