Human Generated Data

Title

Untitled (Lockhart high school football team on bleachers)

Date

1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11207

Human Generated Data

Title

Untitled (Lockhart high school football team on bleachers)

People

Artist: Harry Annas, American 1897 - 1980

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.8
Person 99.8
Person 99.7
Person 99.6
Person 99.6
Person 99.5
Person 99.5
Person 99.3
Person 99.3
Person 99.2
Person 99
Person 99
People 98.7
Apparel 97.3
Clothing 97.3
Team 94.1
Sport 91.9
Sports 91.9
Team Sport 91.9
Person 91.1
Athlete 89.1
Helmet 86.3
Person 84.2
American Football 77.5
Football 77.5
Ballplayer 69.7
Softball 69.7
Baseball 69.7
Person 64.9
Person 60.5
Crash Helmet 55.4
Person 54.2
Person 45.1

Imagga
created on 2022-01-23

cemetery 75.1
stone 21.8
people 19.5
silhouette 19
gravestone 18.8
memorial 17.3
old 15.3
architecture 14.8
structure 14.3
male 14.2
city 14.1
man 14
group 13.7
kin 12.9
travel 12.7
urban 12.2
dark 11.7
sunset 11.7
building 11.4
walking 11.4
beach 11
history 10.7
black 10.3
landmark 9.9
tourism 9.9
adult 9.7
sun 9.7
summer 9.6
crowd 9.6
couple 9.6
men 9.4
monument 9.3
street 9.2
outdoors 9
sky 8.9
person 8.8
women 8.7
water 8.7
scene 8.7
ancient 8.6
dusk 8.6
business 8.5
tourist 8.3
landscape 8.2
world 8.1
sand 8
night 8
park bench 7.8
friends 7.5
light 7.3
art 7.2
celebration 7.2
transportation 7.2
portrait 7.1
sea 7

Microsoft
created on 2022-01-23

posing 99.4
person 97.3
clothing 96.3
group 93.5
text 92.2
baseball 88.9
standing 83.6
old 77.1
man 76.8
team 72.1
footwear 54.3
crowd 0.6

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 97.6%
Calm 83.5%
Happy 15%
Angry 0.5%
Sad 0.3%
Surprised 0.3%
Confused 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 90.8%
Angry 3.3%
Confused 1.7%
Happy 1.6%
Sad 1.2%
Fear 0.8%
Disgusted 0.4%
Surprised 0.3%

AWS Rekognition

Age 19-27
Gender Male, 94.9%
Happy 99.7%
Calm 0.2%
Surprised 0%
Sad 0%
Disgusted 0%
Angry 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 20-28
Gender Male, 100%
Happy 43.9%
Calm 43.5%
Angry 2.9%
Confused 2.8%
Sad 2.3%
Surprised 2.1%
Disgusted 1.3%
Fear 1.2%

AWS Rekognition

Age 21-29
Gender Male, 92%
Calm 99.9%
Angry 0.1%
Sad 0%
Surprised 0%
Confused 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 19-27
Gender Male, 98.9%
Calm 95.5%
Sad 2.7%
Angry 1.1%
Happy 0.3%
Fear 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 99.8%
Sad 0.1%
Angry 0%
Confused 0%
Happy 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 23-31
Gender Male, 100%
Happy 99.9%
Calm 0.1%
Angry 0%
Surprised 0%
Confused 0%
Sad 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 16-22
Gender Male, 100%
Happy 65.5%
Calm 31.9%
Sad 1.4%
Angry 0.5%
Surprised 0.2%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Female, 59.3%
Calm 86.5%
Happy 11.8%
Angry 0.4%
Sad 0.4%
Surprised 0.3%
Confused 0.3%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 85.5%
Angry 3.9%
Confused 3.2%
Happy 2.6%
Disgusted 1.6%
Sad 1.4%
Surprised 1.4%
Fear 0.4%

AWS Rekognition

Age 18-26
Gender Female, 99.6%
Happy 99.7%
Calm 0.1%
Surprised 0.1%
Angry 0%
Fear 0%
Confused 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 98.4%
Sad 0.6%
Angry 0.4%
Confused 0.2%
Fear 0.1%
Happy 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Male, 99.2%
Happy 98.8%
Calm 0.8%
Fear 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Sad 0.1%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 92.4%
Sad 5.9%
Angry 0.9%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-24
Gender Male, 93.2%
Happy 99.7%
Angry 0.1%
Calm 0.1%
Confused 0.1%
Surprised 0%
Fear 0%
Sad 0%
Disgusted 0%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 99.7%
Happy 0.2%
Sad 0.1%
Angry 0%
Confused 0%
Fear 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 53.5%
Happy 98.9%
Calm 0.4%
Surprised 0.2%
Angry 0.2%
Fear 0.1%
Confused 0.1%
Sad 0.1%
Disgusted 0%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 97.2%
Angry 1.3%
Sad 0.6%
Confused 0.3%
Fear 0.2%
Surprised 0.2%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 100%
Happy 52.5%
Calm 46.5%
Surprised 0.2%
Confused 0.2%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 99.8%
Angry 0.1%
Happy 0.1%
Confused 0%
Sad 0%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 99.8%
Sad 0.1%
Angry 0%
Confused 0%
Surprised 0%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 89.6%
Happy 3.9%
Sad 2.5%
Confused 1.5%
Angry 1%
Disgusted 0.6%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 60.4%
Happy 31.7%
Angry 2.8%
Sad 2%
Confused 1.3%
Fear 0.7%
Disgusted 0.6%
Surprised 0.5%

AWS Rekognition

Age 16-24
Gender Female, 99.3%
Calm 67%
Sad 17.2%
Angry 11.4%
Confused 1.3%
Surprised 1.2%
Fear 0.7%
Happy 0.7%
Disgusted 0.4%

AWS Rekognition

Age 33-41
Gender Male, 91.3%
Happy 89.8%
Calm 9.2%
Sad 0.2%
Confused 0.2%
Surprised 0.2%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Male, 99.4%
Calm 64.6%
Happy 34.4%
Confused 0.2%
Sad 0.2%
Angry 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 21-29
Gender Female, 55.7%
Calm 71.1%
Sad 19.3%
Angry 7.5%
Surprised 0.7%
Confused 0.7%
Happy 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Male, 84.7%
Happy 99.7%
Calm 0.2%
Angry 0%
Disgusted 0%
Surprised 0%
Sad 0%
Fear 0%
Confused 0%

AWS Rekognition

Age 26-36
Gender Male, 100%
Calm 99.3%
Angry 0.2%
Confused 0.2%
Sad 0.1%
Surprised 0.1%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 98.4%
Calm 96.5%
Happy 1.8%
Angry 0.7%
Sad 0.4%
Confused 0.3%
Fear 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Male, 100%
Happy 66.7%
Calm 30.4%
Sad 0.7%
Angry 0.7%
Confused 0.5%
Surprised 0.4%
Fear 0.3%
Disgusted 0.3%

AWS Rekognition

Age 22-30
Gender Male, 100%
Happy 95.3%
Calm 2.2%
Angry 0.8%
Surprised 0.5%
Confused 0.5%
Sad 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 92.9%
Angry 4.6%
Confused 0.8%
Surprised 0.5%
Disgusted 0.5%
Sad 0.3%
Happy 0.3%
Fear 0.1%

AWS Rekognition

Age 29-39
Gender Female, 90.9%
Happy 98.1%
Calm 0.8%
Angry 0.4%
Surprised 0.4%
Sad 0.1%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Male, 66.7%
Calm 99.6%
Happy 0.1%
Confused 0.1%
Surprised 0%
Sad 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 98.6%
Confused 0.5%
Sad 0.5%
Angry 0.3%
Surprised 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 99.9%
Calm 82.3%
Sad 7.6%
Angry 6.3%
Fear 1.4%
Confused 0.7%
Happy 0.7%
Disgusted 0.7%
Surprised 0.4%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 99.3%
Sad 0.5%
Angry 0.1%
Confused 0.1%
Fear 0%
Happy 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 89.3%
Sad 4.4%
Happy 2.4%
Angry 1.8%
Disgusted 0.8%
Surprised 0.6%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Male, 100%
Happy 96.5%
Confused 1%
Angry 0.6%
Sad 0.5%
Surprised 0.4%
Disgusted 0.4%
Fear 0.3%
Calm 0.3%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 97%
Happy 2.7%
Angry 0.1%
Confused 0.1%
Sad 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Female, 74.8%
Happy 99.4%
Calm 0.1%
Fear 0.1%
Angry 0.1%
Sad 0.1%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 29-39
Gender Male, 100%
Happy 90.9%
Calm 6.6%
Fear 0.5%
Sad 0.5%
Confused 0.4%
Surprised 0.4%
Angry 0.3%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of men posing for a photo 96.9%
a group of people posing for a photo 96.8%
a group of men posing for a picture 96.7%

Text analysis

Amazon

16
12
15
6
17
22
23
35
2
32
30
11
14
8
20
36
27
19
1
13
29
0
م

Google

8 35 27 22 15 28 23 2 2. 20 13 12 16 32 14 19 11 17 36 30
35
22
19
11
8
13
32
15
2.
12
14
30
27
17
36
28
23
2
20
16