Human Generated Data

Title

Untitled (high school marching band on football field)
Date

1938
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2208

Human Generated Data

Title

Untitled (high school marching band on football field)

People

Artist: Harry Annas, American 1897 - 1980

Date

1938

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.8
Marching 99.8
Crowd 99.8
Person 99.5
Person 99.5
Person 98.9
Person 98.7
Person 98.7
Person 98.5
Person 98.2
Person 98.2
Person 97.9
Person 97.4
Military 94.4
Person 94.3
Person 91.7
Person 90.1
Person 89.6
Person 88.9
Military Uniform 87.9
Officer 85
People 84.7
Person 84
Person 80.3
Person 77.5
Armored 65
Army 65
Troop 65
Soldier 59.1
Person 49.4

Imagga
created on 2021-12-14

city 33.3
architecture 31.2
building 24.9
pedestrian 22.9
sky 21
travel 19.7
speedway 19.4
uniform 18.8
military uniform 18.2
racetrack 16.5
history 16.1
house 15.2
urban 14.9
monument 13.1
spectator 12.9
street 12.9
historic 12.8
course 12.2
tourist 12
construction 12
old 11.8
facility 11.8
summer 11.6
tourism 11.5
clothing 11
snow 10.6
landscape 10.4
grass 10.3
famous 10.2
winter 10.2
day 10.2
landmark 9.9
private 9.6
sunny 9.5
cityscape 9.5
park 9.1
world 8.8
percussion instrument 8.7
culture 8.5
capital 8.5
buildings 8.5
outdoor 8.4
place 8.4
people 8.4
town 8.3
church 8.3
vacation 8.2
center 8.1
transportation 8.1
water 8
musical instrument 7.8
scene 7.8
wall 7.8
ancient 7.8
port 7.7
structure 7.7
skyline 7.6
cemetery 7.6
lawn 7.5
sport 7.5
consumer goods 7.4
covering 7.3
road 7.2
home 7.2
religion 7.2
river 7.1
palace 7.1
sea 7
station 7

Google
created on 2021-12-14

Gesture 85.3
Monochrome 75.2
Monochrome photography 74.5
Crew 71.7
Event 71.2
Pole 69.4
Crowd 66.5
Uniform 65.9
Stock photography 64.3
Team 62.5
Fence 61.1
Recreation 60.4
Vintage clothing 52.6
Stadium 51.9

Microsoft
created on 2021-12-14

text 92.3
outdoor 89.6
person 89.4
flag 70.2
black and white 69.3
white 66
line 33

Face analysis

Amazon

Google

AWS Rekognition

Age 38-56
Gender Female, 50.7%
Calm 91.1%
Angry 2.4%
Surprised 1.8%
Happy 1.7%
Sad 1.2%
Fear 0.7%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 21-33
Gender Female, 53.1%
Calm 91.5%
Happy 4.1%
Fear 1.5%
Surprised 1.5%
Sad 0.8%
Confused 0.3%
Angry 0.3%
Disgusted 0.1%

AWS Rekognition

Age 10-20
Gender Female, 73.1%
Calm 90.7%
Surprised 4.9%
Sad 1.9%
Fear 0.8%
Angry 0.6%
Confused 0.5%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 38-56
Gender Male, 99%
Calm 95%
Sad 3%
Happy 1.3%
Fear 0.2%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Disgusted 0%

AWS Rekognition

Age 26-40
Gender Male, 77%
Calm 46.7%
Happy 46%
Angry 1.8%
Sad 1.7%
Surprised 1.4%
Confused 1.1%
Fear 0.8%
Disgusted 0.4%

AWS Rekognition

Age 23-35
Gender Female, 53.6%
Calm 63.2%
Happy 32.7%
Sad 2.7%
Confused 0.6%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

AWS Rekognition

Age 13-25
Gender Male, 84%
Calm 62.4%
Happy 27.8%
Sad 5.1%
Surprised 1.9%
Angry 0.8%
Disgusted 0.7%
Fear 0.7%
Confused 0.5%

AWS Rekognition

Age 26-42
Gender Male, 70.1%
Calm 84.4%
Sad 13.8%
Confused 0.5%
Surprised 0.4%
Happy 0.4%
Angry 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 17-29
Gender Female, 64%
Calm 72.6%
Sad 9.7%
Surprised 5.3%
Confused 5.2%
Angry 4.7%
Happy 1.3%
Disgusted 0.9%
Fear 0.3%

AWS Rekognition

Age 22-34
Gender Female, 64.9%
Calm 76.4%
Happy 11.8%
Sad 7.2%
Confused 2.6%
Surprised 1%
Disgusted 0.4%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 23-37
Gender Male, 66.4%
Calm 93.2%
Surprised 5.1%
Confused 0.5%
Happy 0.4%
Fear 0.3%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 18-30
Gender Male, 88.4%
Calm 97.4%
Happy 1%
Surprised 0.8%
Angry 0.3%
Fear 0.2%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 22-34
Gender Male, 59.9%
Calm 34.9%
Confused 30.6%
Sad 16.5%
Happy 8.6%
Surprised 4.6%
Fear 2.3%
Angry 1.6%
Disgusted 0.9%

AWS Rekognition

Age 21-33
Gender Male, 85.5%
Surprised 61.2%
Calm 16.6%
Confused 10.2%
Angry 4.1%
Disgusted 2.7%
Sad 2.5%
Fear 2.1%
Happy 0.6%

AWS Rekognition

Age 14-26
Gender Male, 53.6%
Surprised 35%
Fear 33.3%
Calm 13.9%
Angry 7.3%
Happy 4.9%
Sad 2%
Confused 1.9%
Disgusted 1.6%

AWS Rekognition

Age 30-46
Gender Male, 80.4%
Calm 74.7%
Sad 12.2%
Happy 3.6%
Confused 3.4%
Angry 3.2%
Disgusted 1%
Fear 1%
Surprised 0.9%

AWS Rekognition

Age 11-21
Gender Female, 65.5%
Calm 85.5%
Happy 6%
Surprised 3.6%
Sad 1.6%
Angry 1%
Confused 1%
Disgusted 0.7%
Fear 0.5%

AWS Rekognition

Age 12-22
Gender Male, 96.7%
Calm 68%
Angry 17.8%
Confused 9.7%
Sad 1.8%
Fear 0.9%
Happy 0.7%
Surprised 0.6%
Disgusted 0.5%

AWS Rekognition

Age 17-29
Gender Male, 84.5%
Calm 52.5%
Disgusted 30.8%
Angry 8%
Happy 4%
Sad 2.2%
Confused 1.2%
Fear 0.9%
Surprised 0.5%

AWS Rekognition

Age 30-46
Gender Female, 96.1%
Happy 84.5%
Calm 6.3%
Surprised 5.9%
Angry 1.8%
Confused 0.6%
Disgusted 0.5%
Fear 0.3%
Sad 0.3%

AWS Rekognition

Age 36-52
Gender Female, 54.6%
Calm 68.5%
Sad 15.8%
Confused 12.6%
Surprised 1.1%
Angry 1%
Happy 0.5%
Fear 0.4%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Male, 90.9%
Calm 36.9%
Confused 36.7%
Surprised 17.8%
Angry 2.5%
Sad 2.4%
Disgusted 1.6%
Fear 1%
Happy 1%

AWS Rekognition

Age 23-35
Gender Male, 66%
Calm 98.7%
Happy 0.4%
Angry 0.3%
Sad 0.2%
Disgusted 0.2%
Surprised 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 34-50
Gender Male, 59.1%
Calm 75%
Sad 22%
Happy 2.2%
Angry 0.3%
Disgusted 0.2%
Fear 0.1%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 16-28
Gender Male, 59.6%
Calm 51.2%
Sad 15.7%
Angry 10.2%
Happy 8%
Confused 7%
Disgusted 5.1%
Fear 1.8%
Surprised 0.9%

AWS Rekognition

Age 42-60
Gender Female, 66.6%
Surprised 81.4%
Calm 8.2%
Confused 7.8%
Angry 1%
Disgusted 0.7%
Fear 0.6%
Happy 0.3%
Sad 0.2%

AWS Rekognition

Age 24-38
Gender Male, 88.1%
Fear 53.8%
Calm 24.2%
Sad 9.1%
Surprised 6.4%
Happy 2.5%
Confused 2.2%
Angry 1.1%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people posing for a photo 87.9%
a group of people posing for the camera 87.8%
a group of people posing for a picture 87.7%