Human Generated Data

Title

Untitled (Lockhart High School band)
Date

1941
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2207

Human Generated Data

Title

Untitled (Lockhart High School band)

People

Artist: Harry Annas, American 1897 - 1980

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.5
Person 99.5
Person 99.1
Person 97.8
People 97.5
Person 95.3
Person 94.9
Person 92.7
Person 88.2
Person 87
Crowd 82.4
Tennis Racket 81.5
Racket 81.5
Sailor Suit 72.7
Family 68.4
Person 61
Person 48.3
Person 43.8

Imagga
created on 2021-12-14

drawing 29.6
sketch 28.5
grunge 23.8
architecture 20.5
art 19.7
vintage 19
city 18.3
old 17.4
representation 16.6
silhouette 16.5
structure 16
ancient 14.7
flag 14.5
history 14.3
building 14.1
retro 13.9
antique 13.8
people 13.4
travel 13.4
black 13.2
house 12.8
sky 12.7
gymnasium 12.6
landmark 11.7
decoration 11.7
religion 11.6
old fashioned 11.4
design 11.2
business 10.9
dirty 10.8
facility 10.6
urban 10.5
kin 10.4
texture 10.4
historical 10.3
athletic facility 10.1
male 9.9
life 9.5
paper 9.4
culture 9.4
emblem 9.4
famous 9.3
historic 9.2
tourism 9.1
aged 9
landscape 8.9
sculpture 8.8
crowd 8.6
men 8.6
construction 8.6
grungy 8.5
decorative 8.3
man 8.2
style 8.2
tower 8.1
light 8
scene 7.8
space 7.8
window 7.6
pattern 7.5
frame 7.5
town 7.4
negative 7.3
graphic 7.3
group 7.3

Google
created on 2021-12-14

Black 89.5
Gesture 85.3
Style 83.9
Black-and-white 83.3
Font 81.9
Suit 79.3
People 77.6
Monochrome 77
Uniform 74.2
Crew 72.7
Event 72.6
Monochrome photography 70.6
Art 69.6
Team 68.6
Stock photography 66.5
Child 66
Team sport 65.3
Illustration 64.8
Room 63.4
History 61.8

Microsoft
created on 2021-12-14

posing 99.3
text 96.4
cartoon 86.3
group 83.2
black 82.1
old 80.8
drawing 67.5
clothing 60.3
black and white 57.7
chessman 38.2

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Male, 92.9%
Calm 78.4%
Confused 13.7%
Angry 2.3%
Surprised 2.1%
Sad 1.5%
Happy 1.1%
Disgusted 0.7%
Fear 0.3%

AWS Rekognition

Age 1-7
Gender Male, 68%
Calm 59.2%
Angry 14.3%
Happy 9.8%
Surprised 7.2%
Fear 6.3%
Sad 2%
Confused 0.6%
Disgusted 0.5%

AWS Rekognition

Age 28-44
Gender Male, 85.4%
Calm 92%
Happy 2.2%
Sad 2.1%
Angry 1.4%
Confused 1%
Surprised 0.7%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 38-56
Gender Male, 75.1%
Calm 57.1%
Sad 26.1%
Fear 4.4%
Confused 4.2%
Angry 3.3%
Surprised 2.5%
Disgusted 1.3%
Happy 1%

AWS Rekognition

Age 3-9
Gender Female, 59.6%
Calm 44%
Fear 13.9%
Sad 11.7%
Angry 11.5%
Happy 11%
Surprised 5.8%
Confused 1.1%
Disgusted 0.9%

AWS Rekognition

Age 29-45
Gender Male, 71.4%
Sad 93.8%
Calm 2.8%
Angry 1.4%
Disgusted 0.7%
Happy 0.5%
Confused 0.5%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 23-35
Gender Female, 65%
Calm 56%
Sad 40.1%
Happy 1.6%
Fear 1.1%
Angry 0.6%
Disgusted 0.2%
Confused 0.2%
Surprised 0.2%

AWS Rekognition

Age 29-45
Gender Male, 50.7%
Calm 84.6%
Happy 14.2%
Sad 0.7%
Surprised 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 22-34
Gender Female, 55.4%
Fear 37.8%
Angry 26.2%
Calm 20.1%
Sad 7.8%
Happy 3.8%
Disgusted 2%
Surprised 1.4%
Confused 1%

AWS Rekognition

Age 53-71
Gender Female, 72.7%
Calm 92.7%
Fear 3.1%
Angry 1.3%
Sad 1.2%
Surprised 0.8%
Happy 0.7%
Disgusted 0.2%
Confused 0.1%

AWS Rekognition

Age 14-26
Gender Female, 62.7%
Fear 82.2%
Calm 11.3%
Angry 1.5%
Surprised 1.4%
Happy 1.3%
Sad 1.3%
Confused 0.5%
Disgusted 0.4%

AWS Rekognition

Age 34-50
Gender Female, 74.9%
Calm 65.7%
Happy 23.9%
Sad 3.9%
Fear 2.1%
Surprised 1.9%
Confused 1%
Disgusted 1%
Angry 0.5%

AWS Rekognition

Age 22-34
Gender Male, 78.5%
Fear 23.1%
Surprised 19.3%
Disgusted 18.4%
Confused 16.9%
Calm 12%
Sad 5.2%
Angry 3.6%
Happy 1.5%

AWS Rekognition

Age 2-8
Gender Female, 87.5%
Fear 47.1%
Surprised 16.7%
Sad 12.7%
Calm 9.7%
Angry 6.7%
Confused 4.8%
Happy 1.5%
Disgusted 0.9%

AWS Rekognition

Age 6-16
Gender Female, 95.3%
Sad 61.8%
Fear 16.6%
Calm 9.3%
Confused 8.7%
Angry 1.1%
Happy 0.9%
Surprised 0.8%
Disgusted 0.6%

AWS Rekognition

Age 23-35
Gender Female, 69.7%
Fear 43.6%
Surprised 32.6%
Calm 9.3%
Happy 7.9%
Angry 2.2%
Sad 1.6%
Confused 1.5%
Disgusted 1.2%

AWS Rekognition

Age 23-37
Gender Female, 66.4%
Sad 34.8%
Confused 24.5%
Fear 21.9%
Disgusted 7.8%
Surprised 3.9%
Happy 2.7%
Calm 2.7%
Angry 1.7%

AWS Rekognition

Age 26-42
Gender Female, 73.4%
Calm 89.8%
Happy 6.1%
Sad 3.5%
Fear 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Female, 60.5%
Calm 75%
Fear 7.7%
Angry 5.8%
Surprised 5.3%
Happy 3.3%
Sad 1.6%
Confused 0.9%
Disgusted 0.4%

AWS Rekognition

Age 23-35
Gender Female, 59.8%
Calm 78.7%
Sad 16.2%
Happy 3.6%
Fear 0.4%
Angry 0.4%
Confused 0.4%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Female, 97%
Calm 32.7%
Sad 27.8%
Happy 16.6%
Angry 11.5%
Fear 4.6%
Confused 4.3%
Disgusted 1.8%
Surprised 0.6%

AWS Rekognition

Age 3-11
Gender Female, 68.9%
Calm 90.4%
Sad 6.4%
Happy 1.4%
Angry 0.9%
Fear 0.4%
Confused 0.3%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 41-59
Gender Male, 95.9%
Calm 92.4%
Happy 1.8%
Surprised 1.4%
Sad 1.4%
Fear 0.9%
Angry 0.8%
Disgusted 0.7%
Confused 0.6%

AWS Rekognition

Age 27-43
Gender Female, 92.2%
Sad 96.4%
Calm 1.8%
Fear 1.4%
Confused 0.2%
Disgusted 0.1%
Happy 0%
Surprised 0%
Angry 0%

AWS Rekognition

Age 18-30
Gender Female, 92.1%
Fear 57.9%
Confused 12.3%
Happy 10.3%
Calm 7.4%
Sad 6%
Surprised 4.5%
Disgusted 1%
Angry 0.5%

AWS Rekognition

Age 46-64
Gender Female, 62.1%
Calm 84.5%
Happy 7.3%
Sad 5.1%
Confused 1.2%
Fear 0.6%
Surprised 0.6%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 4-14
Gender Female, 63.1%
Fear 33.3%
Calm 30.1%
Sad 20.1%
Surprised 11.3%
Confused 2.3%
Angry 1.5%
Happy 0.8%
Disgusted 0.6%

AWS Rekognition

Age 20-32
Gender Female, 93.8%
Surprised 26.1%
Fear 20.3%
Confused 17.8%
Happy 16.3%
Calm 10.7%
Sad 5.5%
Angry 1.7%
Disgusted 1.6%

AWS Rekognition

Age 22-34
Gender Female, 77.8%
Calm 89.1%
Happy 4.8%
Surprised 1.9%
Sad 1.5%
Disgusted 0.9%
Angry 0.7%
Confused 0.5%
Fear 0.4%

AWS Rekognition

Age 22-34
Gender Female, 70%
Calm 37.4%
Happy 32.5%
Surprised 9%
Confused 9%
Fear 5.2%
Angry 3.1%
Sad 2.9%
Disgusted 0.9%

AWS Rekognition

Age 35-51
Gender Male, 91.8%
Calm 95.6%
Sad 1.1%
Surprised 1.1%
Fear 0.6%
Angry 0.6%
Confused 0.5%
Happy 0.4%
Disgusted 0.1%

AWS Rekognition

Age 24-38
Gender Male, 64.8%
Calm 45.8%
Happy 36.7%
Disgusted 3.9%
Angry 3.3%
Surprised 3.2%
Sad 2.7%
Fear 2.4%
Confused 2.2%

AWS Rekognition

Age 22-34
Gender Male, 69%
Calm 82.1%
Sad 7.5%
Surprised 5.9%
Happy 1.2%
Confused 1%
Fear 1%
Angry 1%
Disgusted 0.4%

AWS Rekognition

Age 41-59
Gender Male, 89%
Angry 96.4%
Disgusted 1.4%
Sad 0.7%
Fear 0.7%
Calm 0.4%
Happy 0.3%
Confused 0.1%
Surprised 0%

AWS Rekognition

Age 29-45
Gender Male, 91.8%
Calm 60.5%
Fear 15%
Confused 9.8%
Sad 6.9%
Surprised 5.6%
Happy 1%
Angry 0.6%
Disgusted 0.5%

AWS Rekognition

Age 10-20
Gender Female, 53.7%
Fear 41.9%
Sad 18.1%
Happy 17.9%
Calm 11.4%
Surprised 5.2%
Angry 4.6%
Confused 0.7%
Disgusted 0.3%

AWS Rekognition

Age 23-35
Gender Male, 87.8%
Calm 98.8%
Sad 0.4%
Happy 0.2%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 12-22
Gender Female, 65.7%
Happy 51.2%
Calm 38.7%
Sad 5.7%
Angry 3.3%
Fear 0.6%
Confused 0.3%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 22-34
Gender Male, 90.2%
Surprised 68.3%
Confused 12.1%
Calm 7.5%
Fear 5.5%
Sad 3.4%
Happy 2.3%
Angry 0.7%
Disgusted 0.3%

AWS Rekognition

Age 15-27
Gender Female, 66.3%
Calm 81.2%
Surprised 8.9%
Happy 7.4%
Sad 1%
Confused 0.5%
Angry 0.4%
Fear 0.4%
Disgusted 0.2%

AWS Rekognition

Age 18-30
Gender Female, 61.2%
Calm 37.5%
Sad 29.9%
Happy 24.3%
Confused 4.5%
Fear 1.5%
Angry 1.4%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 8-18
Gender Female, 93.9%
Sad 85.6%
Calm 9.1%
Happy 2.1%
Fear 2%
Confused 0.5%
Angry 0.4%
Surprised 0.2%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 70.3%
Sad 77.1%
Fear 13.7%
Angry 6.2%
Happy 1.2%
Calm 0.7%
Disgusted 0.4%
Confused 0.4%
Surprised 0.1%

AWS Rekognition

Age 49-67
Gender Female, 67.3%
Happy 41%
Calm 29.9%
Angry 8.5%
Confused 8.2%
Sad 5.1%
Fear 3.7%
Surprised 2%
Disgusted 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tennis Racket 81.5%

Captions

Microsoft

a group of people posing for a photo 95.9%
an old photo of a group of people posing for the camera 94.5%
an old photo of a group of people posing for a picture 94.4%

Text analysis

Amazon

AR
BAND
PUBLIC
SC
LOCKH

Google

UBLIC
UNA
OCKI UBLIC UNA
OCKI