Human Generated Data

Title

Untitled (portrait of two young boys in uniform)
Date

c. 1940
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.436

Human Generated Data

Title

Untitled (portrait of two young boys in uniform)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.5
Coat 99.5
Clothing 99.5
Coat 99.2
Human 96.8
Officer 96.6
Military 96.6
Military Uniform 96.6
Person 96.3
Person 95.6
Sailor Suit 93.4
Helmet 87.9
Captain 67.9
Soldier 62.7
Hat 62.6
Face 60.3
Photography 60.3
Portrait 60.3
Photo 60.3

Imagga
created on 2022-01-23

clothing 100
military uniform 100
uniform 100
consumer goods 73.5
covering 72.7
suit 38.2
adult 36.2
commodity 35.9
man 33.6
business 32.8
male 31.9
people 27.9
person 27.2
portrait 27.2
standing 24.3
handsome 21.4
businessman 21.2
professional 21.1
hat 20.7
attractive 20.3
success 19.3
smiling 18.8
happy 18.2
smile 17.8
job 17.7
confident 17.3
model 17.1
fashion 16.6
work 16.5
one 16.4
casual 16.1
office 16.1
looking 16
lifestyle 15.9
manager 15.8
face 15.6
corporate 15.5
businesswoman 15.5
worker 15.1
holding 14.9
executive 13.8
occupation 12.8
expression 12.8
human 12.7
building 12.7
engineer 12.5
confidence 12.4
cheerful 12.2
studio 11.4
career 11.4
pretty 11.2
style 11.1
helmet 11.1
successful 11
working 10.6
boss 10.5
modern 10.5
brunette 10.5
sexy 10.4
tie 10.4
men 10.3
women 10.3
construction 10.3
happiness 10.2
protection 10
jacket 9.8
posing 9.8
architect 9.7
couple 9.6
meeting 9.4
shirt 9.3
cute 9.3
elegance 9.2
safety 9.2
lady 8.9
cool 8.9
formal 8.6
workplace 8.6
engineering 8.6
industry 8.5
youth 8.5
black 8.5
camera 8.3
dress 8.1
hair 7.9
designer 7.7
military 7.7
employee 7.7
smart 7.5
site 7.5
mature 7.4
guy 7.4
20s 7.3
pose 7.2
color 7.2
team 7.2
architecture 7
indoors 7

Google
created on 2022-01-23

Peaked cap 94
Hat 89.2
Military person 88.6
Coat 86.8
Standing 86.4
Sleeve 85.3
Gesture 85.3
Military uniform 84.2
Collar 83.6
Headgear 82.1
Non-commissioned officer 80.3
Soldier 77.8
Blazer 77.5
Uniform 76.9
Military organization 73.6
Vintage clothing 72.5
Military officer 68.9
Official 68.7
Military rank 63.9
Military 62.5

Microsoft
created on 2022-01-23

military uniform 99.9
clothing 95.1
hat 91
peaked cap 88.7
person 87.8
coat 87.1
uniform 86.9
military rank 84.8
official 82.3
fashion accessory 82.1
government agency 81.9
security 77.5
military person 73.8
military officer 73.5
non-commissioned officer 70.8
text 69.9
human face 68
old 66.6
suit 65.9
army 63.3
law enforcement 61.4
police officer 61.3
naval officer 59.6
military 58.4
military organization 54.7
gentleman 54.4
posing 41.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-4
Gender Male, 99.9%
Calm 100%
Sad 0%
Angry 0%
Confused 0%
Surprised 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 0-3
Gender Female, 96.7%
Calm 99.7%
Sad 0.1%
Happy 0.1%
Disgusted 0%
Confused 0%
Surprised 0%
Angry 0%
Fear 0%

Microsoft Cognitive Services

Age 5
Gender Male

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Coat 99.5%
Person 96.3%
Helmet 87.9%
Hat 62.6%

Captions

Microsoft

a person wearing a military uniform 94.2%
a person wearing a military uniform standing in front of a building 92.1%
a person in a military uniform standing in front of a building 92%