Human Generated Data

Title

Untitled (studio portrait of two little boys in matching uniforms)

Date

c. 1940

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11198

Human Generated Data

Title

Untitled (studio portrait of two little boys in matching uniforms)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Clothing 97.9
Coat 97.9
Apparel 97.9
Coat 97.6
Person 97.5
Human 97.5
Person 96.7
Sailor Suit 95.8
Military Uniform 94.5
Military 94.5
Officer 94.5
Hat 79.2
Hat 78
Tie 63.2
Accessories 63.2
Accessory 63.2
Captain 62.8
Photo 62.3
Photography 62.3
Face 61.8
Portrait 61.8
Overcoat 58
People 56.5
Soldier 55.9

Imagga
created on 2022-01-23

military uniform 100
uniform 100
clothing 100
consumer goods 77.6
covering 76.8
commodity 37.9
suit 32.6
adult 31.7
man 30.9
male 29.8
hat 28.8
business 27.9
people 27.9
portrait 26.5
person 26
success 22.5
smile 21.4
professional 19.4
businesswoman 18.2
happy 18.2
smiling 18.1
model 17.1
face 17.1
studio 16.7
standing 16.5
manager 15.8
jacket 15.4
tie 15.2
handsome 15.2
businessman 15
happiness 14.9
attractive 14.7
cheerful 14.6
confident 14.6
youth 14.5
fashion 14.3
worker 14.2
one 14.2
job 14.2
corporate 13.7
engineer 13.5
confidence 13.4
black 13.2
shirt 13.1
looking 12.8
casual 12.7
architect 12.6
holding 12.4
boy 12.2
office 12.1
expression 11.9
occupation 11.9
friendly 11.9
work 11.8
lifestyle 11.6
helmet 11.6
boss 11.5
hair 11.1
executive 11.1
20s 11
hand 10.6
pretty 10.5
building 10.3
men 10.3
construction 10.3
successful 10.1
style 9.6
sexy 9.6
employee 9.6
elegant 9.4
lady 8.9
designer 8.7
costume 8.6
career 8.5
elegance 8.4
human 8.3
student 8.2
modern 7.7
industry 7.7
collar 7.7
profession 7.7
engineering 7.6
wearing 7.6
businesspeople 7.6
child 7.5
cute 7.2
working 7.1
indoors 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 0-4
Gender Male, 99.2%
Calm 66.1%
Angry 12.7%
Confused 9%
Surprised 7.2%
Happy 1.9%
Sad 1.4%
Fear 1%
Disgusted 0.7%

AWS Rekognition

Age 0-4
Gender Female, 95.4%
Calm 83%
Surprised 6.9%
Happy 4%
Angry 1.7%
Confused 1.5%
Sad 1.1%
Disgusted 0.9%
Fear 0.8%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Coat 97.9%
Person 97.5%
Hat 79.2%
Tie 63.2%

Captions

Microsoft

a person standing in front of a military uniform 96.1%
a person wearing a military uniform standing in front of a statue 84.8%
a person wearing a military uniform 84.7%