Human Generated Data

Title

Untitled (portrait of a young man in uniform)
Date

c. 1940
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1420

Human Generated Data

Title

Untitled (portrait of a young man in uniform)

People

Artist: Martin Schweig, American 20th century

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Hat 99.8
Clothing 99.8
Apparel 99.8
Military 99.5
Military Uniform 99.5
Person 98.9
Human 98.9
Officer 98.5
Soldier 88.5
Army 84.4
Armored 84.4
Suit 83
Coat 83
Overcoat 83
Captain 76.9

Imagga
created on 2022-01-22

military uniform 100
uniform 100
clothing 100
consumer goods 75.4
covering 74.2
man 49.8
male 49.7
commodity 37.4
portrait 36.9
hat 36.3
handsome 34.8
person 34.6
face 29.1
suit 26.4
shirt 25.2
people 24
adult 23.9
guy 23.9
model 21.8
job 21.2
smile 20.7
businessman 20.3
confident 19.1
tie 19
business 18.2
one 17.9
black 17.4
success 16.9
smiling 16.6
serious 16.2
professional 16
standing 15.7
looking 15.2
hand 15.2
happy 15
studio 14.4
helmet 14.2
work 14.1
boy 13.9
men 13.7
worker 13.3
safety 12.9
casual 12.7
attractive 12.6
human 12
head 11.8
dark 11.7
jacket 11.6
mature 11.2
style 11.1
executive 11.1
successful 11
lifestyle 10.8
posing 10.7
confidence 10.5
corporate 10.3
construction 10.3
industry 10.3
expression 10.2
occupation 10.1
fashion 9.8
old 9.8
hair 9.5
eyes 9.5
senior 9.4
manager 9.3
pose 9.1
single 9
office 8.8
brown 8.8
look 8.8
wearing 8.6
fashionable 8.5
youth 8.5
modern 8.4
glasses 8.3
alone 8.2
cowboy 7.9
foreman 7.9
happiness 7.8
engineer 7.8
contractor 7.8
mysterious 7.8
western 7.8
architect 7.7
sad 7.7
collar 7.7
employee 7.7
smart 7.5
strong 7.5
20s 7.3
cheerful 7.3
student 7.2
sexy 7.2

Google
created on 2022-01-22

Face 98.3
Peaked cap 94
Military person 90.3
Military uniform 89
Coat 87
Tie 86.5
Hat 86
Cap 85.6
Gesture 85.3
Sleeve 84.9
Collar 83.4
Non-commissioned officer 82.9
Blazer 77.5
Military officer 76
Costume hat 74.7
Uniform 73
Official 72.9
Soldier 70.2
Suit 69.9
Badge 67.2

Microsoft
created on 2022-01-22

text 99.8
wall 99.8
military uniform 99.1
hat 99
man 98.9
person 97.1
human face 96.7
wearing 96.4
clothing 95.9
fashion accessory 94
peaked cap 92.7
uniform 85.1
official 82.4
suit 80.7
military rank 80.2
government agency 77.5
headgear 73.8
gentleman 71.6
military officer 69.4
military person 68
security 65.7
fedora 65.6
non-commissioned officer 65
old 63.3
cap 62.8
law enforcement 55.7
naval officer 53.6
police officer 50.9
posing 49

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 98.4%
Confused 1.1%
Surprised 0.1%
Fear 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.8%
Person 98.9%
Suit 83%

Captions

Microsoft

a man wearing a suit and hat 99.3%
a man wearing a uniform posing for a photo 97.9%
a man wearing a uniform and hat 97.8%

Text analysis

Amazon

PROOF
LOUIS
SAINT LOUIS
SAINT
MARTIN
MARTIN SCHWEIG
SCHWEIG
U.S.

Google

PROOF MARTIN SCHWEIG SAINT LOUIS
PROOF
MARTIN
SCHWEIG
SAINT
LOUIS