Human Generated Data

Title

Untitled (portrait of a young man in uniform)

Date

c. 1940

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1420

Human Generated Data

Title

Untitled (portrait of a young man in uniform)

People

Artist: Martin Schweig, American 20th century

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.8
Hat 99.8
Apparel 99.8
Military 99.5
Military Uniform 99.5
Person 98.9
Human 98.9
Officer 98.5
Soldier 88.5
Armored 84.4
Army 84.4
Suit 83
Coat 83
Overcoat 83
Captain 76.9

Imagga
created on 2022-01-22

uniform 100
clothing 100
military uniform 100
consumer goods 75.4
covering 74.2
man 49.8
male 49.7
commodity 37.4
portrait 36.9
hat 36.3
handsome 34.8
person 34.6
face 29.1
suit 26.4
shirt 25.2
people 24
adult 23.9
guy 23.9
model 21.8
job 21.2
smile 20.7
businessman 20.3
confident 19.1
tie 19
business 18.2
one 17.9
black 17.4
success 16.9
smiling 16.6
serious 16.2
professional 16
standing 15.7
looking 15.2
hand 15.2
happy 15
studio 14.4
helmet 14.2
work 14.1
boy 13.9
men 13.7
worker 13.3
safety 12.9
casual 12.7
attractive 12.6
human 12
head 11.8
dark 11.7
jacket 11.6
mature 11.2
style 11.1
executive 11.1
successful 11
lifestyle 10.8
posing 10.7
confidence 10.5
corporate 10.3
construction 10.3
industry 10.3
expression 10.2
occupation 10.1
fashion 9.8
old 9.8
hair 9.5
eyes 9.5
senior 9.4
manager 9.3
pose 9.1
single 9
office 8.8
brown 8.8
look 8.8
wearing 8.6
fashionable 8.5
youth 8.5
modern 8.4
glasses 8.3
alone 8.2
cowboy 7.9
foreman 7.9
happiness 7.8
engineer 7.8
contractor 7.8
mysterious 7.8
western 7.8
architect 7.7
sad 7.7
collar 7.7
employee 7.7
smart 7.5
strong 7.5
20s 7.3
cheerful 7.3
student 7.2
sexy 7.2

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 98.4%
Confused 1.1%
Surprised 0.1%
Fear 0.1%
Sad 0.1%
Angry 0.1%
Disgusted 0.1%
Happy 0%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.8%
Person 98.9%
Suit 83%

Captions

Microsoft

a man wearing a suit and hat 99.3%
a man wearing a uniform posing for a photo 97.9%
a man wearing a uniform and hat 97.8%

Text analysis

Amazon

PROOF
LOUIS
SAINT LOUIS
SAINT
MARTIN
MARTIN SCHWEIG
SCHWEIG
U.S.

Google

SAINT
PROOF
MARTIN
LOUIS
SCHWEIG
PROOF MARTIN SCHWEIG SAINT LOUIS