Human Generated Data

Title

Untitled (young man in Navy uniform)

Date

c. 1940

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1421

Human Generated Data

Title

Untitled (young man in Navy uniform)

People

Artist: Martin Schweig, American 20th century

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Sailor Suit 100
Human 100
Hat 99.1
Apparel 99.1
Clothing 99.1
Person 98.4
Officer 76.8
Military 76.8
Military Uniform 76.8
Captain 56.6

Imagga
created on 2022-01-22

military uniform 100
uniform 100
clothing 82.5
hat 61.6
consumer goods 53.5
covering 52.9
man 46.4
male 42.7
person 40.5
portrait 32.4
face 28.4
guy 28.3
people 27.9
handsome 27.6
model 25.7
cowboy hat 24.4
commodity 23.6
boy 20.9
studio 20.5
job 20.4
worker 19.6
adult 19.4
smile 19.2
attractive 18.9
beard 18.5
headdress 17.3
work 17.3
men 17.2
serious 17.2
shirt 16.8
looking 16.8
fashion 16.6
helmet 14.9
safety 14.7
expression 14.5
one 14.2
black 13.8
construction 13.7
casual 13.6
professional 13.5
head 13.4
posing 13.3
eyes 12.9
sexy 12.9
occupation 12.8
industry 12.8
hair 12.7
old 12.5
happy 12.5
smiling 12.3
look 12.3
style 11.9
dark 11.7
standing 11.3
youth 11.1
contractor 10.7
human 10.5
senior 10.3
industrial 10
pose 10
hand 9.9
eye 9.8
foreman 9.8
close 9.7
wearing 9.5
cap 9.4
smart 9.4
lifestyle 9.4
confident 9.1
engineer 9
hardhat 8.8
labor 8.8
builder 8.7
gesture 8.6
hard 8.6
mature 8.4
cool 8
kid 8
cute 7.9
skin 7.8
modern 7.7
collar 7.7
repair 7.7
fashionable 7.6
fun 7.5
rough 7.3
blond 7.2
building 7.1
child 7.1

Google
created on 2022-01-22

Microsoft
created on 2022-01-22

wall 99.8
person 99.6
text 98.7
human face 97.3
fashion accessory 95.9
wearing 95.6
hat 95.4
man 95
clothing 90.8
black 88.6
uniform 85.3
military uniform 84.2
player 82.6
white 75
headgear 74
peaked cap 70.2
old 68.9
posing 68.8
portrait 68.5
fedora 65.9
cap 65.4
cowboy hat 51.5
vintage 27.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 92.7%
Happy 3.4%
Confused 2.3%
Sad 0.5%
Surprised 0.4%
Angry 0.4%
Fear 0.2%
Disgusted 0.2%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.1%
Person 98.4%

Captions

Microsoft

a vintage photo of a man wearing a hat 95.3%
a vintage photo of a man wearing a baseball hat 91.5%
a man wearing a baseball hat 91.4%

Text analysis

Amazon

STUDIO
NAVY
THIS
U.S. NAVY
RETURNED
PROPERTY
U.S.
THIS PROORIS THE PROPERTY
DAVE
NE
OE NE
owner DAVE
OE
PROORIS
THE
owner

Google

FROPERTY
S
LD
U.S.
PROd
SIG
STUTDIO
THIS
LEARE
AND
RETURNED
U.S. NAVY THIS PROd FROPERTY LEARE AND S LD RETURNED SIG STUTDIO
NAVY