Human Generated Data

Title

Untitled (studio portrait of two men wearing military pins shaking hands)

Date

1942

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9966

Human Generated Data

Title

Untitled (studio portrait of two men wearing military pins shaking hands)

People

Artist: Martin Schweig, American 20th century

Date

1942

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.8
Apparel 99.8
Hat 99.3
Person 98.8
Human 98.8
Person 98.3
Hat 90.6
Sleeve 87.1
Sailor Suit 80.3
Home Decor 70.6
Sun Hat 63.4
Photography 61.7
Photo 61.7
Portrait 61.7
Face 61.7
Female 57.4
People 57
Long Sleeve 55.4

Imagga
created on 2022-01-29

hat 58.4
man 41
male 40.4
nurse 39.7
clothing 37.1
person 35.2
uniform 32.7
cowboy hat 30.5
people 27.3
portrait 26.5
military uniform 26.5
adult 25.9
professional 24.6
worker 21.8
headdress 21.8
handsome 20.5
occupation 20.2
happy 20.1
job 18.6
business 17.6
consumer goods 17.4
covering 17.3
helmet 16.7
smile 16.4
suit 14.8
industry 14.5
work 14.1
medical 14.1
doctor 14.1
black 13.8
men 13.7
construction 13.7
face 13.5
hair 13.5
one 13.4
profession 13.4
shirt 13.1
standing 13
hand 12.9
looking 12.8
engineer 12.6
coat 12.4
hospital 12.2
success 12.1
friendly 11.9
architect 11.6
businessman 11.5
builder 11.4
attractive 11.2
manager 11.2
safety 11
stethoscope 10.9
industrial 10.9
smiling 10.9
hardhat 10.8
care 10.7
medicine 10.6
boy 10.4
senior 10.3
guy 10.3
lifestyle 10.1
model 10.1
cowboy 10
health 9.7
staff 9.7
serious 9.5
wearing 9.5
expression 9.4
attendant 9.2
holding 9.1
working 8.8
look 8.8
building 8.7
collar 8.6
corporate 8.6
engineering 8.6
tie 8.5
site 8.4
fashion 8.3
20s 8.2
successful 8.2
outdoors 8.2
surgeon 8.1
patient 7.9
together 7.9
happiness 7.8
physician 7.8
contractor 7.8
designer 7.7
casual 7.6
two 7.6
human 7.5
mature 7.4
style 7.4
protection 7.3
foreman 7.2
clipboard 7.1

Google
created on 2022-01-29

Outerwear 95.4
Hat 94.5
Sun hat 91.6
Sleeve 87.2
Gesture 85.3
Style 83.8
Collar 83.6
Headgear 81.6
Blazer 77.4
Waist 73.2
Smile 71.5
Fashion design 70.4
Vintage clothing 70.1
Fedora 69.9
Event 69.6
Costume hat 69.3
Cowboy hat 69.3
Monochrome photography 69
Uniform 68.5
Trench coat 67.7

Microsoft
created on 2022-01-29

hat 99.8
fashion accessory 98.9
person 98.4
text 97.1
fedora 95.7
cowboy hat 95.4
clothing 94.6
sun hat 94.1
man 90.5
human face 81.3
standing 79.9

Face analysis

Amazon

AWS Rekognition

Age 50-58
Gender Male, 99.7%
Calm 100%
Sad 0%
Surprised 0%
Disgusted 0%
Happy 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Female, 50.1%
Happy 81%
Calm 7.3%
Surprised 6.2%
Angry 2.1%
Disgusted 1.3%
Fear 1.1%
Confused 0.6%
Sad 0.3%

Feature analysis

Amazon

Hat 99.3%
Person 98.8%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 73.3%
a man and woman standing in front of a mirror posing for the camera 55.1%
a person standing in front of a mirror posing for the camera 55%

Text analysis

Amazon

MISSOURI
LOUIS
ST. LOUIS
ST.
20301
AROA
MJIA AROA
MJIA

Google

MJI7
AFJA
MISSOURI
YT33A2
LOUIE
MJI7 YT33A2 AFJA ST. LOUIE MISSOURI
ST.