Human Generated Data

Title

Untitled (man with cigar seated behind desk with typewriter)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12132

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with cigar seated behind desk with typewriter)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.6
Person 99.6
Hat 95.7
Clothing 95.7
Apparel 95.7
Machine 80.1
Motor 64.3
Engine 64.3
Appliance 58.7
Dishwasher 58.7

Imagga
created on 2022-01-22

newspaper 46.1
man 40.3
product 34.6
male 32.7
person 32.1
working 31.8
work 30.6
worker 30.2
people 30.1
job 27.4
creation 26.9
dishwasher 24.8
adult 24
professional 23
white goods 19.2
home 18.3
hat 17.4
office 17.4
men 17.2
happy 16.9
laptop 16.5
occupation 16.5
business 16.4
home appliance 16.3
technology 16.3
computer 16.1
looking 16
smiling 15.9
indoors 15.8
construction 14.5
industry 14.5
portrait 14.2
equipment 13.6
house 13.4
medical 13.2
businessman 13.2
safety 12.9
industrial 12.7
kitchen 12.6
helmet 12.6
employee 12.5
hospital 12.4
medicine 12.3
clothing 12.2
doctor 12.2
casual 11.9
appliance 11.8
uniform 11.8
holding 11.6
engineer 11.5
interior 11.5
building 11.4
smile 11.4
health 11.1
women 11.1
businesswoman 10.9
builder 10.5
senior 10.3
executive 10.1
student 10
team 9.8
nurse 9.8
labor 9.7
collar 9.6
repair 9.6
cowboy hat 9.5
corporate 9.4
sitting 9.4
successful 9.1
pretty 9.1
success 8.8
room 8.5
businesspeople 8.5
tool 8.5
attractive 8.4
manager 8.4
teamwork 8.3
one 8.2
confident 8.2
lifestyle 7.9
sterile 7.9
hardhat 7.8
lab 7.8
chef 7.8
architect 7.7
laboratory 7.7
scholar 7.7
profession 7.7
engineering 7.6
plan 7.6
patient 7.5
glasses 7.4
coat 7.2
handsome 7.1
together 7

Google
created on 2022-01-22

White 92.2
Hat 91.7
Fedora 87.3
Sun hat 85
Cap 84.3
Baseball cap 80.8
Cooking 78.4
Machine 73.2
T-shirt 70.8
Monochrome photography 70.8
Sleeve 69
Monochrome 69
Engineering 64.1
Kitchen appliance 61.7
Art 60.4
Room 56.1
Automotive design 55.9
Eyewear 51.6

Microsoft
created on 2022-01-22

text 99.1
man 96
person 95.5
hat 94.8
clothing 93.7
black and white 86.5
fashion accessory 72.7
cowboy hat 64.3
fedora 63.3

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 63.3%
Surprised 50.4%
Calm 38%
Fear 6.4%
Confused 2.3%
Angry 1%
Sad 0.9%
Disgusted 0.6%
Happy 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 95.7%

Captions

Microsoft

a man standing in front of a refrigerator 59.9%
a man that is standing in the kitchen 59.8%
a man standing in a kitchen 59.7%

Text analysis

Amazon

PHILLI
EVERLAST
10742.
DAVEG
M 117
M 117 YEAT AFCA
1.
AFCA
YEAT

Google

DAVEG
10742.
MI17
YT77A
2
A73A
MI17 YT77A 2 A73A DAVEG 10742.