Human Generated Data

Title

Untitled (two men in suits, hats and glasses facing each other)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4699

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men in suits, hats and glasses facing each other)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.9
Apparel 99.9
Hat 99.5
Person 99.4
Human 99.4
Person 99.3
Hat 98.5
Accessories 88.9
Sunglasses 88.9
Accessory 88.9
Shirt 85.8
Sun Hat 83.6
Suit 82.1
Coat 82.1
Overcoat 82.1
Text 79.3
Tie 65.6
Finger 60.9
Advertisement 59.4
Home Decor 59.2
Poster 58.6
Face 57.7
Sleeve 55.6

Imagga
created on 2022-01-29

man 53.1
male 46.2
person 45.2
professional 40.9
adult 37.5
coat 36
people 31.8
businessman 31.8
work 30.6
business 30.4
lab coat 29.6
job 29.2
doctor 28.2
office 28.1
smiling 26.1
handsome 25.9
happy 25.7
portrait 24.6
occupation 22.9
looking 22.4
men 22.4
worker 22.2
suit 22.2
medical 22.1
nurse 21.6
businesspeople 20.9
team 20.6
attractive 20.3
corporate 19.8
hospital 19.8
specialist 19.7
uniform 19.6
mature 19.5
computer 19.3
laptop 19.2
working 18.6
success 18.5
colleagues 18.5
smile 17.8
medicine 17.6
garment 16.8
health 16.7
clothing 16.5
executive 16.4
face 16.4
scholar 15.5
desk 15.1
manager 14.9
teamwork 14.8
care 14.8
modern 14.7
clinic 14.5
bright 14.3
meeting 14.1
senior 14.1
indoors 14.1
successful 13.7
stethoscope 13.6
laboratory 13.5
ruler 13.5
women 13.5
profession 13.4
glasses 13
sitting 12.9
color 12.8
indoor 12.8
businesswoman 12.7
casual 12.7
lab 12.6
happiness 12.5
intellectual 12.4
together 12.3
friendly 11.9
technology 11.9
associates 11.8
30s 11.6
elderly 11.5
serious 11.5
look 11.4
group 11.3
table 11.3
patient 11.2
surgeon 11.2
two 11
confident 10.9
student 10.9
lifestyle 10.9
hand 10.6
corporation 10.6
diversity 10.6
couple 10.5
standing 10.4
engineer 10.2
20s 10.1
holding 9.9
secretary 9.8
science 9.8
businessmen 9.8
home 9.6
staff 9.6
ethnic 9.5
career 9.5
practitioner 9.4
builder 9.3
room 9.1
white 9.1
clipboard 9.1
old 9.1
black 9
scientist 8.8
40s 8.8
expertise 8.7
building 8.7
architect 8.7
necktie 8.6
formal 8.6
workplace 8.6
construction 8.6
tie 8.5
expression 8.5
notebook 8.4
shirt 8.4
horizontal 8.4
cheerful 8.1
jacket 8.1
coworkers 7.9
physician 7.8
education 7.8
bow tie 7.8
mid adult 7.7
busy 7.7
sit 7.6
employee 7.5
human 7.5
hat 7.2
day 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

hat 100
fashion accessory 99.8
fedora 99.5
text 99.3
cowboy hat 98.7
sun hat 98.5
man 94.1
clothing 93.3
human face 92.5
person 88.6
black and white 87.6
old 81.3
glasses 78

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 95.3%
Calm 51.1%
Surprised 28%
Angry 8.1%
Disgusted 3.9%
Happy 2.9%
Sad 2.3%
Fear 2%
Confused 1.7%

AWS Rekognition

Age 48-56
Gender Male, 69.3%
Calm 99.2%
Happy 0.3%
Disgusted 0.2%
Angry 0.1%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.5%
Person 99.4%
Sunglasses 88.9%
Suit 82.1%
Tie 65.6%

Captions

Microsoft

an old photo of a man 92.1%
a man wearing a hat 90.1%
an old photo of a man in a hat 89.7%

Text analysis

Amazon

H8
H&