Human Generated Data

Title

Untitled (man in suit and tie playing cards, New York City)
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12135
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man in suit and tie playing cards, New York City)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Clothing 99.6
Apparel 99.6
Tie 99.3
Accessories 99.3
Accessory 99.3
Person 99
Human 99
Person 98.7
Hat 98.1
Hat 98
Sunglasses 97.3
Tie 96.7
Shirt 93.8
Person 79
Clinic 69
Coat 68.6
Overcoat 64.7
Person 64.1
Finger 61.4
Suit 60.5
Dress Shirt 56.6

Imagga
created on 2022-01-22

bow tie 58.3
man 53.1
necktie 51.1
male 44.7
professional 39.8
person 38.9
businessman 36.2
people 32.4
work 31.4
medical 30
business 29.8
garment 29.7
adult 28.9
office 25.9
doctor 25.4
occupation 24.8
looking 24
portrait 24
worker 21.8
corporate 21.5
job 21.3
coat 20.9
medicine 20.3
laboratory 20.3
clothing 20.2
face 19.9
hospital 19.9
lab 18.5
student 18.4
handsome 17.8
working 17.7
happy 17.6
suit 17.5
businesspeople 17.1
team 17
successful 16.5
care 16.5
confident 16.4
men 16.3
tie 16.1
desk 16.1
health 16
smiling 15.9
manager 15.8
scientist 15.7
serious 15.3
computer 15.2
executive 14.6
research 14.3
mature 14
laptop 13.7
expertise 13.6
lab coat 13.3
senior 13.1
success 12.9
nurse 12.8
chemistry 12.6
science 12.5
illness 12.4
biology 12.3
career 12.3
indoors 12.3
patient 12.2
group 12.1
employee 11.7
workplace 11.4
hand 11.4
guy 11.3
modern 11.2
shirt 11.2
casual 11
clinic 11
indoor 11
experiment 10.7
bright 10.7
employment 10.6
test 10.6
exam 10.6
elderly 10.5
human 10.5
uniform 10.5
education 10.4
sitting 10.3
study 10.3
teamwork 10.2
two 10.2
smile 10
examining 9.8
chemical 9.8
technology 9.7
look 9.6
building 9.5
happiness 9.4
specialist 9.4
communication 9.2
businesswoman 9.1
one 9
thoughtful 8.8
lifestyle 8.7
table 8.7
collar 8.6
profession 8.6
notebook 8.4
color 8.4
holding 8.3
room 8.2
engineer 8.1
stethoscope 7.9
women 7.9
together 7.9
chemist 7.9
x ray 7.9
technician 7.8
partner 7.7
1 7.7
attractive 7.7
old 7.7
only 7.6
meeting 7.5
company 7.4
builder 7.3
black 7.2
to 7.1

Google
created on 2022-01-22

Coat 92.6
Hat 92.4
White 92.2
Vision care 91.1
Fedora 89.8
Eyewear 89.8
Sun hat 89.1
Tie 86.4
Black-and-white 84.6
Sunglasses 84
Style 83.8
Suit 83.2
Blazer 78.3
Cap 77.8
White-collar worker 77.2
Font 75.3
Motor vehicle 75.2
Vintage clothing 74.7
Snapshot 74.3
Formal wear 73.7

Microsoft
created on 2022-01-22

hat 100
fashion accessory 99.8
fedora 99.1
text 98.5
cowboy hat 97.9
sun hat 97.9
man 94.1
human face 93.9
clothing 92.7
person 91.9
black and white 72.9

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 92.3%
Calm 98.3%
Sad 0.6%
Happy 0.5%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 42-50
Gender Male, 99.9%
Calm 94.9%
Sad 1.4%
Surprised 1.2%
Angry 1.1%
Happy 0.5%
Disgusted 0.4%
Confused 0.4%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Tie 99.3%
Person 99%
Hat 98.1%
Sunglasses 97.3%
Suit 60.5%

Captions

Microsoft

a man wearing a hat 82.2%
a man in a hat 80.7%
a close up of a man wearing a hat 73.3%

Text analysis

Amazon

10743.
M 113
M 113 AFCA
AFCA
EhLOI

Google

10743.
10743.