Human Generated Data

Title

Untitled (older man conversing with a young man in sitting room)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11939
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (older man conversing with a young man in sitting room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.4
Human 99.4
Chair 91.2
Furniture 91.2
Clothing 89.8
Apparel 89.8
Person 87.8
Clinic 82.3
Couch 73.3
LCD Screen 66.9
Electronics 66.9
Screen 66.9
Monitor 66.9
Display 66.9
Chair 62.7
Finger 62
Dining Table 58.5
Table 58.5
Wood 58
Hospital 57.3
Flooring 55.1

Imagga
created on 2022-01-15

person 43.7
man 39.7
people 35.7
male 34.8
adult 29.1
professional 28.8
teacher 26.7
businessman 23.8
office 23.3
room 23.1
worker 21.9
business 21.9
table 21.6
patient 21.2
brass 21.1
sitting 20.6
indoors 20.2
desk 19.8
wind instrument 19.8
men 19.8
smiling 19.5
happy 19.4
nurse 19.2
home 19.1
team 17.9
work 17.3
cornet 17.1
medical 16.8
musical instrument 16.6
businesspeople 16.1
educator 15.6
group 15.3
women 15
senior 15
life 14.7
laptop 14.6
coat 13.7
businesswoman 13.6
computer 13.6
colleagues 13.6
casual 13.6
working 13.3
meeting 13.2
together 13.1
couple 13.1
mature 13
education 13
corporate 12.9
laboratory 12.5
talking 12.4
cheerful 12.2
smile 12.1
executive 11.9
indoor 11.9
lab 11.7
lifestyle 11.6
student 11.5
doctor 11.3
teamwork 11.1
sick person 11.1
20s 11
happiness 11
case 10.9
suit 10.8
sit 10.4
portrait 10.4
study 10.3
modern 9.8
handsome 9.8
scientist 9.8
job 9.7
health 9.7
chemistry 9.7
biology 9.5
face 9.2
confident 9.1
sax 8.9
microscope 8.9
associates 8.9
interior 8.8
looking 8.8
optical 8.7
day 8.6
research 8.6
thinking 8.5
document 8.5
lab coat 8.5
attractive 8.4
manager 8.4
instrument 8.4
hand 8.4
color 8.3
human 8.2
board 8.1
clinic 8.1
family 8
hospital 8
clothing 7.9
coworkers 7.9
25 30 years 7.8
casual clothing 7.8
conference 7.8
assistant 7.8
scientific 7.7
chemical 7.7
retirement 7.7
two 7.6
development 7.6
communication 7.6
care 7.4
occupation 7.3
classroom 7.2
bright 7.1
groom 7.1
medicine 7

Google
created on 2022-01-15

Coat 88.7
Style 83.9
Black-and-white 83.3
Hat 81.2
Suit 80.5
Table 79.8
Font 76.5
Chair 75.7
Curtain 74.6
Art 74
Event 72.9
Monochrome photography 71.5
Monochrome 70.9
Coffee table 68.9
Sitting 68.8
Formal wear 68.5
Tableware 68
Vintage clothing 67.8
Plant 67.3
Room 65.4

Microsoft
created on 2022-01-15

wedding 97.3
man 96.7
person 91.4
text 87.9
ceremony 77.9
wedding dress 74.1
clothing 70.1
groom 55.1
marriage 54.7

Face analysis

Amazon

Google

AWS Rekognition

Age 39-47
Gender Female, 95.9%
Calm 99.9%
Sad 0%
Happy 0%
Confused 0%
Fear 0%
Disgusted 0%
Angry 0%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Chair 91.2%
Couch 73.3%
Dining Table 58.5%

Captions

Microsoft

a man sitting on a bed 50.1%
a man and a woman sitting on a bed 25.7%
a man sitting on top of a bed 25.6%

Text analysis

Amazon

ARDA