Human Generated Data

Title

Untitled (man with pipe sitting at desk holding a small model of a gorilla)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4694

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with pipe sitting at desk holding a small model of a gorilla)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Apparel 98.6
Clothing 98.6
Person 97.1
Human 97.1
Furniture 92.4
Person 89.6
Shelf 89.1
Scientist 71
Coat 67.9
Accessories 65.7
Accessory 65.7
Tie 65.7
Appliance 62.9
Bookcase 58.5
Lab 57.8
Lab Coat 57.8
Meal 55.6
Food 55.6

Imagga
created on 2022-01-29

man 44.4
office 42.1
professional 39.7
adult 38
businessman 36.2
male 34.8
people 34.6
businesspeople 34.2
business 33.5
person 31.1
coat 30
work 29.9
lab coat 29.4
job 29.2
businesswoman 28.2
computer 27.3
doctor 27.3
indoors 27.3
desk 27.2
corporate 26.7
nurse 24.8
working 24.8
smiling 23.9
happy 23.8
team 23.3
medical 23
laptop 22.9
casual 22.9
indoor 22.9
hospital 22.7
group 21.8
attractive 21.7
colleagues 21.4
teamwork 21.4
worker 20.4
sitting 19.8
portrait 19.4
clinic 19.3
looking 19.2
meeting 18.9
occupation 18.4
executive 17.9
handsome 17.9
lifestyle 17.4
confident 17.3
men 17.2
associates 16.7
health 16.7
face 16.4
talking 16.2
color 16.2
clothing 16.1
medicine 15.9
coworkers 15.7
expertise 15.5
patient 15.5
communication 15.1
bright 15
care 14.8
employee 14.8
20s 14.7
student 14.6
formal 14.3
smile 14.3
successful 13.7
practitioner 13.7
cheerful 13
education 13
room 13
garment 12.9
explaining 12.8
pharmacist 12.8
pretty 12.6
cooperation 12.6
30s 12.5
modern 11.9
happiness 11.8
consultant 11.7
specialist 11.7
women 11.1
suit 11
table 11
horizontal 10.9
doctors 10.8
holding 10.7
businessmen 10.7
employment 10.7
corporation 10.6
success 10.5
brunette 10.5
career 10.4
technology 10.4
stethoscope 10.3
manager 10.3
day 10.2
clipboard 10
collaboration 9.9
discussing 9.8
25 30 years 9.8
conference 9.8
together 9.7
couple 9.6
groom 9.5
two 9.3
company 9.3
camera 9.3
hand 9.1
crew 8.9
to 8.9
diagnosis 8.8
clinical 8.8
lab 8.8
laboratory 8.7
health professional 8.7
planning 8.7
collar 8.6
staff 8.6
uniform 8.6
notebook 8.5
smart 8.5
showing 8.5
presentation 8.4
friendly 8.2
30 35 years 7.9
x ray 7.9
businessperson 7.8
cure 7.8
discussion 7.8
examination 7.8
partners 7.8
attention 7.8
partner 7.7
mid adult 7.7
busy 7.7
test 7.7
exam 7.7
elderly 7.7
service 7.7
shirt 7.5
study 7.5
glasses 7.4
treatment 7.4
alone 7.3
scholar 7.3
idea 7.1

Google
created on 2022-01-29

Furniture 94.6
Table 91.7
Desk 89.6
Black 89.6
Shelf 86.4
Black-and-white 85.1
Building 84.4
Style 83.8
Shelving 83.3
Writing desk 83.1
Chair 82.9
Wood 80.7
Bookcase 78.9
Window 76.7
Monochrome 73.8
Monochrome photography 73.6
Art 69.4
Room 68.2
Sunglasses 67.9
Sitting 63.4

Microsoft
created on 2022-01-29

text 98
indoor 95.4
window 93.7
furniture 89
book 84
person 57.8
white goods 53.6
refrigerator 52.4

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.8%
Calm 71.3%
Sad 10.9%
Surprised 10.4%
Angry 4.8%
Confused 1.2%
Happy 0.6%
Disgusted 0.5%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Tie 65.7%

Captions

Microsoft

a person sitting next to a window 49.4%
a person sitting in front of a window 49.3%
a person sitting on top of a refrigerator 34.6%

Text analysis

Amazon

and