Human Generated Data

Title

Untitled (man with pipe holding small model gorilla)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4696

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man with pipe holding small model gorilla)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Furniture 99.1
Human 96.7
Person 96.7
Chair 93.2
Shelf 91.1
Appliance 79.2
Clothing 76.1
Apparel 76.1
Bookcase 71.4
Mammal 69.4
Zebra 69.4
Animal 69.4
Wildlife 69.4
Person 62

Imagga
created on 2022-01-29

man 37.7
people 35.7
office 32.6
adult 31.2
male 29.8
person 28.8
businessman 28.3
professional 26.8
businesspeople 26.6
computer 26.5
business 26.1
working 24.8
work 23.6
happy 23.2
indoors 22.9
desk 22.4
businesswoman 21.8
casual 20.3
medical 20.3
smiling 20.3
indoor 20.1
laptop 19.3
worker 18.3
corporate 18
shop 17.3
sitting 17.2
doctor 16.9
job 16.8
looking 16.8
attractive 16.8
hospital 15.9
lifestyle 15.9
room 15.6
colleagues 15.5
team 15.2
talking 15.2
home 15.2
clinic 15.1
communication 15.1
face 14.9
portrait 14.9
teamwork 14.8
furniture 14.8
20s 14.7
confident 14.6
coat 14.5
group 14.5
technology 14.1
medicine 14.1
color 13.9
health 13.9
occupation 13.8
student 13.7
table 13.5
nurse 13.5
patient 13
men 12.9
bright 12.9
smile 12.8
women 12.7
lab 12.6
laboratory 12.5
meeting 12.3
executive 12.2
education 12.1
barbershop 11.8
clothing 11.7
handsome 11.6
care 11.5
employee 11.3
modern 11.2
lab coat 11
happiness 11
horizontal 10.9
mercantile establishment 10.8
25 30 years 10.8
holding 10.7
30s 10.6
formal 10.5
bookcase 10.3
suit 10.2
two 10.2
successful 10.1
associates 9.8
pretty 9.8
science 9.8
cheerful 9.8
two people 9.7
furnishing 9.7
together 9.6
jacket 9.1
scientist 8.8
businessmen 8.8
businessperson 8.8
newspaper 8.7
chemical 8.7
mid adult 8.7
corporation 8.7
day 8.6
research 8.6
reading 8.6
career 8.5
one person 8.5
manager 8.4
house 8.4
negative 8.3
film 8
chemist 7.9
coworkers 7.9
couple 7.8
discovery 7.8
scientific 7.8
employment 7.7
expression 7.7
shelf 7.6
biology 7.6
notebook 7.5
company 7.4
glasses 7.4
inside 7.4
friendly 7.3
success 7.2
place of business 7.2
specialist 7

Google
created on 2022-01-29

Table 96.6
Furniture 95.5
Desk 91.4
Black 89.7
Shelf 87.4
Bookcase 86.6
Writing desk 85.1
Black-and-white 84.7
Chair 84.6
Style 84
Shelving 80.1
Building 78.7
Monochrome 75.6
Monochrome photography 74.7
Book 73.4
Room 68.4
Publication 66.1
Sitting 65.6
Stock photography 63.3
Art 62.6

Microsoft
created on 2022-01-29

text 98.3
book 90.6
furniture 88.4
indoor 86.6
window 83.7
person 75.3
shelf 69.8
clothing 61.7
white goods 59.6
man 51.7

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.1%
Calm 97.8%
Surprised 0.8%
Sad 0.8%
Confused 0.3%
Angry 0.2%
Disgusted 0.1%
Happy 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.7%
Zebra 69.4%

Captions

Microsoft

a person sitting on a shelf 59.1%
a person sitting in front of a bookshelf 44.4%
a person sitting on a bookshelf 41.6%