Human Generated Data

Title

Untitled (woman seated behind desk, standing man looking at his watch)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5306
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (woman seated behind desk, standing man looking at his watch)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 98.4
Human 98.4
Person 96.4
Apparel 95.8
Clothing 95.8
Furniture 90.6
Chair 90.6
Clinic 85.7
Hospital 79.9
Hat 74.2
Operating Theatre 55.6

Imagga
created on 2022-01-22

people 31.2
professional 31.1
work 27.9
worker 27.5
person 27.4
medical 26.5
man 26.2
working 24.7
male 24.1
lab 23.3
laboratory 23.1
indoors 21.1
home 20.9
adult 20.8
doctor 20.7
office 20.5
research 20
kitchen 20
scientist 19.6
medicine 19.4
business 18.2
smiling 18.1
biology 18
job 17.7
clinic 17.6
room 17.6
team 17
modern 16.8
coat 16.7
chemical 16.7
technology 16.3
happy 16.3
interior 15.9
table 15.9
nurse 15.6
scientific 15.5
student 15.4
test 15.4
looking 15.2
science 15.1
indoor 14.6
health 14.6
chemistry 14.5
furniture 14.2
hospital 13.6
portrait 13.6
businesspeople 13.3
white goods 13.2
businessman 13.2
teamwork 13
corporate 12.9
occupation 12.8
chemist 12.8
equipment 12.5
refrigerator 12.3
kitchenware 12.3
education 12.1
computer 12.1
home appliance 12
successful 11.9
laptop 11.8
businesswoman 11.8
biotechnology 11.8
experiment 11.7
smile 11.4
desk 11.2
men 11.2
inside 11
confident 10.9
house 10.9
microscope 10.8
assistant 10.7
appliance 10.2
executive 10.1
instrument 10
holding 9.9
cheerful 9.7
human 9.7
discovery 9.7
uniform 9.7
development 9.5
lifestyle 9.4
window 9.3
face 9.2
alone 9.1
attractive 9.1
patient 9.1
employee 8.9
clothing 8.9
microbiology 8.9
standing 8.7
lab coat 8.6
sitting 8.6
glasses 8.3
counter 8.3
care 8.2
dishwasher 8.2
decor 8
women 7.9
genes 7.9
biochemistry 7.9
sterile 7.9
analysis 7.8
tube 7.7
30s 7.7
casual 7.6
workplace 7.6
one person 7.5
one 7.5
study 7.5
20s 7.3
design 7.3
bright 7.1
to 7.1
happiness 7
look 7

Google
created on 2022-01-22

Furniture 94.7
Chair 90.5
Hat 88.3
Coat 86.5
Table 83
Suit 73.6
Monochrome photography 72.6
White-collar worker 69.7
Monochrome 69.7
Vintage clothing 68.5
Art 65.7
Sitting 64.5
Room 64.3
Uniform 64.1
Font 64
Job 59.5
Cooking 56.2
Illustration 53.6
Window blind 50.9

Microsoft
created on 2022-01-22

wall 95.7
indoor 94.5
hat 90.1
clothing 88
furniture 87.8
fashion accessory 86.4
text 83.1
person 76.1
appliance 75.4
white goods 70.9
chair 58.8
fedora 58.4
refrigerator 53.9

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Female, 61.1%
Happy 52.7%
Calm 35.1%
Sad 6.9%
Confused 1.3%
Disgusted 1%
Angry 1%
Fear 1%
Surprised 0.9%

AWS Rekognition

Age 27-37
Gender Female, 97.5%
Calm 42.7%
Happy 35.7%
Sad 14.6%
Surprised 2.3%
Confused 1.8%
Angry 1%
Fear 0.9%
Disgusted 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Chair 90.6%
Hat 74.2%

Captions

Microsoft

a person standing in front of a window 53.5%
a man and a woman standing in front of a window 30.8%
a person standing next to a window 30.7%

Text analysis

Amazon

6471

Google

6471
6471