Human Generated Data

Title

Untitled (men near glass display case; man writing on pad of paper)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4815
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men near glass display case; man writing on pad of paper)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.4
Person 99.4
Accessory 99.1
Accessories 99.1
Tie 99.1
Person 99.1
Person 98.7
Clinic 97.6
Tie 94.5
Hospital 93.7
Person 88.1
Operating Theatre 87.1
Clothing 75.7
Apparel 75.7
Person 64.2
Coat 63.8
Doctor 59.8
Lab Coat 58

Imagga
created on 2022-01-29

specialist 67.7
lab coat 46.3
office 44.3
person 43.5
man 43.1
computer 42.8
coat 41.6
laptop 41.4
professional 40.9
people 40.8
work 37
male 37
adult 35.6
desk 35
business 32.9
working 32.8
happy 30.1
businessman 30.1
doctor 29.2
mature 28.9
portrait 28.5
job 28.4
smiling 26.1
businesspeople 25.7
sitting 25
indoors 24.7
elderly 23
businesswoman 22.8
table 22.5
looking 22.4
medical 22.1
senior 21.6
corporate 21.5
men 21.5
colleagues 21.4
casual 21.2
confident 21
hospital 20.1
clinic 19.9
worker 19.7
lifestyle 19.6
face 19.2
smile 18.6
patient 18.5
modern 18.3
attractive 18.2
health 18.1
handsome 17.9
executive 17.8
notebook 17.7
consultant 17.6
team 17.1
medicine 16.8
successful 16.5
care 16.5
technology 16.4
document 16.1
home 16
indoor 15.6
old 15.4
suit 15.3
success 15.3
garment 15.3
meeting 15.1
clothing 15.1
women 15.1
together 14.9
teamwork 14.9
associates 14.8
education 14.7
occupation 14.7
nurse 14.5
bright 14.3
workplace 14.3
horizontal 14.3
cheerful 13.8
busy 13.5
color 13.4
happiness 13.3
glasses 13
clinical 12.7
talking 12.4
manager 12.1
group 12.1
student 12.1
letter 11.8
physician 11.7
older 11.7
couple 11.3
keyboard 11.3
communication 10.9
coworkers 10.8
practitioner 10.8
pharmacist 10.6
laboratory 10.6
human 10.5
writing 10.5
camera 10.2
one 9.7
expertise 9.7
concentration 9.7
30s 9.6
retirement 9.6
career 9.5
sit 9.5
day 9.4
light 9.4
hand 9.1
room 9.1
text 9
good mood 8.8
surgery 8.8
assistant 8.8
secretary 8.7
using 8.7
paper 8.6
profession 8.6
illness 8.6
uniform 8.6
thinking 8.6
expression 8.5
two 8.5
contemporary 8.5
company 8.4
20s 8.3
alone 8.2
aged 8.2
surgeon 8.1
science 8
general practitioner 7.9
look 7.9
doctors 7.9
discussing 7.9
case 7.9
businessmen 7.8
partners 7.8
employee 7.8
1 7.7
exam 7.7
age 7.6
teacher 7.6
health professional 7.6
females 7.6
clipboard 7.5
learning 7.5
relaxed 7.5
treatment 7.4
friendly 7.3
sick person 7.3

Google
created on 2022-01-29

Health care provider 89.5
Medical equipment 86.9
Medical assistant 83.1
Black-and-white 83
White coat 82.7
Health care 82
Medical procedure 80
Service 76.5
Laboratory equipment 75.5
Science 74.4
Medical 74
Cooking 73
Physician 72
Event 71.8
Monochrome 71.3
Chemistry 70.9
Clinic 70.2
Monochrome photography 69.7
Nurse uniform 69.7
Apron 66.1

Microsoft
created on 2022-01-29

man 98.5
person 98.2
text 91.4
tableware 78.4
drawing 67.8
sketch 64.6
wine glass 55.7
table 54.1

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Female, 52.4%
Calm 97.3%
Angry 1%
Confused 0.7%
Sad 0.4%
Surprised 0.2%
Disgusted 0.2%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 48-56
Gender Female, 98.8%
Sad 58.8%
Calm 33%
Happy 2.6%
Angry 2.6%
Fear 1.2%
Confused 1.1%
Disgusted 0.5%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 99.1%

Captions

Microsoft

a group of people standing around a table 91.1%
a group of people standing on top of a table 84.3%
a man standing on a table 84.2%

Text analysis

Amazon

٢٤
zena
zena YY33A2
YY33A2
FIF

Google

SAFFAFMANCD
SAFFAFMANCD