Human Generated Data

Title

Untitled (two men examining small objects near glass case)

Date

c. 1936

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4778

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men examining small objects near glass case)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Apparel 99.7
Clothing 99.7
Person 99.1
Human 99.1
Person 99
Hat 98.8
Sun Hat 74.2
Sleeve 73.1
Shirt 69.9
Face 69.5
Accessories 66.2
Sunglasses 66.2
Accessory 66.2
Photography 60.4
Photo 60.4
Coat 59.5
Portrait 59.2
Long Sleeve 58.1
Finger 57

Imagga
created on 2022-01-29

man 42.4
office 40.8
person 35.8
businessman 35.3
laptop 35
male 34.1
computer 33.8
business 33.4
work 33
working 31
adult 30.1
professional 30.1
people 29
nurse 28.2
desk 26.6
surgeon 25.7
businesspeople 24.7
businesswoman 24.6
meeting 23.6
corporate 23.2
worker 21
table 20.9
sitting 20.6
medical 20.3
indoors 20.2
happy 20.1
job 19.5
specialist 19.5
executive 18.9
team 17.9
group 17.7
successful 17.4
teamwork 16.7
suit 16.2
looking 16
smiling 15.9
scholar 15.7
colleagues 15.6
document 15.4
face 14.9
manager 14.9
portrait 14.9
men 14.6
confident 14.6
coat 14.4
notebook 14.2
hospital 14
home 13.6
doctor 13.2
success 12.9
smile 12.8
communication 12.6
intellectual 12.5
patient 12.4
serious 12.4
education 12.1
attractive 11.9
horizontal 11.7
handsome 11.6
engineer 11.4
senior 11.3
company 11.2
technology 11.1
casual 11
occupation 11
paper 11
letter 11
scientist 10.8
employment 10.6
laboratory 10.6
using 10.6
medicine 10.6
room 10.5
together 10.5
lab coat 10.4
student 10.3
lifestyle 10.1
pen 10.1
indoor 10
color 10
science 9.8
conference 9.8
assistant 9.7
lab 9.7
project 9.6
elderly 9.6
workplace 9.5
ethnic 9.5
research 9.5
employee 9.5
talking 9.5
women 9.5
biology 9.5
career 9.5
happiness 9.4
teacher 9.3
health 9
cheerful 8.9
coworkers 8.8
businessperson 8.8
couple 8.7
architect 8.7
boss 8.6
formal 8.6
microscope 8.6
study 8.4
text 8.4
glasses 8.3
writing 8.3
clipboard 8.1
associates 7.9
bright 7.9
60s 7.8
clothing 7.8
chemistry 7.7
expression 7.7
exam 7.7
illness 7.6
college 7.6
sit 7.6
builder 7.5
care 7.4
20s 7.3
clinic 7.3
modern 7
pretty 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 98.1
black and white 90.6
person 89.9
clothing 81.7
fashion accessory 78.3
hat 67.6
man 51.4

Face analysis

Amazon

Google

AWS Rekognition

Age 61-71
Gender Female, 84.7%
Calm 97.6%
Surprised 1.2%
Angry 0.6%
Sad 0.2%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 48-54
Gender Male, 98.4%
Calm 64.3%
Sad 30.8%
Happy 2.4%
Surprised 1.1%
Confused 0.5%
Disgusted 0.4%
Angry 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Hat 98.8%
Sunglasses 66.2%

Captions

Microsoft

a man sitting at a table in front of a window 67.3%
a man sitting at a table 67.2%
a man sitting at a table in front of a box 67.1%

Text analysis

Amazon

sos