Human Generated Data

Title

Untitled (men and women looking over railing)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4715

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men and women looking over railing)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 98.7
Person 98.7
Person 98.5
Person 98.4
Person 98.1
Person 98
Person 95.5
Person 95.2
Person 92.1
Tie 82.5
Accessory 82.5
Accessories 82.5
Clinic 77.3
People 75.5
Tie 66.1
Doctor 65.7
Indoors 63.8
Room 63.8
Coat 59.7
Overcoat 59.7
Clothing 59.7
Suit 59.7
Apparel 59.7
Nurse 59.3

Imagga
created on 2022-01-29

nurse 38.4
man 33.6
adult 31.3
male 31.2
person 31.2
people 29
senior 23.4
medical 22
looking 20.8
office 20.1
professional 20.1
indoors 19.3
mature 18.6
elderly 18.2
portrait 18.1
health 18
doctor 17.8
businessman 17.6
happy 17.5
table 16.4
hospital 15.7
work 15.7
face 15.6
men 15.4
coat 15.4
gymnasium 14.9
room 14.8
old 14.6
sitting 14.6
home 14.3
handsome 14.3
business 14
smiling 13.7
computer 13.6
casual 13.5
patient 13.3
occupation 12.8
indoor 12.8
laptop 12.7
worker 12.7
women 12.6
lab 12.6
laboratory 12.5
working 12.4
medicine 12.3
couple 12.2
camera 12
athletic facility 12
aged 11.8
specialist 11.6
clinic 11.6
retired 11.6
retirement 11.5
smile 11.4
life 11.3
modern 11.2
student 11.1
facility 10.9
science 10.7
chemistry 10.6
grandfather 10.5
businesspeople 10.4
technology 10.4
desk 10.4
corporate 10.3
glasses 10.2
chandelier 10.1
horizontal 10
human 9.7
education 9.5
lab coat 9.4
lifestyle 9.4
clothing 9
chemist 8.8
job 8.8
together 8.8
examination 8.7
test 8.7
30s 8.6
day 8.6
happiness 8.6
research 8.6
expression 8.5
attractive 8.4
hand 8.3
care 8.2
lady 8.1
lighting fixture 8.1
interior 8
look 7.9
70s 7.9
bright 7.9
chemical 7.8
examining 7.8
scientist 7.8
color 7.8
colleagues 7.8
scientific 7.7
concentration 7.7
exam 7.7
husband 7.6
two 7.6
biology 7.6
career 7.6
pensioner 7.5
joy 7.5
glass 7.5
holding 7.4
confident 7.3
group 7.2
film 7.2
team 7.2
hair 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

wall 96.9
cartoon 94.4
text 83.5
drawing 82.1
clothing 77.5
black and white 71.1
person 69.7
human face 56.7

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 98.6%
Calm 74.9%
Confused 21.5%
Angry 1.1%
Sad 0.8%
Surprised 0.6%
Disgusted 0.5%
Happy 0.3%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Sad 58.9%
Calm 20.8%
Confused 14.4%
Angry 2.7%
Disgusted 1.5%
Surprised 0.9%
Happy 0.5%
Fear 0.3%

AWS Rekognition

Age 52-60
Gender Male, 90.4%
Calm 90%
Sad 6.9%
Disgusted 1.1%
Angry 0.9%
Confused 0.4%
Fear 0.3%
Happy 0.2%
Surprised 0.2%

AWS Rekognition

Age 45-53
Gender Female, 77.2%
Sad 61.4%
Calm 34.2%
Confused 1.6%
Happy 1.5%
Angry 0.4%
Disgusted 0.3%
Fear 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Tie 82.5%
Suit 59.7%

Captions

Microsoft

a group of people performing on a counter 86.4%
a group of people sitting at a table 78.2%
a group of people performing on a counter top 78.1%

Text analysis

Amazon

as
22