Human Generated Data

Title

Untitled (male students in dorm room)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12094
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (male students in dorm room)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.7
Human 99.7
Person 99.5
Person 99.4
Person 99
Person 92.4
Shoe 89.5
Apparel 89.5
Clothing 89.5
Footwear 89.5
Shoe 85.7
Person 81.1
Tie 78.8
Accessories 78.8
Accessory 78.8
Chair 69.1
Furniture 69.1
Flooring 65.1
Clinic 64.3
Leisure Activities 64.1
Face 63.5
Portrait 63.5
Photo 63.5
Photography 63.5
Coat 61.8
People 60.9
Stage 59.2
Table 58.1
Meal 57.3
Food 57.3
Scientist 55.5

Imagga
created on 2022-01-15

man 39.7
person 33.4
people 31.8
male 30.5
medical 27.4
patient 27.3
doctor 24.4
hospital 24
indoors 23.7
barbershop 23.4
home 22.3
adult 22.3
professional 22.1
hairdresser 21.7
senior 20.6
coat 19
men 18.9
shop 18.5
health 18.1
work 18.1
clinic 17.8
room 17.6
happy 17.5
smiling 16.6
care 16.5
worker 16.4
nurse 16.3
occupation 15.6
office 15.3
grandfather 15.2
working 15
mercantile establishment 14.7
lab coat 14.5
elderly 14.4
medicine 14.1
couple 13.1
sitting 12.9
computer 12.8
laboratory 12.5
illness 12.4
lifestyle 12.3
desk 12.3
mature 12.1
surgeon 11.9
color 11.7
portrait 11.6
retired 11.6
old 11.1
casual 11
business 10.9
lab 10.7
case 10.6
job 10.6
sick person 10.5
looking 10.4
happiness 10.2
scientist 9.8
family 9.8
place of business 9.8
uniform 9.7
research 9.5
student 9.3
smile 9.3
face 9.2
science 8.9
70s 8.9
to 8.9
women 8.7
chemistry 8.7
retirement 8.6
profession 8.6
talking 8.6
enjoying 8.5
clothing 8.4
study 8.4
inside 8.3
treatment 8.3
life 8.2
team 8.1
businessman 7.9
healing 7.8
education 7.8
stethoscope 7.8
chair 7.8
disease 7.8
exam 7.7
musical instrument 7.6
biology 7.6
specialist 7.6
enjoyment 7.5
help 7.4
cheerful 7.3
grandma 7.3
laptop 7.3
group 7.3
aged 7.2
instrument 7
together 7

Google
created on 2022-01-15

Black-and-white 84.8
Style 83.9
Monochrome 77.9
Monochrome photography 77
Snapshot 74.3
Font 70.6
Room 70
Art 69.7
Suit 68
Event 67.9
Photo caption 66.5
Sitting 64.8
Stock photography 62.8
Team 59.5
Illustration 58.8
Vintage clothing 56.8
History 56.7
Motor vehicle 53.2
Curtain 53.1
Chair 52.5

Microsoft
created on 2022-01-15

text 99
person 98
clothing 78.9
man 69.7
black and white 56.8

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Sad 61%
Calm 32.5%
Confused 3.5%
Angry 0.9%
Disgusted 0.7%
Surprised 0.7%
Happy 0.5%
Fear 0.3%

AWS Rekognition

Age 27-37
Gender Male, 67.6%
Calm 99.1%
Sad 0.2%
Fear 0.2%
Happy 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 37-45
Gender Female, 96.5%
Calm 85.2%
Happy 12.7%
Sad 1.6%
Confused 0.2%
Fear 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 26-36
Gender Male, 89.7%
Calm 93.9%
Sad 3%
Happy 2%
Surprised 0.3%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 89.5%
Tie 78.8%
Chair 69.1%

Captions

Microsoft

a group of people posing for the camera 81.6%
a group of people posing for a photo 76.5%
a group of people posing for a picture 76.4%

Text analysis

Amazon

H
330