Human Generated Data

Title

Untitled (Steinmetz family dressed for Halloween)

Date

1939

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4990

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Steinmetz family dressed for Halloween)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Human 99.4
Person 99.4
Person 98.9
Indoors 98.2
Interior Design 98.2
Apparel 98
Clothing 98
Helmet 98
Face 97.4
Person 97.3
Person 96.3
Helmet 95.2
People 80.6
Room 77.5
Female 77.4
Meal 76.1
Food 76.1
Person 75.9
Head 74.3
Portrait 68.6
Photography 68.6
Photo 68.6
Furniture 65.6
Girl 64.7
Text 60.3
Bedroom 60.2
Kid 59.2
Child 59.2
Woman 58.9
Beard 58.7
Bed 58.6
Performer 56.9
Man 55.3

Imagga
created on 2022-01-22

negative 90.3
film 73.1
photographic paper 55
photographic equipment 36.7
people 32.3
person 25
adult 20.2
man 18.2
medical 17.6
male 15.7
medicine 15
professional 14.7
team 13.4
working 13.3
health 13.2
business 12.7
work 12.6
laboratory 12.5
biology 12.3
doctor 12.2
technology 11.9
portrait 11.6
family 11.6
happy 11.3
human 11.2
attractive 11.2
women 11.1
equipment 10.9
scientist 10.8
worker 10.7
lab 10.7
chemistry 10.6
interior 10.6
clinic 10.6
hospital 10.5
research 10.5
table 10.1
fashion 9.8
science 9.8
businessman 9.7
indoors 9.7
office 9.6
test 9.6
home 9.6
room 9.4
coat 9
looking 8.8
shop 8.8
scientific 8.7
chemical 8.7
day 8.6
men 8.6
smile 8.5
casual 8.5
modern 8.4
desk 8.4
pretty 8.4
house 8.4
color 8.3
occupation 8.2
businesswoman 8.2
style 8.2
dress 8.1
lady 8.1
suit 8.1
sexy 8
clothing 8
job 8
happiness 7.8
standing 7.8
black 7.8
face 7.8
model 7.8
corporate 7.7
instrument 7.7
old 7.7
development 7.6
nurse 7.5
clothes 7.5
teamwork 7.4
20s 7.3
cheerful 7.3
decoration 7.3
group 7.2
smiling 7.2
lifestyle 7.2
life 7.1
glass 7.1
mother 7.1

Google
created on 2022-01-22

Photograph 94.3
Shirt 93.8
White 92.2
Product 90.7
Sleeve 87.1
Black-and-white 86
Smile 85.7
Hat 84.9
Style 84.1
T-shirt 81
Font 78.1
Art 77.4
Snapshot 74.3
Monochrome 74
Monochrome photography 72.5
Room 68.8
Pattern 68.5
Vintage clothing 68.4
Fashion design 66.6
Picture frame 66

Microsoft
created on 2022-01-22

text 98.6
person 90.3
human face 87.9
clothing 84.1
smile 81.6
posing 77.1
old 76
drawing 51.1

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Confused 40.8%
Sad 26.9%
Calm 23.3%
Happy 4.4%
Surprised 2.4%
Disgusted 1%
Angry 0.6%
Fear 0.6%

AWS Rekognition

Age 45-53
Gender Female, 99.5%
Calm 97%
Happy 1.6%
Sad 0.5%
Surprised 0.4%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 41-49
Gender Female, 90.7%
Happy 54.2%
Calm 37.4%
Sad 3.1%
Confused 1.6%
Angry 1.5%
Surprised 1%
Disgusted 0.9%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Helmet 98%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 92.6%
a vintage photo of a group of people posing for a picture 92.5%
a group of people posing for a photo 92.4%

Text analysis

Amazon

10949.
'39.
os
VCAR

Google

lo949.
lo949.