Human Generated Data

Title

Untitled (Joe Steinmetz holding rattle snake)
Date

1949
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5470
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Joe Steinmetz holding rattle snake)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 96
Face 91.2
Outdoors 87.6
Person 87.5
Grass 86.6
Plant 86.6
Clothing 85.7
Apparel 85.7
Furniture 82.3
Play 76.8
Guitar 74.5
Musical Instrument 74.5
Leisure Activities 74.5
Person 73.9
Nature 70.2
Person 70.1
Text 69.7
Female 66.8
Portrait 64.8
Photography 64.8
Photo 64.8
Suit 64
Coat 64
Overcoat 64
Shorts 62.5
Kid 60.8
Child 60.8
Girl 60.5
Bed 58.8
Wood 57.4
Housing 57.4
Building 57.4
Brick 57.1
Person 54.7

Imagga
created on 2022-01-23

newspaper 72
product 55.2
creation 43.9
people 19.5
statue 17.8
old 16.7
portrait 15.5
daily 14.5
person 14.5
outdoors 13.4
male 12.8
marble 12.6
sculpture 12.4
art 12.4
face 12.1
sport 11.6
man 11.5
cemetery 10.9
history 10.7
park 10.7
human 10.5
outdoor 9.9
adult 9.7
film 9.7
model 9.3
street 9.2
city 9.1
cricket equipment 9
one 9
stone 8.9
sports equipment 8.9
death 8.7
architecture 8.6
grunge 8.5
negative 8.4
black 8.4
pretty 8.4
sky 8.3
fashion 8.3
dress 8.1
lady 8.1
religion 8.1
memorial 8
women 7.9
equipment 7.9
ancient 7.8
men 7.7
culture 7.7
structure 7.6
happy 7.5
fun 7.5
traditional 7.5
vintage 7.4
symbol 7.4
light 7.3
design 7.3
clothing 7.3
decoration 7.2
lifestyle 7.2
active 7.2
grass 7.1
summer 7.1
day 7.1

Google
created on 2022-01-23

Fence 87.3
Black-and-white 85.4
Split-rail fence 84
Style 83.9
Grass 82.6
Tree 81.1
Landscape 77.5
Plant 76.9
Monochrome photography 74.7
Monochrome 74.2
Wood 71.9
Hat 71.2
Happy 70.1
Vintage clothing 68.1
Stock photography 63.4
Personal protective equipment 58.1
Ranch 56.9
Photo caption 54.4
Font 54.1
Room 53.1

Microsoft
created on 2022-01-23

outdoor 98.9
text 97
standing 87.8
statue 71.2
posing 57.9
black and white 55.7

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 94.8%
Confused 60.3%
Surprised 10.5%
Fear 9.3%
Sad 7.1%
Disgusted 3.9%
Angry 3.8%
Calm 3.8%
Happy 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Guitar 74.5%

Captions

Microsoft

a person standing in front of a fence 76.4%
a person standing in front of a fence 76.3%
a person standing next to a fence 75.2%

Text analysis

Amazon

SARASOTA,
STEINMETZ, SARASOTA, FLORIDA
FLORIDA
STEINMETZ,
e
S
S 2198
2198
9
,
6
A
J
®
F

Google

STEINMETZ, SARASOTA, FLORIDA
STEINMETZ,
SARASOTA,
FLORIDA