Human Generated Data

Title

Untitled (dolphin jumping out of water to get fish from trainer)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5441

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (dolphin jumping out of water to get fish from trainer)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 93.9
Human 93.9
Bird 88.7
Animal 88.7
Person 85.2
Person 84.3
Text 80.7
Bird 72.9
Person 72.4
Poster 64.1
Advertisement 64.1
Outdoors 64.1
Paper 63.8
People 63.4
Leisure Activities 61.6
Water 61.3
Tree 60.4
Plant 60.4
Architecture 58.2
Building 58.2
Tower 58.2
Clock Tower 58.2
Steamer 57.7
Word 57.7
Angler 57
Fishing 57

Imagga
created on 2022-01-23

book jacket 52.1
jacket 43.4
wrapping 30.8
newspaper 25.1
product 22.3
covering 20.7
sky 20.4
water 19.3
creation 17.6
man 16.8
ocean 16.1
beach 16
people 15.1
sea 15
person 14.7
sun 14.5
outdoors 14.2
negative 14.1
landscape 13.4
travel 13.4
silhouette 13.2
film 12.5
cool 12.4
outdoor 12.2
world 12
human 12
summer 11.6
serene 11.3
adult 11.2
light 10.8
sunset 10.8
holiday 10.7
scene 10.4
dark 10
tree 10
male 9.9
park 9.9
snow 9.8
daily 9.7
cloud 9.5
winter 9.4
dirty 9
vacation 9
one 9
sunlight 8.9
color 8.9
sand 8.9
fog 8.7
lifestyle 8.7
cold 8.6
tropical 8.5
relaxation 8.4
tourism 8.3
scenery 8.1
activity 8.1
river 8
scenic 7.9
business 7.9
lake 7.8
black 7.8
outside 7.7
mask 7.7
money 7.7
happy 7.5
photographic paper 7.4
symbol 7.4
island 7.3
danger 7.3
coast 7.2
recreation 7.2
trees 7.1
day 7.1
happiness 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 100
poster 67.1
sign 65.3

Face analysis

Amazon

AWS Rekognition

Age 6-16
Gender Female, 66.6%
Surprised 43.3%
Fear 32.6%
Happy 9.5%
Calm 7.2%
Confused 2.3%
Disgusted 2%
Angry 1.9%
Sad 1.3%

AWS Rekognition

Age 31-41
Gender Male, 99.2%
Fear 87.7%
Happy 3.7%
Confused 2.1%
Surprised 1.6%
Sad 1.6%
Angry 1.2%
Calm 1.1%
Disgusted 0.9%

AWS Rekognition

Age 49-57
Gender Male, 98.8%
Calm 89.2%
Happy 5%
Sad 2.8%
Surprised 1.6%
Angry 0.5%
Confused 0.5%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 37-45
Gender Male, 99.7%
Surprised 64.5%
Happy 8.2%
Confused 7.1%
Calm 6%
Disgusted 5.5%
Sad 5.1%
Angry 1.9%
Fear 1.7%

Feature analysis

Amazon

Person 93.9%
Bird 88.7%
Clock Tower 58.2%

Captions

Microsoft

a person holding a sign 53.1%
a person holding a sign 53%
a close up of a person holding a sign 44.8%

Text analysis

Amazon

OF
SEA
THE
THEATER OF THE SEA
THEATER
FLORIDA
ISLAMORADA
STEINMETZ,
KEYS
SARASOTA,
ON THE
ON
2
OF THEATER THE SEA
STEINMETZ, SARASOTA, FLORIDA 2 5993
5993
25993
asi

Google

YT37A2-NAGO
THEATER
OF
THE
STEINMETZ,
SEA
ISLAMORADA
ER
SARASOTA,
ON
FLORIDA
259
YT37A2-NAGO as THEATER OF THE SEA ISLAMORADA ON THE THE FLORIDA KEYS ER OF THEA STEINMETZ, SARASOTA, FLORIDA 259
as
THEA
KEYS