Human Generated Data

Title

Untitled (two men fishing on a row boat)

Date

c. 1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7770

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (two men fishing on a row boat)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Nature 99.4
Person 99.2
Human 99.2
Outdoors 98.9
Person 98.7
Water 96.2
Snow 86
Plant 80
Tree 80
Ice 79.3
Sea 79.3
Ocean 79.3
Person 73.8
Winter 73.7
Waterfront 71.9
Female 71.7
Pier 67.4
Port 67.4
Dock 67.4
Weather 66.5
Apparel 65
Clothing 65
Woman 61.7
People 61.7
Drawing 61.4
Art 61.4
Building 61.3
Shelter 61.3
Rural 61.3
Countryside 61.3
Coast 60.5
Shoreline 60.5
Photography 59.1
Photo 59.1
Oars 55.8
Landscape 55.1

Imagga
created on 2022-01-09

beach 35
ski 27.8
ocean 27
sport 26.7
water 26
sky 24.4
sunset 23.4
winter 23
outdoors 23
snow 21.2
sea 21.1
cold 18.9
people 18.4
vacation 18
landscape 17.9
travel 17.6
fun 17.2
recreation 17
silhouette 16.6
active 16.4
activity 16.1
summer 16.1
sand 16
outdoor 15.3
lifestyle 15.2
leisure 14.9
man 14.1
athlete 13.8
device 13.6
river 13.3
action 13
mountain 12.5
slope 12.5
sun 12.2
person 12.2
sunrise 12.2
runner 12
tree 11.9
speed 11.9
coast 11.7
park 11.6
jump 11.5
extreme 11.5
holiday 11.5
male 11.3
outrigger 11.1
lake 11
freedom 11
dawn 10.6
board 10.6
dusk 10.5
scene 10.4
horizon 9.9
trees 9.8
shore 9.6
conveyance 9.5
wave 9.5
men 9.4
day 9.4
fisherman 9.4
tropical 9.4
skier 9.3
waves 9.3
relax 9.3
air 9.2
exercise 9.1
scenery 9
stabilizer 8.9
vehicle 8.8
jumping 8.7
happiness 8.6
frozen 8.6
coastline 8.5
clouds 8.5
fast 8.4
city 8.3
resort 8.3
scenic 7.9
forest 7.8
freeze 7.8
cloud 7.8
surf 7.7
outside 7.7
walking 7.6
wheeled vehicle 7.6
relaxation 7.5
bench 7.5
movement 7.5
joy 7.5
free 7.5
fly 7.5
mountains 7.4
tourist 7.3
wet 7.2
cool 7.1
season 7

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

tree 99.9
sky 99.8
outdoor 99.2
text 92.4
water 91.5
black and white 80.7
person 72.1
lake 61.9
surfing 59.5

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 97.7%
Sad 52.8%
Calm 29.2%
Happy 14.2%
Confused 1.3%
Surprised 0.9%
Disgusted 0.8%
Angry 0.6%
Fear 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a man flying through the air while riding a skateboard 43.2%
a man flying through the air while riding skis 37.6%
a man doing a trick on a skateboard 37.5%

Text analysis

Amazon

24561.
KODVKS

Google

24561.
24561.