Human Generated Data

Title

Untitled (man on dock with men rowing crew in background)
Date

1917
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11755
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (man on dock with men rowing crew in background)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1917

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.3
Human 99.3
Person 98.8
Person 98.7
Water 98.6
Clothing 95.9
Apparel 95.9
Waterfront 95.5
Bird 93.9
Animal 93.9
Pier 92.6
Dock 92.6
Port 92.6
Person 90.1
Person 86.8
Person 86.4
Person 83.3
Airplane 80.4
Transportation 80.4
Vehicle 80.4
Aircraft 80.4
Person 77.5
Shorts 67
Cap 65.2
Hat 65.2
Boat 63.5

Imagga
created on 2022-01-15

oar 39
scull 36.8
sport 30
exercise 20
person 18.8
sexy 18.5
people 17.3
outdoors 16.8
athlete 16.5
adult 16.2
man 15.4
fitness 15.3
water 15.3
active 15.3
body 14.4
attractive 14
fashion 13.6
male 12.8
black 12.7
one 12.7
hair 12.7
competition 11.9
health 11.8
model 11.7
recreation 11.6
portrait 11.6
activity 11.6
leisure 11.6
lifestyle 11.6
posing 11.5
legs 11.3
action 11.2
device 11.1
sports 11.1
court 10.7
healthy 10.7
lady 10.5
fun 10.5
brunette 10.4
summer 10.3
outside 10.3
human 9.7
boat 9.7
erotic 9.4
racket 9.4
sea 9.4
old 9
tennis 8.8
running 8.6
training 8.3
slim 8.3
fit 8.3
leg 8.2
sensuality 8.2
board 8.1
river 8
wheeled vehicle 7.9
sitting 7.7
beach 7.7
pretty 7.7
athletic 7.7
professional 7.7
outdoor 7.6
city 7.5
skateboard 7.3
nice 7.3
ball 7.3
pose 7.2
life 7.2
art 7.2
wet 7.1
runner 7.1
vehicle 7.1
paddle 7
player 7
sky 7

Google
created on 2022-01-15

Water 96
Black 89.7
Swimming pool 89.6
Rectangle 80.6
Swimmer 78.7
Recreation 76.6
Snapshot 74.3
Monochrome 70.8
Monochrome photography 70.5
Sports 68.9
Shorts 68.7
Balance 68.4
Leisure 67.5
Chest 66.6
Swimwear 65.3
Boats and boating--Equipment and supplies 64.2
Stock photography 63.8
Knee 63.2
Physical fitness 62.6
Advertising 61.4

Microsoft
created on 2022-01-15

outdoor 98.2
water 97.4
text 89.8
ship 81.1
sport 79
black and white 78.2
watercraft 74.5
boat 69.2
lake 62.5
person 55.6
surfing 54.6

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 98.8%
Calm 45.6%
Happy 28.2%
Angry 14.7%
Sad 5.2%
Surprised 3.5%
Disgusted 1.6%
Fear 0.9%
Confused 0.4%

AWS Rekognition

Age 24-34
Gender Male, 98.8%
Angry 51.4%
Calm 42.1%
Confused 2.3%
Happy 2.1%
Sad 1.2%
Disgusted 0.5%
Surprised 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Bird 93.9%
Airplane 80.4%
Boat 63.5%

Captions

Microsoft

a man riding on the back of a boat 68.1%
a group of men riding on the back of a boat 60%
a man riding on the back of a boat in the water 59.9%

Text analysis

Amazon

PHON
1tot