Human Generated Data

Title

Shakedown

Date

1967-1969

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of The Mr. and Mrs. Stanley Marcus Foundation, P1972.24

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Shakedown

People

Artist: Danny Lyon, American born 1942

Date

1967-1969

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-29

Human 99.8
Person 99.8
Person 99.5
Person 99.4
Person 99.2
Person 98.9
Person 98.5
Person 98
Animal 94.5
Mammal 94.5
Horse 94.5
Person 93.1
Clothing 90.5
Apparel 90.5
Shorts 90.5
Person 86.5
Dog 75.1
Canine 75.1
Pet 75.1
People 69
Bird 68.6
Leisure Activities 66.3
Outdoors 65.2
Back 63.8
Water 60.8
Wood 58.7
Ground 58.7
Finger 58.6
Soil 57.2
Dance Pose 56.5

Clarifai
created on 2018-02-09

people 99.9
group together 99.7
group 99.1
many 99.1
war 98.2
adult 97.9
military 97.6
soldier 96.1
several 94.4
man 94.3
gun 93.5
skirmish 93.2
weapon 92.2
vehicle 89.7
wear 89.5
child 89.2
four 86.9
rifle 86.8
outfit 86
recreation 85.9

Imagga
created on 2018-02-09

brass 43.3
man 31.6
trombone 28.8
rifle 27.9
gun 25.8
people 25.7
weapon 24
male 21.3
sport 21
person 19.5
silhouette 18.2
adult 18.2
sky 17.9
outdoor 16.8
action 16.3
active 16.3
firearm 16
cornet 15.3
danger 14.6
sunset 14.4
beach 14.3
outdoors 14.2
leisure 14.1
uniform 13.7
soldier 13.7
travel 13.4
device 13.4
walking 13.3
fun 12.7
activity 12.5
mountain 12.5
lifestyle 12.3
summer 12.2
sax 12.2
men 12
landscape 11.9
protection 11.8
clothing 11.8
dirty 11.8
military 11.6
player 11.6
boy 11.3
play 11.2
freedom 11
camouflage 10.8
mask 10.7
vacation 10.6
women 10.3
grass 10.3
radioactive 9.8
radiation 9.8
destruction 9.8
accident 9.8
toxic 9.8
protective 9.7
nuclear 9.7
chemical 9.7
gas 9.6
adventure 9.5
free 9.4
sea 9.4
ocean 9.1
industrial 9.1
environment 9.1
horn 9
suit 9
recreation 9
war 8.9
stalker 8.9
success 8.9
athlete 8.8
black 8.4
portrait 8.4
smoke 8.4
dark 8.4
back 8.3
human 8.3
happy 8.2
armament 8.1
meadow 8.1
sand 8
couple 7.8
world 7.8
protect 7.7
hiking 7.7
jump 7.7
winter 7.7
flintlock 7.6
relaxation 7.5
joy 7.5
park 7.4
mountains 7.4
sports 7.4
teen 7.4
life 7.3
group 7.3
sun 7.2
bugle 7.2
day 7.1

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

outdoor 98.2
ground 96.4
person 90.2
beach 81
gun 21.3
sandy 11.4

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 53.8%
Sad 45.2%
Angry 45.3%
Calm 54%
Happy 45.2%
Surprised 45.2%
Confused 45.1%
Disgusted 45.1%

AWS Rekognition

Age 26-43
Gender Male, 52.2%
Angry 45.8%
Disgusted 45.3%
Confused 45.3%
Surprised 45.5%
Calm 50.3%
Sad 47.3%
Happy 45.5%

AWS Rekognition

Age 20-38
Gender Female, 50.6%
Happy 45.2%
Disgusted 45.2%
Surprised 45.2%
Sad 45.2%
Calm 53.9%
Angry 45.2%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.3%
Calm 50.1%
Angry 49.6%
Surprised 49.5%
Sad 49.7%
Disgusted 49.6%
Confused 49.5%
Happy 49.6%

AWS Rekognition

Age 20-38
Gender Female, 69%
Disgusted 0.6%
Calm 73.6%
Happy 1.2%
Angry 2.2%
Sad 16.6%
Surprised 2.7%
Confused 3%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Calm 49.6%
Surprised 49.6%
Happy 49.6%
Angry 49.7%
Sad 49.6%
Disgusted 49.8%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Angry 45.3%
Happy 46.3%
Confused 45.3%
Disgusted 45.3%
Sad 50.1%
Calm 47.5%
Surprised 45.2%

Feature analysis

Amazon

Person 99.8%
Horse 94.5%
Dog 75.1%
Bird 68.6%

Captions

Microsoft

a group of people standing on a beach 88.4%
a group of people on a beach 88.3%
a group of people that are standing in the sand 88.2%