Human Generated Data

Title

Stokely Carmichael and the Maryland National Guard

Date

1964, printed 2010

People

Artist: Danny Lyon, American born 1942

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Anonymous Gift, 2012.36

Copyright

© Danny Lyon/Magnum Photos

Human Generated Data

Title

Stokely Carmichael and the Maryland National Guard

People

Artist: Danny Lyon, American born 1942

Date

1964, printed 2010

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 99.7
Human 99.7
Person 99.7
Person 99.5
Apparel 98.6
Clothing 98.6
Helmet 98.6
Person 97.9
Person 90.9
Military 87.2
Military Uniform 85.5
Army 84.2
Armored 84.2
Weapon 84.1
Weaponry 84.1
Gun 75.1
People 74
Soldier 68.3

Clarifai
created on 2018-02-10

people 99.9
adult 99.2
group 98.9
group together 98.3
man 96.6
two 96.4
wear 95.6
three 95.6
several 94.7
administration 94.6
outfit 94.5
one 94.5
war 94.5
four 93.6
military 93
vehicle 92.8
leader 90.7
many 90.3
five 89.9
uniform 89.3

Imagga
created on 2018-02-10

bassoon 82.4
weapon 70
missile 52.3
rocket 41.9
instrument 35.2
gun 35
rifle 34.6
man 30.2
male 22
person 20.7
conveyance 20.6
device 20.5
protection 19.1
people 19
firearm 18.5
danger 18.2
soldier 16.6
sky 15.9
smoke 15.8
military 15.4
war 15.2
uniform 14.4
portrait 13.6
adult 12.9
camouflage 12.8
army 12.7
black 12.6
safety 12
warrior 11.7
sport 11.5
industry 11.1
industrial 10.9
gas 10.6
mask 10.5
light 10.2
armament 9.9
chemical 9.6
performance 9.6
clothing 9.5
guy 9.2
studio 9.1
attractive 9.1
outdoors 9
bazooka 8.9
posing 8.9
fight 8.7
equipment 8.7
men 8.6
professional 8.4
power 8.4
dark 8.3
silhouette 8.3
security 8.3
launcher 8.1
dirty 8.1
music 8.1
worker 8
steel 8
armed 7.9
smog 7.9
radiation 7.8
disaster 7.8
toxic 7.8
protective 7.8
musician 7.8
steam 7.8
travel 7.7
protect 7.7
club 7.5
environment 7.4
metal 7.2
active 7.2
history 7.2

Google
created on 2018-02-10

Microsoft
created on 2018-02-10

person 99.4
man 98.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 98.2%
Disgusted 0.7%
Sad 7%
Calm 87.5%
Surprised 1.8%
Happy 0.4%
Confused 1.6%
Angry 0.9%

AWS Rekognition

Age 35-52
Gender Male, 97.8%
Disgusted 8.8%
Angry 6.2%
Calm 47.4%
Happy 3.1%
Sad 11.2%
Surprised 15%
Confused 8.3%

AWS Rekognition

Age 26-43
Gender Male, 98.9%
Angry 4.2%
Happy 3.9%
Calm 64.5%
Surprised 5.8%
Sad 9.3%
Disgusted 1.6%
Confused 10.7%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Happy 47.3%
Sad 46.2%
Calm 48.4%
Confused 45.5%
Disgusted 45.7%
Angry 46%
Surprised 45.8%

AWS Rekognition

Age 20-38
Gender Male, 53.3%
Disgusted 45.1%
Confused 45.4%
Angry 45.4%
Surprised 45.3%
Happy 45.3%
Sad 48.6%
Calm 49.9%

AWS Rekognition

Age 26-44
Gender Male, 59.1%
Surprised 1.3%
Happy 2.5%
Sad 86%
Calm 2.4%
Disgusted 1.7%
Angry 3.8%
Confused 2.4%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 40
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Helmet 98.6%

Captions

Microsoft

a man wearing a hat 81%
a man wearing a black hat 76.9%
a man holding a gun 67.1%