Human Generated Data

Title

Crisis de Octubre I

Date

1962, printed 2001

People

Artist: Ernesto Fernández, Cuban b. 1939?

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the David Rockefeller Center for Latin American Studies, Harvard University, Gift of the artist, 2012.164

Human Generated Data

Title

Crisis de Octubre I

People

Artist: Ernesto Fernández, Cuban b. 1939?

Date

1962, printed 2001

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-28

Human 99.8
Person 99.8
Person 99.5
Military 99.4
Person 99.4
Military Uniform 99.1
Armored 97.5
Army 97.5
Person 96.7
People 95.9
Troop 95.9
Person 94.6
Person 94.5
Person 90.3
Person 89.8
Apparel 89
Footwear 89
Clothing 89
Shoe 89
Soldier 87.3
Crowd 86.1
Person 86
Person 84.9
Person 84
Marching 80.7
Person 78.2
Person 75.1
Person 70.2
Person 69.5
Officer 56.2
Person 46.6
Person 42.6

Clarifai
created on 2019-05-28

people 100
group 99.5
many 99.4
group together 99.4
military 99.2
soldier 98.9
adult 98.6
war 98.3
man 96.9
vehicle 96.3
uniform 95.1
gun 94.7
weapon 94.5
administration 93.8
military uniform 93.7
leader 93.7
wear 93.3
skirmish 93
outfit 92.7
rifle 92.2

Imagga
created on 2019-05-28

sky 22.3
man 22.2
ship 18.7
sea 18
vessel 17.2
travel 16.9
outdoor 16.8
landscape 16.4
wreck 16.3
water 16
fisherman 15.8
shovel 15.7
vacation 15.5
old 15.3
tourist 15.3
ocean 14.9
beach 14.6
people 14.5
sand 14.4
vehicle 14
male 13.5
person 13
summer 12.9
disaster 12.7
village 12.2
rock 12.2
outdoors 11.9
destruction 11.7
shipwreck 11.3
stone 11
sunset 10.8
tourism 10.7
tree 10.7
sun 10.5
building 10.3
tool 9.9
coast 9.9
desert 9.5
industry 9.4
leisure 9.1
protection 9.1
environment 9
recreation 9
farm 8.9
craft 8.8
symbol 8.8
military 8.7
wave 8.6
day 8.6
cloud 8.6
holiday 8.6
architecture 8.6
dirt 8.6
men 8.6
boat 8.4
shore 8.4
danger 8.2
gunnery 7.9
urban 7.9
soldier 7.8
nuclear 7.8
tropical 7.7
coastline 7.5
life 7.4
dirty 7.2
child 7.2
horizon 7.2
transportation 7.2
mountain 7.1
grass 7.1
weaponry 7

Google
created on 2019-05-28

Troop 85
Military organization 80.5
Military uniform 76.4
Infantry 75.7
Soldier 75.3
Army 75.3
Crew 74.6
Vehicle 69.7
Headgear 67.5
Military 55.4
Uniform 52.8

Microsoft
created on 2019-05-28

person 99.9
sky 99.9
outdoor 99.8
clothing 96.2
man 90.9
group 88.2
people 86
old 49.9
posing 48
team 29.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 54.1%
Surprised 45.1%
Happy 45.1%
Calm 53.2%
Confused 45.2%
Angry 45.2%
Disgusted 45%
Sad 46.3%

AWS Rekognition

Age 26-43
Gender Female, 53.2%
Disgusted 52%
Happy 45.2%
Confused 45.2%
Surprised 45.2%
Calm 46%
Angry 45.9%
Sad 45.5%

AWS Rekognition

Age 23-38
Gender Male, 50.8%
Confused 46.2%
Surprised 45.4%
Disgusted 48%
Calm 46.1%
Angry 45.9%
Happy 45.5%
Sad 47.9%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Angry 45.4%
Disgusted 45.4%
Sad 51.1%
Surprised 45.2%
Calm 46.7%
Happy 45.7%
Confused 45.5%

AWS Rekognition

Age 26-43
Gender Female, 53.6%
Disgusted 46.1%
Surprised 45.1%
Sad 47.5%
Happy 45.2%
Calm 49.5%
Confused 45.5%
Angry 46.1%

AWS Rekognition

Age 26-43
Gender Male, 51.1%
Calm 50.6%
Confused 45.2%
Happy 45.3%
Disgusted 45.4%
Surprised 45.1%
Angry 45.4%
Sad 48.1%

AWS Rekognition

Age 26-43
Gender Male, 54%
Angry 45.1%
Calm 54.4%
Disgusted 45.1%
Sad 45.3%
Surprised 45%
Confused 45.1%
Happy 45%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Sad 54.2%
Happy 45.1%
Disgusted 45.1%
Surprised 45%
Calm 45.4%
Angry 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 50.7%
Disgusted 45.1%
Happy 45.2%
Confused 45.1%
Sad 52.8%
Calm 46.6%
Angry 45.2%
Surprised 45.1%

AWS Rekognition

Age 45-66
Gender Male, 54.8%
Disgusted 45.2%
Confused 46.3%
Surprised 45.6%
Calm 47.7%
Happy 45.2%
Angry 46.5%
Sad 48.5%

AWS Rekognition

Age 35-53
Gender Male, 54.1%
Angry 45.7%
Happy 45.1%
Disgusted 45.3%
Confused 45.3%
Sad 46.4%
Surprised 45.3%
Calm 51.9%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Disgusted 50.5%
Calm 47.7%
Confused 45.4%
Surprised 45.2%
Angry 45.8%
Sad 45.3%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Male, 53.9%
Disgusted 45.4%
Calm 51.3%
Sad 46.6%
Surprised 45.2%
Angry 45.4%
Happy 45.7%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Sad 45.2%
Calm 45.7%
Surprised 45.1%
Confused 45.1%
Happy 45.2%
Angry 52.3%
Disgusted 46.4%

AWS Rekognition

Age 27-44
Gender Male, 55%
Confused 45.4%
Happy 45.6%
Calm 51.4%
Angry 45.4%
Disgusted 45.7%
Sad 46.4%
Surprised 45.2%

AWS Rekognition

Age 10-15
Gender Male, 53.2%
Calm 45%
Disgusted 45%
Surprised 45%
Confused 45%
Happy 45.1%
Sad 54.9%
Angry 45%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Sad 47.7%
Calm 49%
Confused 45.3%
Angry 46.2%
Disgusted 45.2%
Happy 45.8%
Surprised 45.9%

AWS Rekognition

Age 35-52
Gender Male, 54.8%
Calm 50.3%
Disgusted 45.6%
Surprised 45.2%
Angry 46.5%
Sad 47%
Happy 45.1%
Confused 45.3%

AWS Rekognition

Age 35-52
Gender Male, 52.2%
Happy 45.1%
Surprised 45.2%
Sad 51.8%
Calm 47.3%
Angry 45.3%
Disgusted 45%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Male, 52.2%
Confused 45.2%
Disgusted 45.1%
Angry 45.3%
Happy 45.1%
Calm 45.7%
Sad 53.6%
Surprised 45.1%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 89%

Captions

Microsoft

a group of people posing for the camera 96.6%
a group of people posing for a picture 96.5%
a group of people posing for a photo 95.7%