Human Generated Data

Title

Crisis de Octubre II

Date

1962, printed 2001

People

Artist: Ernesto Fernández, Cuban b. 1939?

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the David Rockefeller Center for Latin American Studies, Harvard University, Gift of the artist, 2012.172

Human Generated Data

Title

Crisis de Octubre II

People

Artist: Ernesto Fernández, Cuban b. 1939?

Date

1962, printed 2001

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-28

Human 99.7
Person 99.7
Person 99.6
Person 99.1
Person 95.4
Clothing 91.6
Apparel 91.6
People 80.2
Face 79.8
Helmet 70.1
Helmet 63.3
Photo 62
Photography 62
Sunglasses 60.4
Accessory 60.4
Accessories 60.4
Coat 60.1
Suit 60.1
Overcoat 60.1
Outdoors 58.1
Poster 57.3
Advertisement 57.3
Collage 57.3

Clarifai
created on 2019-05-28

people 100
adult 99.7
group 99.3
group together 98.4
man 97.9
two 97.5
war 96.8
woman 96.4
wear 95.1
vehicle 94.6
military 93.4
child 93.3
administration 92.5
soldier 91.9
one 91.2
interaction 90.8
three 90.4
many 90.2
skirmish 88.5
several 88.5

Imagga
created on 2019-05-28

man 28.9
brass 28.4
wind instrument 25.1
person 24.4
male 24.2
soldier 21.5
military 21.2
weapon 20.6
people 20.1
uniform 20
adult 18.8
sport 17.9
musical instrument 17.9
war 17.4
protection 17.3
gun 16.9
army 15.6
mask 15
helmet 14.8
trombone 14.3
statue 14
clothing 13.8
portrait 13.6
photographer 13.2
outdoor 13
camouflage 12.9
warrior 12.7
holding 12.4
safety 12
danger 11.8
black 11.6
rifle 11
device 11
outdoors 10.7
sax 10.6
attractive 10.5
equipment 10
protective 9.7
men 9.4
dark 9.2
cornet 9.1
fashion 9
one 9
looking 8.8
music 8.7
adventure 8.5
power 8.4
sword 8.3
park 8.3
recreation 8.1
posing 8
lifestyle 7.9
face 7.8
two 7.6
active 7.5
human 7.5
fun 7.5
vintage 7.4
horn 7.3
dirty 7.2
activity 7.2
to 7.1

Google
created on 2019-05-28

Microsoft
created on 2019-05-28

clothing 98.4
outdoor 97.9
person 96.9
black and white 90.2
man 90
human face 70.6
clothes 15.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 88.2%
Confused 1.7%
Happy 0.3%
Calm 6.3%
Angry 26.8%
Disgusted 1.5%
Sad 62.8%
Surprised 0.5%

AWS Rekognition

Age 26-43
Gender Male, 96.2%
Surprised 0.3%
Sad 2%
Happy 91.1%
Confused 0.2%
Angry 0.4%
Disgusted 0.3%
Calm 5.7%

AWS Rekognition

Age 15-25
Gender Male, 58.2%
Angry 4.6%
Surprised 13.9%
Confused 4.6%
Calm 52.7%
Happy 4%
Disgusted 5.6%
Sad 14.6%

AWS Rekognition

Age 20-38
Gender Male, 74.8%
Sad 83.6%
Angry 1.3%
Disgusted 0.4%
Calm 12.9%
Confused 0.9%
Happy 0.4%
Surprised 0.5%

Microsoft Cognitive Services

Age 27
Gender Male

Microsoft Cognitive Services

Age 17
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Helmet 70.1%
Sunglasses 60.4%

Captions

Microsoft

a group of people sitting posing for the camera 91.3%
a group of people posing for a photo 88.8%
a group of people sitting on a bench 80%