Human Generated Data

Title

Untitled (group of men with machine guns)

Date

1959, printed later

People

Artist: Lester Cole, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.517

Human Generated Data

Title

Untitled (group of men with machine guns)

People

Artist: Lester Cole, American

Date

1959, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.2
Human 99.2
Person 98.8
Person 98.1
Weaponry 95.5
Weapon 95.5
Person 91.8
Gun 89.3
Person 89.1
Military 87.6
Military Uniform 87.6
People 83.6
Army 80.6
Armored 80.6
Soldier 71.4
Rifle 68
Armory 56.5

Imagga
created on 2021-12-14

weapon 31.8
person 27.7
adult 26.7
portrait 25.9
fashion 24.9
black 22.8
sword 22.8
people 21.7
man 19.5
sexy 18.5
model 17.1
male 17
warrior 16.6
war 15.4
studio 15.2
instrument 14.9
attractive 14.7
dress 14.4
dark 14.2
costume 14.2
gun 13.5
stick 13.2
singer 13
face 12.8
style 12.6
military 12.6
posing 12.4
musician 12.4
clothing 12.3
uniform 12.2
pretty 11.9
women 11.9
soldier 11.7
performer 11
protection 10.9
hair 10.3
danger 10
music 9.9
device 9.8
fighting 9.8
army 9.7
outfit 9.7
lady 9.7
body 9.6
brunette 9.6
musical instrument 9.6
wall 9.4
culture 9.4
clothes 9.4
two 9.3
smile 9.3
power 9.2
security 9.2
traditional 9.1
hat 9.1
holding 9.1
pose 9.1
old 9
guitar 9
human 9
forces 8.9
armed 8.8
camouflage 8.8
conflict 8.8
armor 8.7
play 8.6
elegant 8.6
modern 8.4
smoke 8.4
hand 8.3
girls 8.2
stringed instrument 8.1
helmet 8
looking 8
standing 7.8
rock 7.8
ancient 7.8
fight 7.7
hairstyle 7.6
happy 7.5
one 7.5
safety 7.4
mask 7.3
make 7.3
metal 7.2
smiling 7.2
cute 7.2
rifle 7.2
game 7.1
happiness 7

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

person 99.6
text 94.4
musical instrument 91.4
clothing 89.1
man 84.2
black and white 84.2
trumpet 75.3
posing 75.1
wind instrument 68.4
saxophone 51.9
old 43.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-44
Gender Male, 99.7%
Happy 91.2%
Angry 3%
Calm 2.7%
Sad 0.8%
Confused 0.7%
Disgusted 0.5%
Surprised 0.5%
Fear 0.4%

AWS Rekognition

Age 22-34
Gender Female, 73.2%
Calm 96.1%
Angry 2%
Sad 0.8%
Surprised 0.5%
Happy 0.2%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 26-42
Gender Male, 97.4%
Calm 99%
Sad 0.3%
Fear 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Happy 0.1%
Disgusted 0.1%

AWS Rekognition

Age 22-34
Gender Male, 99%
Happy 67.5%
Calm 19.2%
Surprised 9.2%
Confused 1.5%
Angry 0.9%
Fear 0.7%
Disgusted 0.6%
Sad 0.3%

AWS Rekognition

Age 28-44
Gender Male, 98.4%
Calm 97.5%
Surprised 1.7%
Confused 0.7%
Angry 0.1%
Sad 0.1%
Fear 0%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Male, 98.9%
Happy 45.7%
Calm 40.6%
Surprised 9.7%
Confused 1.2%
Angry 1.2%
Fear 0.6%
Disgusted 0.6%
Sad 0.4%

Microsoft Cognitive Services

Age 32
Gender Male

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

Chucho Monge et al. posing for a photo 95.8%
Chucho Monge et al. posing for the camera 95.7%
Chucho Monge et al. posing for a picture 95.6%