Human Generated Data

Title

Untitled (Gordon Gahan receiving medal from army officer, Vietnam)
Date

1967-68
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.166

Human Generated Data

Title

Untitled (Gordon Gahan receiving medal from army officer, Vietnam)

People

Artist: Unidentified Artist,

Date

1967-68

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Human 99.2
Person 99.2
Person 98.6
Accessory 87
Glasses 87
Accessories 87
Military 82.2
Military Uniform 82.2
Finger 75.1
Officer 72
Clothing 67.5
Apparel 67.5
Face 66.1
Army 60.6
Armored 60.6
Door 58.3
Soldier 58.2
Man 56.8

Clarifai
created on 2019-03-22

people 99.2
man 99.1
adult 97.4
portrait 96
two 94.5
actor 84.7
wear 82.7
one 82.2
monochrome 79.6
uniform 79.1
group 78.8
three 76
desktop 76
war 72.4
boy 71.2
military 70.1
person 68.9
retro 67.7
leader 66.8
couple 65.6

Imagga
created on 2019-03-22

people 31.8
person 29.9
portrait 29.8
adult 27.9
male 25.4
man 24.9
face 22.7
attractive 20.3
fashion 19.6
stethoscope 19.4
hair 19
brunette 16.6
black 16.3
happy 16.3
lifestyle 15.9
model 15.6
human 15
mature 14.9
professional 14.5
looking 14.4
clothing 14
old 13.9
business 13.4
office 12.9
sexy 12.9
expression 12.8
youth 12.8
women 12.7
dress 12.7
style 12.6
lady 12.2
mother 12.1
home 12
medical instrument 11.8
couple 11.3
one 11.2
pretty 11.2
child 11.1
casual 11
head 10.9
hand 10.8
smile 10.7
family 10.7
job 10.6
businessman 10.6
senior 10.3
love 10.3
instrument 10.2
happiness 10.2
smiling 10.1
vintage 9.9
cheerful 9.8
health 9.7
tie 9.5
device 9.5
mug shot 9.5
cute 9.3
occupation 9.2
aged 9.1
medical 8.8
body 8.8
sepia 8.7
boy 8.7
antique 8.7
nurse 8.7
eyes 8.6
uniform 8.6
doctor 8.5
suit 8.1
success 8
eye 8
look 7.9
work 7.8
performer 7.8
corporate 7.7
men 7.7
elderly 7.7
two 7.6
healthy 7.6
dark 7.5
military uniform 7.5
daughter 7.4
photograph 7.3
alone 7.3
sensuality 7.3
decoration 7.2
romantic 7.1
kin 7.1
representation 7.1
medicine 7

Google
created on 2019-03-22

Photograph 96.3
Stock photography 73.1
Photography 67.8
Black-and-white 56.4
Wing chun 50.1

Microsoft
created on 2019-03-22

person 99.8
man 99.5
wall 97.7
indoor 94.4
brass 89.6
black and white 18.8
jazz 15.8
portrait 13.5
monochrome 10.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Male, 98.1%
Surprised 0.6%
Sad 7.6%
Confused 1.2%
Disgusted 0.6%
Calm 88.1%
Happy 0.8%
Angry 1.1%

AWS Rekognition

Age 35-52
Gender Male, 63.3%
Confused 4.3%
Angry 2%
Sad 1.2%
Calm 85.4%
Disgusted 2.6%
Surprised 2.3%
Happy 2.3%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Glasses 87%

Captions

Microsoft

an old photo of a man 85.8%
a man looking at the camera 83.4%
a man posing for a photo 83.3%