Human Generated Data

Title

Untitled (Gordon Gahan receiving patch from army officer, Vietnam)
Date

1967-68
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.165

Human Generated Data

Title

Untitled (Gordon Gahan receiving patch from army officer, Vietnam)

People

Artist: Unidentified Artist,

Date

1967-68

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Robinson, 2007.184.1.165

Machine Generated Data

Tags

Amazon
created on 2019-03-22

Person 99.6
Human 99.6
Person 98.9
Face 79.5
Man 77.9
Finger 72.3
Military 65.5
Arm 65.3
Military Uniform 64.3
Clothing 59.6
Apparel 59.6
Officer 58.7

Clarifai
created on 2019-03-22

people 99.7
man 99.2
adult 98.5
portrait 98.2
wear 95.8
one 95
two 94.7
military 94.3
war 93.5
uniform 90.9
administration 90.2
soldier 89.4
actor 87.7
facial expression 86.8
outfit 83.3
monochrome 82.1
group 81.4
boy 80.1
indoors 78.6
three 78.4

Imagga
created on 2019-03-22

family 39.2
man 39
child 38.6
male 37.5
people 32.4
father 30.8
happy 29.5
parent 26.2
love 25.3
home 24.7
mother 24.5
dad 24.2
person 24.2
portrait 23.3
smiling 22.4
sitting 21.5
sibling 21.3
boy 20.9
happiness 20.4
adult 20.3
kid 19.5
indoors 19.3
lifestyle 18.8
smile 18.5
together 17.5
military uniform 16.6
couple 16.6
children 16.4
brother 15.8
clothing 15.8
son 15.5
casual 15.3
childhood 14.3
face 14.2
attractive 14
cheerful 13.8
men 13.7
group 12.9
uniform 12.8
kids 12.2
indoor 11.9
two 11.9
old 11.8
daughter 11.8
grandfather 11.7
baby 11.6
interior 11.5
cute 11.5
senior 11.2
relationship 11.2
looking 11.2
expression 11.1
30s 10.6
day 10.2
horizontal 10.1
playing 10
house 10
little 9.7
couch 9.7
juvenile 9.6
married 9.6
husband 9.5
room 9.5
mature 9.3
joy 9.2
holding 9.1
human 9
handsome 8.9
businessman 8.8
work 8.6
sofa 8.6
loving 8.6
youth 8.5
business 8.5
togetherness 8.5
black 8.5
meeting 8.5
kin 8.3
team 8.1
office 8
color 7.8
diversity 7.7
four 7.7
talking 7.6
wife 7.6
females 7.6
friends 7.5
fun 7.5
world 7.5
shirt 7.5
outdoors 7.5
three 7.4
20s 7.3
lady 7.3
aged 7.2
domestic 7.2
life 7.1

Google
created on 2019-03-22

Photograph 96.6
Snapshot 83.3
Black-and-white 74.4
Photography 67.8
Stock photography 67.6
Monochrome 60.1

Microsoft
created on 2019-03-22

person 99.9
wall 96.6
man 95.9
indoor 92.6
military uniform 85.1
jazz 8.9
black and white 7.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 99.9%
Happy 97.4%
Sad 0.2%
Disgusted 0.5%
Confused 0.5%
Surprised 0.9%
Angry 0.4%
Calm 0.1%

AWS Rekognition

Age 35-52
Gender Male, 97.3%
Confused 6.3%
Happy 10.8%
Angry 5.1%
Disgusted 1.5%
Calm 66.4%
Sad 5.9%
Surprised 3.9%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Categories

Imagga

people portraits 92.7%
pets animals 4.4%
events parties 1.3%

Captions

Microsoft
created on 2019-03-22

a man wearing a uniform 86.7%
a man wearing a uniform and holding a gun 59.3%
a man holding a gun 59.2%