Human Generated Data

Title

Self-portrait with Kenny in bed, Boston
Date

1972, printed 1990-1991
People

Artist: Nan Goldin, American born 1953
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.229
Copyright

© Nan Goldin

Human Generated Data

Title

Self-portrait with Kenny in bed, Boston

People

Artist: Nan Goldin, American born 1953

Date

1972, printed 1990-1991

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Face 100
Human 100
Head 100
Hair 99.2
Person 96.4
Person 96.1
Portrait 83.9
Photography 83.9
Photo 83.9
Skin 73
Female 68.4

Clarifai
created on 2018-03-23

people 99.9
portrait 99.8
monochrome 99
adult 98.6
one 97.6
man 97.1
woman 93.8
girl 91.4
facial expression 89.5
black and white 89.5
face 89
two 87.9
art 87.8
son 87.7
dark 86.2
wear 85.6
model 85.5
child 83.1
music 81.2
sepia 77.7

Imagga
created on 2018-03-23

man 40.3
male 39.9
brother 36.1
person 31.3
adult 29.1
child 25.1
portrait 23.9
black 22.5
people 22.3
handsome 21.4
face 21.3
muscular 20
body 20
attractive 19.6
model 18.7
sexy 17.7
dark 17.5
guy 16.3
athlete 15.1
expression 14.5
fitness 14.4
strong 14
juvenile 13.7
human 13.5
muscle 13.5
men 12.9
one 12.7
love 12.6
serious 12.4
lifestyle 12.3
boy 12
macho 11.9
athletic 11.5
couple 11.3
fit 11
torso 10.7
masculine 10.7
fashion 10.5
casual 10.2
training 10.2
healthy 10.1
sport 10
seat belt 9.9
looking 9.6
bodybuilder 9.3
power 9.2
sibling 9.2
alone 9.1
hand 9.1
health 9
pose 8.1
safety belt 8
indoors 7.9
chest 7.8
eyes 7.7
gym 7.6
head 7.5
happy 7.5
strength 7.5
20s 7.3
playing 7.3
exercise 7.3
smiling 7.2
dad 7.2
eye 7.1
hair 7.1
family 7.1

Google
created on 2018-03-23

black 95.9
face 95.7
photograph 95.3
person 93.5
black and white 92.7
nose 87.4
monochrome photography 86.3
head 85.9
photography 83.9
emotion 83.8
snapshot 81.8
eye 77.8
human 72.4
forehead 72.2
darkness 71.3
girl 70.3
monochrome 69.8
portrait 62.7
portrait photography 57.4

Microsoft
created on 2018-03-23

person 89.9
dark 43.4
blur 11.1

Face analysis

Amazon

Google

AWS Rekognition

Age 26-43
Gender Female, 94.2%
Sad 5.7%
Disgusted 4%
Confused 2.2%
Surprised 0.6%
Calm 81.4%
Angry 5.4%
Happy 0.8%

AWS Rekognition

Age 26-43
Gender Female, 96.6%
Disgusted 8.6%
Confused 5.8%
Calm 56.2%
Surprised 2.4%
Angry 9%
Sad 14.7%
Happy 3.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.4%

Captions

Microsoft

a man looking at the camera 71.1%
a close up of a man 71%
a person looking towards the camera 70.9%