Human Generated Data

Title

Ivy with Marilyn, Boston

Date

1973, printed 1990-1991

People

Artist: Nan Goldin, American born 1953

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.207

Copyright

© Nan Goldin

Human Generated Data

Title

Ivy with Marilyn, Boston

People

Artist: Nan Goldin, American born 1953

Date

1973, printed 1990-1991

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Hair 98.7
Person 94.9
Human 94.9
Person 92.9
Face 72.6
Cat 71.1
Mammal 71.1
Pet 71.1
Animal 71.1
Person 70.4
Fur 66.1
Apparel 56.5
Clothing 56.5
Art 56.2
Advertisement 55.1
Poster 55.1

Clarifai
created on 2018-03-23

people 99.7
portrait 99.4
one 99.2
adult 98.2
art 97.2
print 97.1
wear 96.3
retro 96.2
woman 94.1
veil 93.4
costume 89.1
man 87.9
two 87.9
illustration 87.9
fur coat 87.4
painting 85.4
music 83.6
vintage 82.2
facial expression 79.3
wig 76

Imagga
created on 2018-03-23

sexy 41
portrait 39.5
hair 38.1
attractive 36.4
model 35.8
fashion 35.5
pretty 34.3
sensual 31.9
adult 31.1
clothing 31
doll 30.1
person 29.3
lady 28.4
face 27.7
posing 24.9
feather boa 23.7
makeup 23
people 22.9
brunette 22.7
plaything 22.5
skin 22.1
garment 21.6
cute 21.5
style 21.5
body 20
wig 20
scarf 19.6
make 19.1
lips 18.5
sensuality 18.2
hairstyle 18.1
human 17.3
gorgeous 17.2
elegant 17.1
happy 16.9
elegance 16.8
erotic 16.8
look 16.6
eyes 16.4
black 15.9
costume 15.4
hairpiece 15.2
lovely 15.1
dress 14.5
looking 14.4
smile 14.3
cosmetics 14.1
pose 13.6
vogue 13.6
seductive 13.4
head 12.6
consumer goods 12.6
covering 12.5
attire 12.4
smiling 12.3
feminine 12.2
healthy 12
expression 11.9
women 11.9
love 11.8
stylish 11.8
happiness 11
spa 10.8
fashionable 10.4
youth 10.2
joy 10
studio 9.9
eye 9.8
cheerful 9.8
sketch 9.5
lifestyle 9.4
slim 9.2
girls 9.1
retro 9
one 9
lingerie 8.5
hat 8.5
modern 8.4
clean 8.4
health 8.3
care 8.2
representation 8.2
hands 7.8
luxury 7.7
desire 7.7
charming 7.6
relaxation 7.5
bikini 7.5
long 7.3
romantic 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

text 95.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.3%
Angry 5.9%
Surprised 18.5%
Happy 9.3%
Sad 17.3%
Calm 33.9%
Disgusted 4.6%
Confused 10.4%

AWS Rekognition

Age 30-47
Gender Female, 100%
Confused 12.2%
Sad 5.1%
Surprised 32.3%
Calm 24%
Happy 5.4%
Disgusted 7.6%
Angry 13.4%

AWS Rekognition

Age 14-25
Gender Female, 96.7%
Disgusted 3.8%
Surprised 23.8%
Happy 9.3%
Confused 18.8%
Calm 32.3%
Sad 4%
Angry 8.1%

AWS Rekognition

Age 23-38
Gender Female, 98.5%
Sad 35.3%
Disgusted 5%
Angry 21.2%
Happy 3.7%
Surprised 13.5%
Calm 13.7%
Confused 7.6%

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 94.9%
Cat 71.1%

Captions

Microsoft

a woman posing for a photo 87.3%
a black and white photo of a woman 81.8%
a woman posing for a picture 81.7%