Human Generated Data

Title

Pat and Denine in the Profile Room, Boston
Date

1973, printed 1990-1991
People

Artist: Nan Goldin, American born 1953
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.217
Copyright

© Nan Goldin

Human Generated Data

Title

Pat and Denine in the Profile Room, Boston

People

Artist: Nan Goldin, American born 1953

Date

1973, printed 1990-1991

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Hair 99.6
Human 98.6
Person 98.6
Person 91
Face 79.4

Clarifai
created on 2018-03-23

people 99.7
portrait 98.7
two 98.5
adult 98.4
man 98
woman 95.2
music 92.9
actress 91.8
musician 89
one 88.3
three 86.8
singer 86.6
facial expression 84.7
wear 84.3
monochrome 82.6
couple 81.4
dark 80.5
love 79.3
movie 78.8
group 78.7

Imagga
created on 2018-03-23

wig 70
hairpiece 53.8
attire 40.2
attractive 33.6
couple 31.4
people 30.7
male 28.8
adult 27.9
clothing 27.8
man 27.6
love 26.8
portrait 25.9
hair 25.4
person 25.3
happy 25.1
pretty 23.8
smile 23.5
together 22.8
face 22.7
sexy 21.7
black 21.5
lady 21.1
smiling 18.1
expression 17.9
happiness 17.3
youth 17
women 16.6
fashion 16.6
two 16.1
romance 16.1
looking 16
relationship 15.9
eyes 15.5
sensual 15.5
covering 15.2
romantic 15.1
cute 15.1
friends 15
consumer goods 14.2
family 14.2
mother 14
lifestyle 13.7
girls 13.7
joy 13.4
model 13.2
passion 13.2
fun 12.7
casual 12.7
world 12.7
dark 12.5
girlfriend 12.5
brunette 12.2
boy 12.2
teenager 11.9
boyfriend 11.6
brother 11.2
body 11.2
lips 11.1
emotion 11.1
teen 11
kiss 10.7
handsome 10.7
hug 10.7
studio 10.6
married 10.6
child 10.5
loving 10.5
sitting 10.3
lovers 9.7
look 9.6
enjoying 9.5
buddy 9.4
holding 9.1
husband 9.1
lovely 8.9
affection 8.7
tender 8.7
skin 8.6
marriage 8.6
wife 8.5
parent 8.5
human 8.3
makeup 8.2
cheerful 8.1
posing 8
teens 7.8
men 7.7
outside 7.7
guy 7.7
laugh 7.7
blond 7.5
enjoy 7.5
one 7.5
style 7.4
close 7.4
joyful 7.4
long 7.3
grandma 7.3
make 7.3

Google
created on 2018-03-23

hair 97
photograph 96
black 96
person 94.9
black and white 91.9
lady 85.5
photography 84.7
emotion 83.8
girl 83.2
monochrome photography 82.9
snapshot 81.8
human 74.8
portrait 74.3
smile 72.9
monochrome 68.7
fun 66.4
organ 65.7
retro style 63.4
portrait photography 58.4
vintage clothing 54.5

Microsoft
created on 2018-03-23

person 96.9
posing 60.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 52%
Sad 26.2%
Calm 63.7%
Confused 2.8%
Disgusted 1.5%
Surprised 2.2%
Happy 0.3%
Angry 3.4%

AWS Rekognition

Age 23-38
Gender Female, 99.8%
Calm 31%
Sad 8%
Confused 13.4%
Disgusted 16.1%
Happy 17.8%
Surprised 8.9%
Angry 4.8%

Microsoft Cognitive Services

Age 40
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

Claudette Colbert and woman posing for a photo 68.4%
Claudette Colbert et al. posing for a photo 68.3%
two people sitting posing for the camera 68.2%