Human Generated Data

Title

Self-Portrait Smoking

Date

1958, printed 2013

People

Artist: Peter Hujar, American 1934 - 1987

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2016.160

Copyright

© The Peter Hujar Archive LLC / Artists Rights Society (ARS), New York

Human Generated Data

Title

Self-Portrait Smoking

People

Artist: Peter Hujar, American 1934 - 1987

Date

1958, printed 2013

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Human 98
Face 93.7
Person 93.3
Jaw 92.3
Smoke 89.9
Skin 79.5
Smoking 76.4
Man 75.7
Head 73.9
Finger 70.7
Dessert 65
Creme 65
Cream 65
Food 65
Photography 60.9
Portrait 60.9
Photo 60.9
Icing 58.7
Cake 58.7
Plant 55.5

Clarifai
created on 2018-02-16

people 99.8
portrait 99.6
one 99.4
man 99.1
adult 98.5
pensive 95.1
facial expression 94.9
wear 93.1
music 85.5
profile 78.4
face 77
serious 76.3
actor 73.9
facial hair 73.1
look 71.8
indoors 71.4
monochrome 65.7
side view 65.7
eye 64
boredom 63.8

Imagga
created on 2018-02-16

beard 90.5
man 53.8
male 45.6
face 42
portrait 40.8
handsome 40.2
person 37.4
adult 32.4
guy 26.4
attractive 25.9
people 24.6
adolescent 24.4
model 22.6
mustache 22.6
close 22.3
expression 22.2
hair 21.4
serious 21
looking 20.8
skin 20.5
juvenile 20.2
head 19.3
black 18.7
boy 18.3
human 18
eyes 17.2
men 17.2
look 16.7
one 16.4
casual 16.1
confident 15.5
sexy 15.3
thinking 13.3
mature 13
closeup 12.8
youth 12.8
happy 12.5
dark 11.7
masculine 11.7
stress 11.5
body 11.2
lifestyle 10.9
smile 10.7
fashion 10.6
smiling 10.1
cool 9.8
health 9.7
shirt 9.4
emotion 9.2
teenager 9.1
healthy 8.8
depression 8.8
facial 8.6
professional 8.4
style 8.2
cheerful 8.1
wet 8.1
unshaven 7.9
cute 7.9
thoughtful 7.8
sad 7.7
pretty 7.7
old 7.7
pain 7.7
hand 7.6
senior 7.5
lips 7.4
student 7.4
alone 7.3
eye 7.2
macho 7.1
love 7.1

Google
created on 2018-02-16

person 95.4
man 95
chin 92.1
black and white 91
eyebrow 90.4
nose 88.5
portrait 87.6
forehead 86.3
hairstyle 82.7
monochrome photography 81.6
cheek 81.3
neck 75.4
jaw 72.2
facial hair 71.3
gentleman 66.9
monochrome 65.4
self portrait 60
lip 57.3
portrait photography 52.9
ear 52.4

Microsoft
created on 2018-02-16

person 99.7
wall 99.3
indoor 98.9
posing 49.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 99%
Confused 6.9%
Sad 27.8%
Surprised 2.9%
Angry 3.4%
Calm 53.2%
Happy 3.6%
Disgusted 2.2%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 93.3%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 61.1%
a person sitting in front of a mirror posing for the camera 52.6%
a person standing in front of a mirror posing for the camera 52.5%