Human Generated Data

Title

Untitled (Dewayne Pomeroy)

Date

1983

People

Artist: Mary Ellen Mark, American 1940-2015

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.380

Copyright

© Mary Ellen Mark

Human Generated Data

Title

Untitled (Dewayne Pomeroy)

People

Artist: Mary Ellen Mark, American 1940-2015

Date

1983

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Clothing 100
Apparel 100
Hood 99.2
Sweater 98.5
Sweatshirt 98.5
Automobile 93.1
Vehicle 93.1
Car 93.1
Transportation 93.1
Human 92.8
Person 92.8
Hoodie 89.9
Photography 61.2
Photo 61.2
Face 59.8
Portrait 59.8

Clarifai
created on 2018-03-23

street 99.8
people 99.7
portrait 99.2
monochrome 97.9
woman 97.2
adult 96.8
one 96.1
urban 95.4
city 94
girl 91
man 90.4
black and white 89.3
child 87
wear 85.8
lid 84.5
veil 80.4
winter 77.1
boy 76.4
face 74.8
model 74.7

Imagga
created on 2018-03-23

bonnet 100
headdress 100
hat 100
clothing 81.4
portrait 38.3
covering 36.3
consumer goods 35.2
face 34.2
attractive 31.5
person 30.6
cute 30.2
eyes 28.5
pretty 27.3
fashion 27.2
smile 25
adult 24.6
people 23.5
happy 23.2
model 22.6
sombrero 22.6
youth 22.2
sexy 20.9
hair 20.6
expression 20.5
smiling 18.8
child 18.1
casual 17.8
skin 16.1
lifestyle 15.2
looking 13.6
one 13.5
black 13.2
lady 13
studio 12.9
teenager 12.8
make 12.7
head 12.6
childhood 12.6
wearing 12.4
ethnic 12.4
girls 11.9
posing 11.6
close 11.4
human 11.3
lips 11.1
eye 10.7
kid 10.7
look 10.5
brunette 10.5
clothes 10.3
man 10.1
dark 10
gorgeous 10
lovely 9.8
little 9.7
style 9.7
nice 9.2
20s 9.2
pose 9.1
blond 9
fun 9
cheerful 9
women 8.7
cap 8.6
male 8.5
winter 8.5
modern 8.4
joy 8.4
teen 8.3
makeup 8.3
closeup 8.1
hood 7.9
happiness 7.8
boy 7.8
scarf 7.8
cold 7.8
outside 7.7
twenties 7.7
long 7.4
sensuality 7.3

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 99.3
wearing 76.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 94.8%
Sad 9.3%
Disgusted 2.3%
Angry 4.6%
Happy 0.4%
Surprised 1.8%
Calm 79.3%
Confused 2.2%

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Car 93.1%
Person 92.8%

Captions

Microsoft

a person wearing a hat 92.3%
a person wearing a black hat 90.7%
a person wearing a hat and smiling at the camera 88.6%