Human Generated Data

Title

Untitled (New York City)

Date

1932-1935

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2840

Copyright

© President and Fellows of Harvard College

Human Generated Data

Title

Untitled (New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

1932-1935

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.2840

Copyright

© President and Fellows of Harvard College

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99.2
Human 99.2
Person 98.8
Apparel 98.4
Clothing 98.4
Person 98.2
Sleeve 80.6
Overcoat 63.2
Coat 63.2
Face 60.1
Column 59.9
Building 59.9
Pillar 59.9
Architecture 59.9
Hair 59.6
Crypt 59.3
Long Sleeve 59
Sitting 55.9
Evening Dress 55.6
Robe 55.6
Fashion 55.6
Gown 55.6

Clarifai
created on 2018-03-23

people 100
adult 99
one 98.3
woman 97.5
man 96.2
two 95.8
group together 94.9
wear 94.7
group 93.9
administration 92.2
portrait 89.4
elderly 87.6
music 86.6
military 84.8
leader 83.9
three 83.1
four 82.5
recreation 81.8
instrument 81
outfit 79.5

Imagga
created on 2018-03-23

musical instrument 42.6
black 30.5
person 30.5
accordion 26.5
people 26.2
adult 24.8
wind instrument 24.1
model 23.3
keyboard instrument 23.2
sexy 22.5
man 20.9
portrait 20.1
guitar 19.7
male 18.5
body 18.4
attractive 18.2
style 17.1
fashion 16.6
posing 16
dark 15.9
one 15.7
sensuality 15.4
music 15.3
hair 14.3
human 14.3
passion 14.1
performer 13.9
stringed instrument 13.9
lady 13.8
world 13.2
sax 13.1
dress 12.7
musician 12.6
pretty 12.6
rock 12.2
silhouette 11.6
lifestyle 11.6
studio 11.4
elegant 11.1
sensual 10.9
stage 10.7
hand 10.6
dancer 10.6
face 9.9
dance 9.8
musical 9.6
instrument 9.1
pose 9.1
art 8.9
night 8.9
guitarist 8.9
love 8.7
performance 8.6
sitting 8.6
erotic 8.5
elegance 8.4
singer 8.3
makeup 8.2
make 8.2
gorgeous 8.2
fitness 8.1
women 7.9
couple 7.8
play 7.8
party 7.7
desire 7.7
grunge 7.7
youth 7.7
player 7.6
skin 7.6
relax 7.6
stylish 7.2
suit 7.2
device 7.1

Google
created on 2018-03-23

Microsoft
created on 2018-03-23

person 98.7
outdoor 94.5
man 93.7
posing 63.7
old 47.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Female, 89.4%
Sad 75%
Angry 8.6%
Happy 2.5%
Calm 4.9%
Surprised 2.9%
Disgusted 3.7%
Confused 2.4%

AWS Rekognition

Age 38-59
Gender Female, 99.5%
Disgusted 26.3%
Confused 5.2%
Calm 17.8%
Surprised 4.2%
Angry 14.4%
Sad 26.6%
Happy 5.4%

Microsoft Cognitive Services

Age 65
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%