Human Generated Data

Title

Untitled (Denpasar Museum, Bali)

Date

February 2, 1960-February 17, 1960

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5149

Human Generated Data

Title

Untitled (Denpasar Museum, Bali)

People

Artist: Ben Shahn, American 1898 - 1969

Date

February 2, 1960-February 17, 1960

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.5149

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Head 100
Face 100
Human 100
Smile 98.2
Person 95.2
Person 92.4
Female 91.1
Advertisement 90.5
Poster 90.5
Collage 90.5
Laughing 89.4
Person 84.9
Photography 83.5
Photo 83.5
Portrait 83.5
Person 82.9
Art 81
Drawing 81
Hair 76.6
Woman 74.6
Person 74.6
Text 73.4
Person 73.1
Person 70.4
Accessory 69.9
Accessories 69.9
Glasses 69.9
Girl 67.5
Selfie 64.7
Sketch 62.8
People 61.8
Man 60.6
Paper 60.3
Photo Booth 58.7
Teeth 58.5
Mouth 58.5
Lip 58.5
Performer 58
Jaw 57.7
Black Hair 55.5

Clarifai
created on 2018-03-23

people 100
portrait 99.4
adult 99.2
man 98.7
group 98.7
administration 96.2
leader 94.6
four 93.9
facial expression 93.1
one 92.5
five 92.1
three 91.5
music 90.6
two 90
monochrome 88.7
group together 88.7
facial hair 87.9
print 86.8
wear 83.2
writer 83.1

Imagga
created on 2018-03-23

comic book 56.9
currency 35.9
money 35.7
cash 30.2
dollar 26
mug shot 25.3
bill 23.8
finance 23.7
covering 23.5
print media 22.8
bank 22.4
book jacket 22.1
banking 22.1
mask 21.4
photograph 20.6
close 20.5
dollars 20.3
portrait 20.1
business 20
wealth 19.8
paper 18.8
representation 18.2
jacket 18.1
face 17
financial 16.9
one 16.4
disguise 16.2
hundred 15.5
man 15.5
savings 14.9
bills 14.6
exchange 14.3
economy 13.9
banknote 13.6
us 13.5
vintage 13.2
wrapping 13.1
culture 12.8
painter 12.6
finances 12.5
male 12.1
creation 12
art 12
banknotes 11.7
notes 11.5
franklin 10.8
black 10.8
crazy 10.7
states 10.6
united 10.5
negative 10.3
person 10.2
investment 10.1
religion 9.9
twenty 9.8
market 9.8
payment 9.6
pay 9.6
loan 9.6
people 9.5
eyes 9.5
closeup 9.4
church 9.2
note 9.2
masterpiece 8.9
postmark 8.9
postage 8.8
postal 8.8
wages 8.8
stamp 8.7
attire 8.7
mail 8.6
rich 8.4
letter 8.3
human 8.2
film 8.1
icon 7.9
president 7.9
antique 7.8
ancient 7.8
museum 7.8
adult 7.8
god 7.7
painted 7.6
capital 7.6
emotion 7.4
success 7.2

Google
created on 2018-03-23

face 96.4
facial expression 93.5
nose 86.9
head 86.1
black and white 82.7
drawing 81.4
facial hair 74.2
human 68.5
portrait 67.7
artwork 65.4
jaw 62.7
moustache 59.1
sketch 58.7
art 56
monochrome 54.7
visual arts 54.3
human behavior 52.8
monochrome photography 52.7
font 51.9

Microsoft
created on 2018-03-23

man 91.5
black 77
posing 75.6
group 64.5
white 60.2
hair 49
staring 17

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 76.9%
Happy 27%
Disgusted 3%
Surprised 30.5%
Calm 16.9%
Angry 7.6%
Sad 5.4%
Confused 9.6%

AWS Rekognition

Age 26-43
Gender Female, 63.2%
Sad 63.3%
Calm 12.6%
Confused 4%
Angry 5.7%
Happy 1%
Disgusted 1.3%
Surprised 12.1%

AWS Rekognition

Age 35-52
Gender Male, 62.5%
Calm 56.1%
Disgusted 1.7%
Angry 5%
Happy 9.2%
Confused 6.3%
Surprised 6.9%
Sad 14.8%

AWS Rekognition

Age 26-43
Gender Female, 91.7%
Sad 5.3%
Angry 12.2%
Happy 20.7%
Calm 9.2%
Surprised 43.2%
Disgusted 3.5%
Confused 5.9%

Feature analysis

Amazon

Person 95.2%