Human Generated Data

Title

Elderly Man with a White Beard

Date

1918

People

Artist: Harold Moody Vanderbilt, American 1879 - 1942

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. Harold M. Vanderbilt, 1944.50.53

Human Generated Data

Title

Elderly Man with a White Beard

People

Artist: Harold Moody Vanderbilt, American 1879 - 1942

Date

1918

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Art 98.3
Painting 97
Human 91.4
Drawing 90.8
Person 90.6
Sketch 67.2
Photography 60.4
Photo 60.4
Portrait 56
Face 56

Clarifai
created on 2019-05-31

people 99.8
print 99.7
portrait 99.7
one 99.6
illustration 99.4
adult 99.2
art 98.9
old 98.9
man 98.5
engraving 98
elderly 97
mustache 96.8
wear 95.4
painting 95.3
antique 92.8
facial hair 90.5
vintage 90.1
poet 89.5
lithograph 89.3
leader 87.4

Imagga
created on 2019-05-31

sketch 40
money 33.2
currency 30.5
book jacket 29.7
drawing 28.8
cash 28.4
dollar 27.9
representation 27.6
portrait 26.6
old 25.8
bill 25.7
man 25.6
senior 24.4
jacket 24.1
one 21.7
banking 21.2
finance 21.1
close 20.6
elderly 20.1
people 20.1
face 19.9
wealth 19.8
business 18.8
bank 18.8
mature 18.6
paper 18.5
retired 18.4
person 17.8
financial 17.8
male 17.7
wrapping 17.6
adult 17.5
dollars 17.4
hundred 16.5
grandfather 16.4
retirement 16.3
ruler 16.2
savings 14.9
us 14.5
grandmother 13.7
banknote 13.6
finances 13.5
age 13.3
franklin 12.8
pay 12.5
serious 12.4
covering 12.3
aged 11.8
gray 11.7
loan 11.5
exchange 11.5
happy 11.3
expression 11.1
banknotes 10.8
hair 10.3
rich 10.2
closeup 10.1
older 9.7
grandma 9.7
looking 9.6
economy 9.3
head 9.2
human 9
pension 8.9
wrinkled 8.8
depression 8.8
bills 8.7
museum 8.7
economic 8.7
notes 8.6
aging 8.6
eyes 8.6
commerce 8.4
glasses 8.3
pensioner 8.3
investment 8.3
alone 8.2
beard 8.1
success 8.1
concepts 8
wrinkle 7.9
life 7.9
black 7.8
art 7.7
sad 7.7
profit 7.7
smiling 7.2
religion 7.2
eye 7.2
market 7.1
look 7

Google
created on 2019-05-31

Microsoft
created on 2019-05-31

drawing 99.9
sketch 99.8
text 99.5
book 98.9
painting 97.7
child art 92.2
human face 89
art 74.3
person 69
cartoon 63
portrait 57.5
old 40.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 60-90
Gender Male, 99.5%
Surprised 1.2%
Happy 3.6%
Disgusted 0.6%
Calm 74.7%
Sad 11%
Confused 4.9%
Angry 4%

Microsoft Cognitive Services

Age 71
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97%
Person 90.6%

Captions

Microsoft

a man holding a book 57.8%
a man sitting on top of a book 44.4%
a man sitting on a book 42.7%