Human Generated Data

Title

Portrait of James Arnold
Date

1837
People

Artist: Narcisse Othon, French active 1839–1847
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Misses Aimée and Rosamond Lamb, 1965.534

Human Generated Data

Title

Portrait of James Arnold

People

Artist: Narcisse Othon, French active 1839–1847

Date

1837

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 98.4
Drawing 98.3
Human 98.3
Person 96.6
Sketch 93.1
Painting 82.8
Photo 64.3
Face 64.3
Photography 64.3
Portrait 64.3
Sitting 57.2

Clarifai
created on 2018-02-10

people 100
portrait 99.9
one 99.6
engraving 99.4
adult 99.4
leader 99.1
scientist 97.9
man 97.4
administration 96.3
print 96.2
art 96
wear 95.6
writer 94.5
politician 92.5
poet 91
chair 88.5
facial hair 82.7
sit 82.2
antique 81.8
mustache 81.3

Imagga
created on 2018-02-10

person 37.4
portrait 36.9
man 32.3
people 28.4
face 27.7
male 26.9
adult 26
senior 24.4
old 19.5
one 17.9
smile 17.8
happy 17.5
human 17.2
expression 17.1
business 16.4
model 16.3
elderly 16.3
casual 16.1
handsome 16
hair 15.8
look 15.8
lady 15.4
money 15.3
currency 15.3
suit 15
mature 14.9
glasses 14.8
head 14.3
dark 14.2
dollar 13.9
lifestyle 13.7
looking 13.6
black 13.3
attractive 13.3
close 13.1
clothing 13.1
older 12.6
bill 12.4
studio 12.2
fashion 12.1
beard 11.8
retired 11.6
success 11.3
eyes 11.2
cash 11
confident 10.9
armor 10.9
executive 10.8
grandmother 10.8
bank 10.7
businessman 10.6
age 10.5
finance 10.1
banking 10.1
closeup 10.1
grandfather 10.1
pretty 9.8
banknote 9.7
life 9.6
professional 9.6
shirt 9.6
elegant 9.4
friendly 9.1
alone 9.1
hand 9.1
gray 9
posing 8.9
smiling 8.7
retirement 8.6
happiness 8.6
jacket 8.6
single 8.2
style 8.2
stylish 8.1
garment 8.1
office 8
standing 7.8
corporate 7.7
modern 7.7
youth 7.7
thinking 7.6
grandma 7.4
guy 7.3
sexy 7.2
work 7.2
financial 7.1

Google
created on 2018-02-10

photograph 95.4
portrait 94.8
person 93.5
man 92.7
gentleman 86.4
vintage clothing 83.1
standing 80.2
male 80.2
self portrait 69.7
art 62
illustration 57.4
visual arts 53
artwork 51.8

Microsoft
created on 2018-02-10

wall 99.5
person 99.1
man 92.4
old 65
white 61.6
posing 42.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 93.8%
Surprised 2.7%
Happy 0.8%
Disgusted 0.3%
Angry 3.1%
Confused 6.5%
Calm 82.2%
Sad 4.4%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.6%
Painting 82.8%

Captions

Microsoft

a black and white photo of Jöns Jacob Berzelius 86%
Jöns Jacob Berzelius posing for the camera 85.9%
Jöns Jacob Berzelius wearing a suit and tie 85.8%

Text analysis

Amazon

pthon
pthon 183y.
183y.