Human Generated Data

Title

George Washington (1732-1799)

Date

c. 1852

People

Artist: Rembrandt Peale, American 1778 - 1860

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Eugenia Frothingham Lombard, 1977.37

Human Generated Data

Title

George Washington (1732-1799)

People

Artist: Rembrandt Peale, American 1778 - 1860

Date

c. 1852

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 99
Human 99
Painting 97.4
Art 97.4
Face 57.5
Portrait 57.5
Photo 57.5
Photography 57.5

Clarifai
created on 2018-03-16

people 99.9
art 99.7
one 99.3
portrait 99.1
adult 98.9
painting 98.2
illustration 95.6
religion 93.9
woman 93.5
leader 92
aura 90.7
print 86.2
wear 85.2
man 84.2
side view 82.5
veil 82.1
god 81.7
old 81.5
prayer 80
vintage 78.6

Imagga
created on 2018-03-16

gong 100
percussion instrument 100
musical instrument 79.2
hat 24.9
man 18.8
portrait 18.1
sombrero 16.7
person 16.6
currency 15.2
male 14.9
adult 14.2
dollar 13.9
money 13.6
people 13.4
old 13.2
body 12.8
fitness 12.6
bill 12.3
face 12.1
black 12
attractive 11.9
art 11.4
happy 11.3
one 11.2
fit 11
finance 11
cash 11
headdress 10.9
close 10.8
banking 10.1
active 9.9
financial 9.8
health 9.7
banknote 9.7
lifestyle 9.4
training 9.2
business 9.1
light 8.7
cute 8.6
smile 8.5
casual 8.5
device 8.4
pretty 8.4
power 8.4
ventilator 8.3
outdoors 8.2
retro 8.2
lady 8.1
sexy 8
to 8
clothing 7.7
healthy 7.5
relaxation 7.5
dark 7.5
fun 7.5
vintage 7.4
symbol 7.4
paper 7.3
exercise 7.2
wealth 7.2
religion 7.2
bank 7.2
working 7.1

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

person 97.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 97.7%
Calm 95%
Confused 0.6%
Surprised 0.4%
Disgusted 0.5%
Happy 0.2%
Angry 0.4%
Sad 2.8%

Microsoft Cognitive Services

Age 38
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 97.4%

Captions

Microsoft

a statue of George Washington 48.3%
a statue of George Washington et al. looking at the camera 13.8%
George Washington standing in front of a mirror posing for the camera 13.7%