Human Generated Data

Title

Governor Elbridge Gerry (1744-1814)
Date

1798
People

Artist: John Vanderlyn, American 1775 - 1852
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, 1943.1817

Human Generated Data

Title

Governor Elbridge Gerry (1744-1814)

People

Artist: John Vanderlyn, American 1775 - 1852

Date

1798

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Louise E. Bettens Fund, 1943.1817

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 98.6
Human 98.6
Person 98.6
Painting 89.1
Portrait 64.7
Photography 64.7
Photo 64.7
Face 64.7

Clarifai
created on 2018-03-16

people 100
portrait 99.9
one 99.8
adult 99.6
engraving 99.4
print 99.4
leader 99.1
scientist 98.5
writer 98.5
art 98.4
poet 98.3
politician 95.1
elderly 94.7
administration 94.7
man 94.2
old 92.8
chair 91.4
wear 90.8
philosopher 90.7
profile 87

Imagga
created on 2018-03-16

statue 26.4
dollar 24.1
money 23
old 21.6
currency 21.5
face 21.3
sculpture 21.2
cash 20.1
portrait 20.1
close 19.4
ruler 18.9
man 18.2
bill 18.1
art 16.5
religion 16.1
sketch 16.1
finance 16.1
one 15.7
banking 15.6
ancient 14.7
bank 14.3
male 14.3
culture 13.7
stone 13.7
god 13.4
temple 13.3
religious 13.1
pray 12.6
wealth 12.6
dollars 12.6
financial 12.5
people 12.3
person 12.3
senior 12.2
business 12.1
paper 12
head 11.8
representation 11.8
baby 11.7
carving 11.6
drawing 11.6
prayer 11.6
spiritual 11.5
holy 10.6
savings 10.3
closeup 10.1
banknote 9.7
us 9.6
pay 9.6
world 9.4
famous 9.3
church 9.2
adult 9.1
black 9
history 8.9
franklin 8.9
look 8.8
hundred 8.7
antique 8.7
serious 8.6
historic 8.3
grandfather 8.2
eye 8
hair 7.9
president 7.9
bills 7.8
travel 7.7
nose 7.6
capital 7.6
fetus 7.6
beard 7.5
symbol 7.4
peace 7.3
success 7.2
scholar 7.1

Google
created on 2018-03-16

photograph 95.7
portrait 94.5
vintage clothing 73.5
painting 70.9
self portrait 68.3
gentleman 64.5
art 61.5
artwork 61.4
stock photography 56.2
history 51.9

Microsoft
created on 2018-03-16

sitting 97.8
person 96.8
text 91
old 85.7
older 41.6

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 87.7%
Confused 3.3%
Surprised 2.5%
Calm 69%
Sad 13.9%
Disgusted 2.3%
Happy 5.2%
Angry 3.7%

Microsoft Cognitive Services

Age 70
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Painting 89.1%

Captions

Microsoft
created on 2018-03-16

an old photo of a man 87.7%
a man sitting in a chair 83%
old photo of a man 82.9%