Human Generated Data

Title

Benjamin Franklin (1706-1790)

Date

c. 1778

People

Artist: Joseph Siffred Duplessis, French 1725 - 1802

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.235

Human Generated Data

Title

Benjamin Franklin (1706-1790)

People

Artist: Joseph Siffred Duplessis, French 1725 - 1802

Date

c. 1778

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 99.5
Painting 99.5
Human 91.7
Person 91.7

Clarifai
created on 2020-04-24

painting 99.3
art 98.8
people 98.7
one 98.2
religion 97.3
portrait 97
aura 95.8
adult 95.5
Renaissance 94.8
man 94.7
wear 94.6
saint 93.8
elderly 92.5
sculpture 92
woman 90.8
gown (clothing) 90.3
Mary 90.1
god 88.5
monk 86.7
church 86.5

Imagga
created on 2020-04-24

portrait 20
church 18.5
man 18.1
person 17.8
art 17.4
currency 17
face 16.3
adult 16.1
religion 16.1
one 15.7
black 15.6
old 15.3
money 15.3
male 15
cash 14.6
people 14.5
dollar 13.9
painter 13.3
holy 12.5
faith 12.4
god 12.4
book jacket 12.3
religious 12.2
banking 11.9
finance 11.8
saint 11.5
business 11.5
bill 11.4
close 10.8
covering 10.6
fashion 10.5
jacket 10.5
attractive 10.5
hat 10.4
paper 10.2
dark 10
wealth 9.9
financial 9.8
lady 9.7
catholic 9.7
banknote 9.7
pray 9.7
closeup 9.4
culture 9.4
famous 9.3
belief 8.7
hair 8.7
prayer 8.7
antique 8.6
spirituality 8.6
pay 8.6
serious 8.6
model 8.5
expression 8.5
vintage 8.3
gold 8.2
astronaut 8.2
symbol 8.1
bank 8.1
sexy 8
bible 7.8
mother 7.8
ancient 7.8
worship 7.7
artist 7.7
cathedral 7.7
spiritual 7.7
historical 7.5
human 7.5
rich 7.4
historic 7.3
wrapping 7.3
architecture 7.2
interior 7.1

Google
created on 2020-04-24

Portrait 92.8
Art 85
Painting 84.4
Chin 82.8
Self-portrait 78.2
Visual arts 64.9
Prophet 56.8

Microsoft
created on 2020-04-24

painting 99.7
drawing 96.7
human face 95.5
text 89.6
art 87.8
person 84.7
sketch 84.3
portrait 79.6
museum 54.3

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 41-59
Gender Male, 99.2%
Fear 0%
Disgusted 0.1%
Happy 0%
Calm 98.4%
Confused 0.3%
Angry 0.5%
Surprised 0.1%
Sad 0.6%

Microsoft Cognitive Services

Age 49
Gender Male

Feature analysis

Amazon

Painting 99.5%
Person 91.7%

Captions

Microsoft

a person posing for the camera 75.6%
a close up of a person 62.2%
a person in a blue shirt 51%