Human Generated Data

Title

Benjamin Franklin
Date

19th century
People

Artist: Francesco Petroncini, Italian actual dates unknown; active 1847
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R14768

Human Generated Data

Title

Benjamin Franklin

People

Artist: Francesco Petroncini, Italian actual dates unknown; active 1847

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 98
Person 98
Art 91.7
Text 82.9
Portrait 63.1
Photography 63.1
Face 63.1
Photo 63.1
Painting 50.9

Clarifai
created on 2019-11-06

people 99.9
portrait 99.8
print 99.3
old 99.1
one 98.9
art 98.7
adult 98
engraving 98
vintage 96.7
antique 96.6
man 96.4
leader 96
painting 95.9
writer 94.5
famous 94.2
politician 93.6
retro 93.5
illustration 92.2
paper 92.2
scientist 92

Imagga
created on 2019-11-06

grandma 61.9
man 47.8
grandfather 44
senior 41.3
male 39
portrait 38.9
person 33.7
elderly 30.7
old 30
adult 27.8
mature 27
face 24.9
people 23.5
glasses 22.2
handsome 21.4
one 20.9
expression 20.5
looking 20
gray 19.8
retired 19.4
retirement 19.2
hair 19
happy 18.8
businessman 18.6
age 17.2
close 17.1
business 17
older 15.6
aged 15.4
serious 15.3
smile 15
suit 14.7
executive 14.2
mug shot 14
eyes 13.8
grandmother 13.7
money 13.6
casual 13.6
human 13.5
professional 13
black 12.6
head 12.6
pensioner 12.4
currency 11.7
couple 11.3
men 11.2
dollar 11.1
photograph 10.9
smiling 10.9
elder 10.8
aging 10.6
look 10.5
tie 10.4
happiness 10.2
old-timer 10
wrinkle 9.8
cash 9.2
confident 9.1
life 9.1
representation 9
pension 8.9
success 8.9
baron 8.7
work 8.6
boss 8.6
shirt 8.6
intellectual 8.5
dark 8.4
successful 8.2
alone 8.2
scholar 8.1
closeup 8.1
beard 8
lifestyle 8
gray hair 7.9
wrinkled 7.8
standing 7.8
wisdom 7.8
dollars 7.7
collar 7.7
husband 7.6
bill 7.6
studio 7.6
manager 7.5
occupation 7.3
cheerful 7.3
lady 7.3
wealth 7.2
financial 7.1
worker 7.1
love 7.1
job 7.1
paper 7.1

Google
created on 2019-11-06

Photograph 95.9
Portrait 88.5
Text 85.2
Gentleman 71
Art 70.9
Self-portrait 68.9
Picture frame 67.5
Photography 62.4
Stock photography 62.1
Facial hair 60.7
History 57.6
Physicist 56.3
Collection 55.6
Painting 54.7
Moustache 52.7

Microsoft
created on 2019-11-06

text 99.3
drawing 98.8
sketch 97.9
human face 97.7
painting 95.6
person 90.8
portrait 89.2
man 80.7
clothing 76.5
old 50.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 47-65
Gender Male, 81.6%
Confused 0.1%
Sad 1.9%
Disgusted 0%
Angry 0.2%
Calm 97.6%
Surprised 0.1%
Fear 0%
Happy 0.1%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98%
Painting 50.9%

Captions

Microsoft

a close up of a person 74.9%
an old picture of a person 74.8%
a person posing for a picture 74.7%

Text analysis

Amazon

BENIAMINO
BENIAMINO FRANKLIN
FRANKLIN
si
si Horimt
Horimt
def
Telronan
ranajoo
ranajoo Telronan def Cinc
Bm
Cinc

Google

rencfo ronan di enc BENIAMINO FRANKLIN
rencfo
ronan
di
enc
BENIAMINO
FRANKLIN