Human Generated Data

Title

Self-portrait
Date

16th-17th Century
People

Artist: Jacopo Palma Giovane, Italian c. 1548 - 1628

Previous attribution: Bartolomeo Passarotti, Italian 1529 - 1592
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mrs. E. P. Hall, 1919.562

Human Generated Data

Title

Self-portrait

People

Artist: Jacopo Palma Giovane, Italian c. 1548 - 1628

Previous attribution: Bartolomeo Passarotti, Italian 1529 - 1592

Date

16th-17th Century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 97.3
Person 97.3
Art 92.3
Face 91.5
Painting 91.1
Portrait 75.3
Photography 75.3
Photo 75.3
Text 70.9
Head 66.5
Drawing 63.8

Clarifai
created on 2020-04-24

portrait 99.9
people 99.9
facial hair 99.4
adult 99.1
one 99.1
mustache 99
engraving 98.9
leader 98.7
print 98.4
art 97.7
scientist 97.6
man 97.3
illustration 94.3
poet 93.9
philosopher 91.6
painting 90.5
writer 86.9
old 86.3
bald 84.9
politician 80.8

Imagga
created on 2020-04-24

man 41
portrait 38.2
mug shot 37.5
face 32
male 31.3
photograph 30.1
person 29.7
beard 29
people 27.3
senior 25.3
old 24.4
adult 23.9
representation 22.7
mustache 21.4
black 21.1
serious 20
hair 19.8
expression 19.6
close 19.4
mature 18.6
human 18
handsome 17.8
one 17.2
spectacles 17
look 16.6
looking 16
head 16
creation 15.5
eyes 15.5
model 14.8
grandfather 14.5
call 13.9
men 13.7
gray 13.5
elderly 13.4
casual 12.7
retired 12.6
eye 12.5
dark 11.7
lifestyle 11.6
retirement 11.5
optical instrument 11.4
happy 11.3
attractive 11.2
older 10.7
skin 10.5
glasses 10.2
smile 10
pensive 9.8
depression 9.7
sad 9.6
guy 9.5
hand 9.1
aged 9
closeup 8.8
hat 8.7
god 8.6
nose 8.6
age 8.6
professional 8.4
health 8.3
business 7.9
love 7.9
together 7.9
despair 7.9
couple 7.8
grandmother 7.8
prayer 7.7
pretty 7.7
money 7.7
grandma 7.6
instrument 7.4
emotion 7.4
device 7.3
sexy 7.2
currency 7.2
businessman 7.1

Google
created on 2020-04-24

Portrait 92.6
Picture frame 84.4
Painting 75
Self-portrait 74.1
Facial hair 73.1
Art 72.1
Stock photography 59.4
Beard 55.1
Historian 51.9
Physicist 50.1

Microsoft
created on 2020-04-24

sketch 99.9
drawing 99.9
painting 99.3
text 97.8
human face 93.3
art 93
child art 91.8
portrait 87.9
indoor 85.7
person 84.4
man 77.7
old 60.2
self-portrait 50.3
picture frame 12.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 34-50
Gender Male, 99.2%
Angry 0.8%
Fear 0.1%
Happy 0%
Disgusted 0.6%
Surprised 0.1%
Confused 1%
Sad 31.6%
Calm 65.8%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.3%
Painting 91.1%

Captions

Microsoft

a man sitting in front of a window 44.2%
an old photo of a man 44.1%
a man sitting in front of a door 44%