Human Generated Data

Title

Portrait of a Man

Date

1541

People

Artist: Master of the 1540s, Netherlandish

Previous attribution: Jan van Scorel, Netherlandish 1495 - 1562

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, The Kate, Maurice R. and Melvin R. Seiden Special Purchase Fund in honor of Ron Spronk, 2001.169

Human Generated Data

Title

Portrait of a Man

People

Artist: Master of the 1540s, Netherlandish

Previous attribution: Jan van Scorel, Netherlandish 1495 - 1562

Date

1541

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 95
Human 91.7
Person 91.7
Apparel 79.9
Hat 79.9
Clothing 79.9
Painting 72.3

Clarifai
created on 2020-04-24

people 99.9
portrait 99.8
lid 99.8
one 99.7
veil 99.2
man 99.2
adult 99.1
wear 98.5
outerwear 96.9
cowboy hat 96.6
cowboy 94.7
mustache 94.5
facial hair 90.7
elderly 89.8
fashion 88.8
cap 88.3
woman 87.8
music 87.6
fedora 87.2
jacket 86.5

Imagga
created on 2020-04-24

man 52.5
male 44.7
person 44.3
suit 43.8
portrait 34.3
businessman 33.6
adult 32.4
business 28.6
bow tie 28.2
necktie 27.8
face 26.3
handsome 25.9
clothing 24.3
guy 24.2
black 24.1
people 22.9
hat 22
executive 20.9
tie 20.9
expression 20.5
garment 19.9
men 19.8
professional 19.5
model 19.5
looking 19.2
corporate 18.1
success 17.7
confident 17.3
smile 16.4
attractive 15.4
studio 15.2
hand 15.2
one 14.9
beard 14.7
happy 14.4
hair 14.3
human 14.3
standing 13.9
successful 13.7
fashion 13.6
formal 13.4
shirt 13.1
smiling 13
jacket 12.8
manager 12.1
posing 11.6
senior 11.3
office 11.3
ruler 11.1
work 11
scholar 10.9
baron 10.7
old 10.5
sexy 10.4
smart 10.4
mature 10.2
glasses 10.2
lifestyle 10.1
pose 10
intellectual 9.7
look 9.6
couple 9.6
boss 9.6
serious 9.5
worker 9.4
youth 9.4
head 9.2
modern 9.1
job 8.9
boy 8.7
elderly 8.6
eyes 8.6
elegant 8.6
money 8.5
actor 8.5
covering 8.4
gown 8.4
holding 8.3
fun 8.2
cute 7.9
judge 7.8
consumer goods 7.7
dark 7.5
style 7.4
20s 7.3
businesswoman 7.3
lawyer 7.2
happiness 7.1

Google
created on 2020-04-24

Portrait 97.6
Self-portrait 95.2
Painting 87.1
Art 65.5

Microsoft
created on 2020-04-24

text 99.3
painting 99.2
human face 98.9
drawing 97.4
person 95.5
portrait 94.9
sketch 90
clothing 86
art 82.9
black 79.3
hat 78
fashion accessory 71.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 96.7%
Disgusted 0%
Happy 0%
Calm 99.1%
Fear 0%
Confused 0%
Sad 0.7%
Surprised 0%
Angry 0.1%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 91.7%
Hat 79.9%
Painting 72.3%

Captions

Microsoft

a man wearing a black hat 71.6%
a man wearing a black hat and looking at the camera 65.6%
a man wearing a hat 65.5%

Text analysis

Amazon

ETATIS
SVE ETATIS
SVE
ANO'41

Google

ANNO
IS41A
ANNO IS41A SVA ETATIS
SVA
ETATIS