Human Generated Data

Title

Portrait of a Man
Date

c. 1535-1540
People

Artist: Bartholomaeus Bruyn the Elder, German 1493 - 1555
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Charles E. Dunlap, 1960.740

Human Generated Data

Title

Portrait of a Man

People

Artist: Bartholomaeus Bruyn the Elder, German 1493 - 1555

Date

c. 1535-1540

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Art 97.7
Human 95.3
Person 95.3
Painting 88.3
Clothing 58
Apparel 58

Clarifai
created on 2018-03-23

people 99.5
adult 98.9
one 98.8
painting 98.7
veil 98.1
lid 98.1
man 97.7
portrait 97.6
art 97.6
wear 95.7
illustration 95.5
print 95.5
woman 94.4
religion 89
facial hair 88.6
mustache 85.9
Renaissance 84.4
royalty 84.2
cape 83.3
coat 82.1

Imagga
created on 2018-03-23

hat 70.6
person 38.6
man 37
sombrero 35.3
clothing 34.1
headdress 32.8
ruler 30.5
portrait 30.4
male 26.9
covering 26.2
handsome 24.1
adult 24
people 21.7
face 21.3
happy 21.3
fashion 18.8
suit 18.7
black 18.2
smile 17.8
cowboy hat 16.7
cloak 16.5
attractive 16.1
model 15.6
jacket 15.5
pretty 15.4
smiling 15.2
white 15
senior 15
hair 14.3
posing 14.2
standing 13.9
cute 13.6
guy 13.4
businessman 13.2
hand 12.9
dress 12.6
consumer goods 12.5
old 12.5
lady 12.2
business 12.1
shirt 12.1
looking 12
one 11.9
outdoors 11.9
style 11.9
costume 11.5
human 11.2
expression 11.1
happiness 11
dark 10.9
traditional 10.8
fun 10.5
wearing 10.5
ethnic 10.5
success 10.5
sexy 10.4
casual 10.2
tie 9.5
work 9.4
lifestyle 9.4
head 9.2
friendly 9.1
worker 8.9
cowboy 8.8
brunette 8.7
love 8.7
elderly 8.6
outside 8.6
glasses 8.3
vintage 8.3
coat 8.2
pose 8.2
couple 7.8
professional 7.7
straw 7.7
serious 7.6
joy 7.5
mature 7.4
successful 7.3
make 7.3
gorgeous 7.2
garment 7.1

Google
created on 2018-03-23

portrait 90.8
gentleman 85.3
painting 79.2
facial hair 74.8
art 64.1
self portrait 61.6
fur 57.9

Microsoft
created on 2018-03-23

person 97.3
wearing 96
hat 95.2
dressed 36.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 99.6%
Confused 2.4%
Surprised 2.5%
Disgusted 0.7%
Angry 1.7%
Happy 0.4%
Calm 90.9%
Sad 1.5%

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.3%
Painting 88.3%

Captions

Microsoft

a man wearing a red hat 90.1%
a man wearing a hat 90%
a man wearing a black hat 89.9%