Human Generated Data

Title

The Man of Sorrows
Date

mid 1490s
People

Artist: Aelbert Bouts, Netherlandish c. 1451/54 - 1549
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, The Kate, Maurice R. and Melvin R. Seiden Special Purchase Fund in honor of Seymour and Zoya Slive, 2001.170

Human Generated Data

Title

The Man of Sorrows

People

Artist: Aelbert Bouts, Netherlandish c. 1451/54 - 1549

Date

mid 1490s

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Person 91.9
Human 91.9
Face 89.3
Art 83.1
Painting 71.8
Finger 60.6
Skin 57.9

Clarifai
created on 2018-03-16

people 98.1
portrait 97.1
man 96.8
one 95
blood 94.9
art 94
adult 93.9
religion 90.8
painting 88.8
god 85.1
woman 84.3
face 80.9
facial hair 79.7
vicious 78.3
veil 77.9
horror 77.8
dreadlock 76.8
color 76.8
dark 75.7
pain 74.7

Imagga
created on 2018-03-16

mosaic 41.3
portrait 32.3
face 24.8
person 23.8
people 22.3
money 22.1
hair 19.8
currency 19.7
man 19.5
adult 19.4
chain mail 18.8
model 18.7
cash 18.3
pretty 17.5
fashion 17.3
bill 17.1
art 16.9
close 16.5
sexy 16.1
transducer 16
dollar 15.8
banking 15.6
male 15.6
lady 15.4
creation 15.2
body armor 15.1
brunette 14.8
finance 14.4
bank 14.3
posing 14.2
attractive 14
eyes 13.8
sensual 13.6
cute 12.9
banknote 12.6
financial 12.5
electrical device 12.1
closeup 12.1
smile 12.1
skin 12.1
happy 11.9
human 11.2
armor 11.2
one 11.2
black 10.2
paper 10.2
beard 10
make 10
old 9.7
pay 9.6
hat 9.4
expression 9.4
wig 9.3
lips 9.2
head 9.2
covering 9.2
device 9
clothing 8.8
lifestyle 8.7
ruler 8.7
payment 8.7
protective covering 8.6
culture 8.5
business 8.5
feminine 8.4
vintage 8.3
makeup 8.2
body 8
smiling 8
twenty 7.9
costume 7.6
fun 7.5
commerce 7.5
rich 7.4
economy 7.4
note 7.4
gorgeous 7.2
dress 7.2
wealth 7.2

Google
created on 2018-03-16

facial hair 87.1
art 84.1
portrait 75
painting 73.7
human behavior 65.1
beard 63.1
religion 61.4

Microsoft
created on 2018-03-16

person 98.3
man 95.1
text 87.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 93.8%
Confused 2.4%
Calm 11.7%
Angry 1.2%
Sad 82.1%
Surprised 0.8%
Disgusted 0.7%
Happy 1.1%

Microsoft Cognitive Services

Age 43
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 91.9%

Captions

Microsoft

a man looking at the camera 67%
a man with a beard looking at the camera 46.2%
a man wearing a hat 46.1%