Human Generated Data

Title

Portrait of an Old Man
Date

1632
People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Nettie G. Naumburg, 1930.191

Human Generated Data

Title

Portrait of an Old Man

People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669

Date

1632

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 97.9
Painting 97.9
Face 81.1
Portrait 60.8
Photo 60.8
Photography 60.8

Clarifai
created on 2018-03-16

people 99.5
portrait 99.1
adult 98.8
painting 98.4
one 98.3
art 98.1
wear 95.4
illustration 91.9
vintage 91.1
old 89.8
man 89.1
mustache 84.8
side view 82.2
print 82.1
profile 81.6
mammal 81
indoors 80.2
woman 80.1
face 80.1
facial hair 79.8

Imagga
created on 2018-03-16

monkey 35.6
primate 32.9
man 28.9
portrait 25.2
face 24.9
male 24.8
person 23.2
senior 22.5
grandma 21
old 20.9
eyes 20.7
coat 20.5
fur coat 20.2
people 19.5
mustache 19.2
orangutan 19.1
wildlife 18.7
adult 18.2
beard 18.1
gray 18
animals 17.6
hair 16.6
grandfather 16.6
wild 15.7
black 15.6
ape 15.4
natural 15.4
head 14.3
primates 13.8
monkeys 13.8
expression 13.6
human 13.5
one 13.4
tree 12.3
look 12.3
mother 12.2
jungle 11.7
elderly 11.5
pretty 11.2
playing 10.9
orphaned 10.9
orphan 10.9
nursery 10.8
looking 10.4
mature 10.2
eye 9.8
trees 9.8
close 9.7
retired 9.7
together 9.6
fur 9.3
dark 9.2
happy 8.8
depression 8.8
couple 8.7
hands 8.7
play 8.6
nose 8.6
garment 8.5
metropolitan 8.1
lifestyle 7.9
life 7.9
elder 7.9
wrinkles 7.9
despair 7.9
climb 7.8
older 7.8
sitting 7.7
zoo 7.7
serious 7.6
clothing 7.6
outdoors 7.5

Google
created on 2018-03-16

painting 91.8
portrait 87.8
facial hair 87
art 57.4
self portrait 56.7
beard 55.8

Microsoft
created on 2018-03-16

primate 97.5
mammal 97
animal 95.6
person 94.7
indoor 94.6
ape 61.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 98.7%
Sad 18.3%
Confused 22.7%
Happy 1.5%
Disgusted 7.1%
Angry 14%
Surprised 4.8%
Calm 31.6%

Microsoft Cognitive Services

Age 72
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97.9%

Captions

Microsoft

a man standing in front of a monkey 77.5%
a man sitting in front of a monkey 68.1%
a man that is standing in front of a monkey 68%

Text analysis

Amazon

Cran ys