Human Generated Data

Title

Portrait of an Old Man (Adriaen van Rijn, Rembrandt's brother)
Date

17th century
People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edwin H. Abbot, 1962.97

Human Generated Data

Title

Portrait of an Old Man (Adriaen van Rijn, Rembrandt's brother)

People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669

Date

17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Edwin H. Abbot, 1962.97

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 97.8
Human 97.8
Clothing 97
Hat 97
Apparel 97
Art 93.1
Face 88.3
Photography 73.7
Portrait 73.7
Photo 73.7
Text 62.7
Drawing 62.4
Painting 62.3

Clarifai
created on 2020-04-24

people 100
portrait 100
one 99.7
lid 99.2
man 99.1
adult 99.1
art 98.5
mustache 98.4
print 98
veil 97.7
facial hair 97.5
engraving 96.7
leader 96.2
old 92.1
painting 91.7
writer 91.7
elderly 91.5
wear 90.6
vintage 87.7
cap 86.7

Imagga
created on 2020-04-24

hat 45.4
person 44.7
portrait 37.5
man 36.3
male 32.7
face 30.5
grandfather 30.3
people 25.1
senior 24.4
old 23.7
adult 23.3
white 22.9
model 21.8
clothing 18.2
elderly 18.2
cloak 18.1
looking 16.8
covering 16.4
black 16.3
hair 15.9
fashion 15.8
happy 15.7
ruler 15.4
casual 15.2
handsome 15.2
smile 15
eyes 14.6
head 14.3
human 14.2
look 14
mature 13.9
cowboy 13.9
hand 13.7
guy 13.5
eye 13.4
beard 13.1
boy 13
expression 12.8
pose 12.7
western 12.6
attractive 12.6
pretty 11.9
dark 11.7
smiling 11.6
posing 11.6
serious 11.4
sexy 11.2
style 11.1
skin 11
mystery 10.6
old-timer 10.5
men 10.3
shirt 10.3
mysterious 9.7
retired 9.7
traditional 9.1
headdress 9.1
make 9.1
outdoors 9
lifestyle 8.7
retirement 8.6
happiness 8.6
cute 8.6
child 8.6
wearing 8.6
youth 8.5
studio 8.4
one 8.2
blond 8.1
sweater 8
close 8
cowboy hat 7.8
culture 7.7
gesture 7.6
smart 7.5
glasses 7.4
cheerful 7.3
alone 7.3
teenager 7.3
cap 7.3
aged 7.2
dress 7.2
lovely 7.1
jacket 7.1

Google
created on 2020-04-24

Portrait 89.5
Self-portrait 77.5
Painting 57.1
Picture frame 55.8
Art 50.2

Microsoft
created on 2020-04-24

text 99.8
sketch 99.1
drawing 98.9
man 97.8
human face 96.5
painting 95.4
portrait 90
person 87.8
electronics 86.4
black and white 79.7
old 78.6
clothing 70.8
hat 69.8
art 55.7
display 36.3
picture frame 25.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 41-59
Gender Male, 99.7%
Happy 0%
Fear 0.1%
Surprised 0.1%
Confused 0.2%
Sad 24.2%
Calm 71.4%
Disgusted 0%
Angry 4%

Microsoft Cognitive Services

Age 68
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Hat 97%
Painting 62.3%

Categories

Imagga

people portraits 99.8%

Captions

Microsoft
created on 2020-04-24

a man wearing a hat 92.5%
a man wearing a black hat 89.4%
a man wearing a hat in front of a screen 86.7%