Human Generated Data

Title

Clement de Jonghe, Printseller

Date

1651

People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Priscilla England and Jean Stern in honor of Agnes Mongan, M21982

Human Generated Data

Title

Clement de Jonghe, Printseller

People

Artist: Rembrandt Harmensz. van Rijn, Dutch 1606 - 1669

Date

1651

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-06

Apparel 99.9
Clothing 99.9
Hat 98.6
Art 97.2
Human 95
Person 95
Drawing 88.2
Sketch 84.5
Painting 74.8
Sun Hat 69.8
Cowboy Hat 58

Clarifai
created on 2019-08-06

people 99.9
one 99.4
portrait 99.3
adult 99.1
lid 99.1
print 98.9
wear 98.7
veil 98.6
fur coat 98.6
coat 98.4
outerwear 98.2
art 97.6
woman 94.2
man 90.5
bonnet 86.2
two 86
cape 84.7
engraving 81.7
overcoat 79.3
royalty 72.9

Imagga
created on 2019-08-06

cloak 100
covering 94.3
hat 47.9
cowboy hat 35.4
statue 34.6
fur coat 27.7
sculpture 26.9
religion 26
coat 25.6
old 25.1
clothing 22.8
headdress 21.9
ancient 19
art 18.9
face 18.5
portrait 16.8
god 16.3
history 15.2
man 14.1
religious 14.1
model 14
close 13.7
culture 13.7
stone 13.5
person 13.5
church 13
garment 12.5
vintage 12.4
people 12.3
antique 12.1
male 12.1
catholic 11.7
pray 11.6
symbol 10.8
monument 10.3
head 10.1
cowboy 9.8
lady 9.7
adult 9.7
museum 9.7
sexy 9.6
holy 9.6
black 9.6
faith 9.6
historical 9.4
architecture 9.4
historic 9.2
fashion 9
retro 9
western 8.7
worship 8.7
saint 8.7
spiritual 8.6
smile 8.6
dark 8.4
figure 8.2
building 7.9
eyes 7.7
prayer 7.7
temple 7.7
consumer goods 7.5
human 7.5
style 7.4
closeup 7.4
peace 7.3
pose 7.2
detail 7.2
hair 7.1

Google
created on 2019-08-06

Gentleman 76.6
Drawing 64.2
Painting 60.3
Self-portrait 59.6
Art 58.1
Portrait 51.6

Microsoft
created on 2019-08-06

sketch 99.6
drawing 99.4
hat 99.3
text 99.2
book 97.6
fashion accessory 95.8
human face 93.1
cowboy hat 88.3
painting 88
fedora 87.4
art 83.5
sun hat 81.6
person 78.7
clothing 78.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-27
Gender Male, 91.7%
Sad 3.4%
Happy 3%
Calm 71%
Confused 8.2%
Surprised 4.6%
Angry 4.2%
Disgusted 5.6%

Microsoft Cognitive Services

Age 28
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Hat 98.6%
Person 95%
Painting 74.8%

Captions

Microsoft

a close up of a book 31%
close up of a book 26.7%
a person with a book 26.6%