Human Generated Data

Title

The Oyster Meal (original, 1661, in the Mauritshuis, The Hague)
Date

17th century
People

Artist: Frans van Mieris the Elder, Dutch 1635 - 1681
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Meta and Paul J. Sachs, 1927.28

Human Generated Data

Title

The Oyster Meal (original, 1661, in the Mauritshuis, The Hague)

People

Artist: Frans van Mieris the Elder, Dutch 1635 - 1681

Date

17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Meta and Paul J. Sachs, 1927.28

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 97.7
Human 97.7
Art 97.5
Painting 97.5

Clarifai
created on 2020-04-24

people 99.9
print 99.2
art 99.2
adult 99.1
one 97.7
painting 97.6
portrait 97.5
man 96.3
engraving 94.6
two 93.9
furniture 92.6
wear 92.3
illustration 91.1
woman 88.6
leader 87.9
facial hair 87.1
administration 84.8
sit 83.7
group 83.7
writer 82.4

Imagga
created on 2020-04-24

book jacket 66.6
jacket 51.8
wrapping 39.4
covering 33.4
fountain 28.2
old 27.2
ancient 20.7
grunge 20.4
structure 19.1
art 18.3
architecture 18
statue 17.4
sculpture 16.4
wall 16.2
building 15.9
antique 14.7
stone 14.5
vintage 14.1
window screen 14
screen 12.7
history 12.5
grungy 12.3
black 12.2
texture 11.8
religion 11.6
people 11.2
cell 11
decoration 11
aged 10.9
temple 10.8
man 10.7
light 10.7
face 10.6
human 10.5
person 10.3
protective covering 10.2
travel 9.9
sexy 9.6
god 9.6
culture 9.4
model 9.3
city 9.1
dirty 9
dress 9
retro 9
body 8.8
hair 8.7
monument 8.4
famous 8.4
house 8.4
window 8.3
rough 8.2
sensuality 8.2
posing 8
artistic 7.8
historical 7.5
dark 7.5
religious 7.5
one 7.5
tourism 7.4
design 7.3
lady 7.3
paint 7.2
adult 7.1
carving 7

Google
created on 2020-04-24

Painting 88.4
Picture frame 85
Stock photography 76.7
Art 74
Photography 67.8
Visual arts 62.5
Black-and-white 56.4
Artwork 53.4
Still life 52.9

Microsoft
created on 2020-04-24

text 99.4
painting 99
drawing 98.9
sketch 97.9
person 89.9
human face 81.3
art 76.7
black and white 66.4
woman 64.8
clothing 64.2
blackboard 52.5
picture frame 23.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 42-60
Gender Male, 65.9%
Surprised 22%
Happy 40.1%
Fear 3.8%
Confused 3.9%
Disgusted 0.6%
Sad 6.5%
Calm 19.9%
Angry 3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Painting 97.5%

Categories

Imagga

people portraits 62.6%
pets animals 19%
streetview architecture 15.1%
paintings art 1.6%

Captions

Microsoft
created on 2020-04-24

a person sitting in front of a door 51.3%
a person sitting in front of a door 32.3%