Human Generated Data

Title

Vanitas

Date

17th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Antonia Paepcke DuBrul Fund, 1985.28

Human Generated Data

Title

Vanitas

People

Artist: Unidentified Artist,

Date

17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Antonia Paepcke DuBrul Fund, 1985.28

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 98.7
Person 98.7
Painting 98.6
Art 98.6

Clarifai
created on 2018-03-16

painting 99.7
people 99.6
art 99.4
one 99
illustration 98.9
adult 98.2
print 97.4
Renaissance 97.3
religion 96.3
man 93.8
indoors 93.3
lithograph 92.3
son 92
baby 90.9
child 90.5
text 89.2
wear 88.7
ancient 87.8
veil 86
two 85.6

Imagga
created on 2018-03-16

religion 44.8
temple 41.5
statue 38.8
sculpture 34.5
culture 25.6
ancient 25.1
god 24.9
art 24.3
religious 23.4
travel 23.2
child 21.6
architecture 20.3
plaything 18.6
spiritual 18.2
holy 17.3
gold 17.3
history 17
stone 16.9
person 16.8
old 16
doll 15.4
juvenile 15.3
monument 14.9
east 14.9
tourism 14.8
prayer 14.5
meditation 14.4
pray 13.6
spirituality 13.4
traditional 13.3
carving 13.1
oriental 12.5
figure 12.2
famous 12.1
peace 11.9
face 11.4
golden 11.2
faith 10.5
antique 10.4
teddy 10.3
church 10.2
historic 10.1
world 9.8
carved 9.8
building 9.5
sitting 9.4
decoration 9.4
tourist 9.1
portrait 9.1
toyshop 9
bangkok 8.9
body 8.8
heritage 8.7
wall 8.5
historical 8.5
lady 8.1
man 8.1
southeast 7.9
praying 7.8
people 7.8
belief 7.8
color 7.8
worship 7.7
palace 7.7
head 7.6
style 7.4
posing 7.1

Google
created on 2018-03-16

art 91.1
painting 81.1
poster 76.8
muscle 70.7
human behavior 69.1
barechestedness 68.4
chest 59.2
modern art 58.8
artwork 53.5
album cover 52.8
visual arts 52.4

Microsoft
created on 2018-03-16

text 94.8
indoor 93.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-13
Gender Male, 50.6%
Angry 4.1%
Happy 3.8%
Calm 72.8%
Surprised 11.7%
Confused 2.9%
Disgusted 2%
Sad 2.7%

Microsoft Cognitive Services

Age 30
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%
Painting 98.6%

Captions

Text analysis

Amazon

gmad
cshch
loub
wnrt
Der
Saum
u
amd
mmacht
2nuft
me
cshch me Der ommucki regandf mm mmacht
u 2nuft Dol wnrt adou SOUen
Stltnerst
Saum Stltnerst Du loub San10 Swen
Swen
Dol
regandf
DET
adou
lfoub
DET snmf 2f lfoub amd n iff gmad
San10
snmf
Du
mm
2f
SOUen
ommucki
iff
n

Google

arum ich
arum
ich