Human Generated Data

Title

Sight
Date

17th century
People

Artist: Jan Both, Dutch 1610 - 1652

Artist after: Andries Both, Dutch 1611 - 1642
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Melvin R. Seiden, S5.52.1

Human Generated Data

Title

Sight

People

Artist: Jan Both, Dutch 1610 - 1652

Artist after: Andries Both, Dutch 1611 - 1642

Date

17th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-04-03

Person 99.5
Human 99.5
Person 98.8
Person 98
Person 93.2
Art 92.7
Person 91.9
Person 91.1
Poster 86.4
Advertisement 86.4
Painting 84.7
Person 65.8
Duel 59.5

Clarifai
created on 2018-03-24

people 100
print 99.3
group 99.2
soldier 98.5
military 98.1
wear 97.6
adult 97.6
child 96.9
engraving 96.1
war 94.9
man 94.8
art 94.4
illustration 94.1
group together 93.5
gun 92
administration 91.7
weapon 91.4
army 90
military uniform 89.3
many 89

Imagga
created on 2018-03-24

grunge 56.3
antique 46.8
old 46
vintage 43.9
retro 43.5
texture 43.1
aged 42.6
frame 35.1
grungy 34.2
paper 33
pattern 30.8
ancient 29.4
border 29
blank 25.7
dirty 25.3
art 24.6
page 23.2
canvas 22.8
paint 22.7
worn 22
wall 21.8
material 21.5
brown 21.4
torn 21.3
parchment 21.1
aging 21.1
textured 21.1
design 20.8
burnt 20.4
graffito 20.2
stained 20.2
wallpaper 19.2
floral 18.7
stucco 18.5
rough 18.3
decorative 17.6
damaged 17.2
decoration 16.9
drawing 16.9
surface 16.8
text 16.6
empty 16.3
space 16.3
color 16.2
flower 15.4
structure 14.4
sketch 14.1
backdrop 14
dirt 13.4
snow 13.3
graphic 13.1
burned 12.8
decay 12.6
weathered 12.4
map 12.2
detail 12.1
manuscript 11.8
album 11.7
rust 11.6
gravestone 11.2
representation 11.2
style 11.1
grain 11.1
memorial 10.9
shabby 10.8
detailed 10.6
edge 10.6
stain 10.6
obsolete 10.6
plant 10.5
rusty 10.5
artistic 10.4
leaf 10.1
stone 10
backgrounds 9.7
stains 9.7
sepia 9.7
scrapbook 9.7
crack 9.7
spot 9.6
sheet 9.4
yellow 9.3
black 9
arabesque 8.9
scratch 8.8
ragged 8.8
messy 8.7
note 8.3
grime 7.8
mottled 7.8
fracture 7.8
element 7.4
document 7.4
mosaic 7.4
book jacket 7.4
foliage 7.4
letter 7.3
effect 7.3

Google
created on 2018-03-24

standing 76.3
history 71.2
black and white 63.6
human behavior 63.5
tree 60.6
vintage clothing 58.6
illustration 57.9
artwork 56
art 54.2

Microsoft
created on 2018-03-24

text 99.5
book 90.2

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 54.3%
Calm 47.6%
Happy 45.2%
Sad 49.2%
Disgusted 45.1%
Angry 45.8%
Confused 46.7%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Female, 52.1%
Disgusted 45.3%
Angry 45.4%
Surprised 45.1%
Happy 45.1%
Confused 45.2%
Sad 53.3%
Calm 45.6%

AWS Rekognition

Age 48-68
Gender Male, 86.1%
Happy 13.4%
Calm 16.8%
Sad 25.5%
Surprised 7.3%
Angry 13.6%
Disgusted 15.6%
Confused 7.8%

AWS Rekognition

Age 49-69
Gender Male, 97.2%
Disgusted 4.2%
Confused 20.3%
Angry 20.2%
Calm 25.2%
Happy 6.7%
Sad 14.5%
Surprised 8.9%

AWS Rekognition

Age 23-38
Gender Male, 53.2%
Disgusted 45.4%
Angry 46.3%
Happy 49.2%
Calm 46.9%
Surprised 45.7%
Confused 45.6%
Sad 45.9%

AWS Rekognition

Age 23-38
Gender Female, 54.4%
Calm 46.1%
Angry 48%
Sad 45.3%
Happy 46.2%
Confused 45.5%
Disgusted 48.4%
Surprised 45.5%

Feature analysis

Amazon

Person 99.5%
Poster 86.4%
Painting 84.7%

Captions

Microsoft

an old photo of a person 81.1%
old photo of a person 76.4%
a person standing next to a book 25.4%

Text analysis

Amazon

besje
Bril
indien
Doch
klonter
Coopman
wil
van
pels
Vrou
Wat
kunnen
Slodder.
Doch Slodder. en kunnen niet bedjen
men
en
slomps.
bedjen
Wat baet de Bril indien men niet toehien en wil
baet
niet
de
Both
Cramerven
Veylt
yn
met
Veylt besje klonter pels een Criflalyne Bril Fratres.
Anderies.
Anderies. Both Invemter . Lan Nlodder met yn mars. Coopman van Cramerven Lan-Bert. Frit.
Frit.
Nlodder
la
Lan
Fratres.
Invemter .
toehien
Criflalyne
mars.
een
en Vrou slomps. la Grodr Coecui
tGEsIcht
Lan-Bert.
Coecui
Grodr

Google

t GESICH T Ian lodder met fyn mars Coopman van Crameryen Tamrh i Veylt bsje klonter pels een Crifaline Bril Doch Slodder. en Vrou Slomps. en kunnen niet betien Wat bact de Bril indien men niet toe fien en wil fideris Both Fratres
t
GESICH
T
Ian
lodder
met
fyn
mars
Coopman
van
Crameryen
Tamrh
i
Veylt
bsje
klonter
pels
een
Crifaline
Bril
Doch
Slodder.
en
Vrou
Slomps.
kunnen
niet
betien
Wat
bact
de
indien
men
toe
fien
wil
fideris
Both
Fratres