Human Generated Data

Title

John the Baptist Preaching
Date

1585
People

Artist: Anton Wierix II, Flemish c. 1555/1559 - 1604

Artist after: Maerten de Vos, Netherlandish 1532 - 1603

Publisher: Gerard de Jode, Flemish 1509 - 1591
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Ketcham Wheaton in memory of Robert Bradford Wheaton, 2011.613.221

Human Generated Data

Title

John the Baptist Preaching

People

Artist: Anton Wierix II, Flemish c. 1555/1559 - 1604

Artist after: Maerten de Vos, Netherlandish 1532 - 1603

Publisher: Gerard de Jode, Flemish 1509 - 1591

Date

1585

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Barbara Ketcham Wheaton in memory of Robert Bradford Wheaton, 2011.613.221

Machine Generated Data

Tags

Amazon
created on 2019-06-26

Person 98.4
Human 98.4
Art 95.3
Person 93.8
Painting 93.1
Person 92.8
Person 92.5
Person 91.7
Person 87.8
Person 79.9
Person 73.2
Person 65.9
Mural 60.9
Person 54.8
Person 54.2
Person 45.3

Clarifai
created on 2019-06-26

painting 99.9
art 99.9
illustration 99.5
print 99.5
people 99.3
religion 98
man 97
sword 96.4
saint 95.5
god 95.3
adult 94.5
veil 94.4
woman 94
Renaissance 92.8
cape 92.4
lithograph 92
gown (clothing) 91.2
woodcut 90.8
old 90.5
group 89.8

Imagga
created on 2019-06-26

vintage 38.1
stamp 30.3
old 30
mail 29.7
postmark 29.6
postage 28.5
postal 27.5
comic book 26.7
letter 26.6
retro 26.2
money 25.5
binding 22.7
finance 22
tray 21.8
envelope 21.8
currency 21.5
post 21
jigsaw puzzle 18.8
cash 18.3
paper 18
receptacle 17.7
global 17.3
art 17
philately 16.8
printed 16.7
dollar 16.7
container 16.6
black 15
symbol 14.8
circa 14.8
puzzle 14.8
book jacket 14.8
ancient 14.7
note 14.7
grunge 14.5
board 14.4
one 14.2
savings 14
business 14
banking 13.8
icon 13.5
bank 13.4
bill 13.3
antique 13.1
decoration 12.9
stamps 12.8
shows 12.8
aged 12.7
collection 12.6
graffito 12.5
close 12
chalkboard 11.8
object 11.7
delivery 11.7
banknote 11.6
financial 11.6
communications 11.5
jacket 11.5
painted 11.5
covering 11.3
church 11.1
game 11
blackboard 10.7
museum 10.7
print media 10.7
painter 10.6
office 10.5
unique 10.4
culture 10.3
map 10.1
communication 10.1
message 10.1
canceled 9.9
masterpiece 9.9
known 9.9
history 9.8
renaissance 9.8
paintings 9.8
texture 9.7
cutting 9.7
dollars 9.7
exchange 9.5
closeup 9.4
book 9.4
design 9.2
wealth 9
religion 9
world 9
post mail 8.9
zigzag 8.9
idea 8.9
fame 8.9
wrapping 8.7
states 8.7
us 8.7
education 8.7
international 8.6
fine 8.6
letters 7.8
hundred 7.7
wall 7.7
payment 7.7
pay 7.7
card 7.7
united 7.6
pattern 7.5
frame 7.5

Google
created on 2019-06-26

Painting 96.3
Art 88.7
Picture frame 77.5
Textile 71.8
Visual arts 69.9
Modern art 69
Miniature 67.3
Illustration 62.3
Still life 59.3
Tapestry 59
History 54.1
Watercolor paint 53.8
Collection 50

Microsoft
created on 2019-06-26

drawing 97.5
text 96.6
indoor 88.2
book 83.5
person 78.1
cartoon 74.7
picture frame 63.2
art 57.1
painting 36.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-68
Gender Male, 50.3%
Calm 49.9%
Angry 45.4%
Happy 45%
Surprised 45.1%
Disgusted 45.1%
Sad 49.5%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.4%
Disgusted 45%
Angry 45.1%
Happy 45.1%
Sad 51.6%
Confused 45.1%
Calm 48.1%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.7%
Surprised 45%
Confused 45%
Calm 54.8%
Happy 45%
Angry 45%
Sad 45.1%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Confused 45.1%
Happy 45%
Angry 45.4%
Calm 46.6%
Sad 52.8%
Surprised 45.1%
Disgusted 45%

AWS Rekognition

Age 26-43
Gender Female, 53.4%
Disgusted 45.5%
Confused 45.2%
Happy 45.2%
Sad 46.4%
Surprised 45.3%
Angry 46.6%
Calm 50.8%

AWS Rekognition

Age 45-66
Gender Male, 53.5%
Disgusted 45%
Sad 45.3%
Angry 45.6%
Happy 45.1%
Calm 53.9%
Surprised 45.1%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53%
Happy 45%
Angry 45.2%
Calm 54.3%
Confused 45%
Sad 45.4%
Disgusted 45%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.5%
Calm 47.2%
Surprised 45.2%
Angry 45.5%
Confused 45.4%
Disgusted 45.2%
Happy 45.4%
Sad 51.2%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Angry 45.2%
Sad 49.5%
Surprised 45.1%
Confused 45.1%
Calm 48.8%
Disgusted 45%
Happy 46.3%

AWS Rekognition

Age 23-38
Gender Female, 52%
Angry 45%
Disgusted 45%
Calm 45.3%
Sad 54.6%
Surprised 45%
Happy 45%
Confused 45%

AWS Rekognition

Age 26-43
Gender Male, 50.2%
Calm 47.5%
Sad 52.1%
Disgusted 45%
Angry 45.2%
Surprised 45%
Confused 45%
Happy 45.1%

AWS Rekognition

Age 45-63
Gender Male, 54.2%
Calm 49.8%
Sad 49.7%
Confused 45.1%
Angry 45.2%
Disgusted 45%
Happy 45.1%
Surprised 45.1%

AWS Rekognition

Age 45-66
Gender Male, 53.7%
Surprised 45.2%
Calm 46.7%
Disgusted 45.1%
Happy 45.4%
Sad 52%
Angry 45.3%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 53.8%
Happy 45.4%
Confused 45.1%
Angry 45.3%
Sad 48%
Surprised 45.1%
Calm 51%
Disgusted 45.1%

AWS Rekognition

Age 35-53
Gender Male, 51.1%
Surprised 45.2%
Angry 45.2%
Confused 45.1%
Happy 45.3%
Disgusted 45.1%
Sad 46.1%
Calm 53%

AWS Rekognition

Age 35-52
Gender Female, 50%
Surprised 45.1%
Calm 46.8%
Sad 52.6%
Confused 45.2%
Disgusted 45.1%
Happy 45.1%
Angry 45.2%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Painting 93.1%

Categories

Imagga

paintings art 99.8%

Captions

Microsoft
created on 2019-06-26

a painting on the wall 76.7%
a painting on a wall 76.2%
a painting hanging on a wall 76.1%

Text analysis

Amazon

clamans
iarum.
per
deferta
aomino
parate.
cgo clamans Toca per deferta parate. Ventuvo grefpum
Toca
231
grefpum
aomino iarum. Foha.
Ventuvo
cgo
Foha.
serr
Lbui

Google

231 gdeale Mde Vas inuntor Vo ego fum clamans loca per deferta parate venturogreßum domino curfumque Viarum. foha.. .1.. Pride gdea e uangehis le bauit de da doime e dugelz il nes la einGori iau ddreP la ya thmps apr pee S a ut commanct a conrtet rar rout. abrr
231
gdeale
Mde
Vas
inuntor
Vo
ego
fum
clamans
loca
per
deferta
parate
venturogreßum
domino
curfumque
Viarum.
foha..
.1..
Pride
gdea
e
uangehis
le
bauit
de
da
doime
dugelz
il
nes
la
einGori
iau
ddreP
ya
thmps
apr
pee
S
conrtet
rar
a
ut
commanct
rout.
abrr