Human Generated Data

Title

A Beggar Pursued by Dogs, from a manuscript of c. 1615
Date

c. 1615
People

Artist: Unknown Artist,

Classification

Manuscripts
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of John Goelet, 1960.52

Human Generated Data

Title

A Beggar Pursued by Dogs, from a manuscript of c. 1615

People

Artist: Unknown Artist,

Date

c. 1615

Classification

Manuscripts

Machine Generated Data

Tags

Amazon
created on 2019-05-22

Human 99.2
Person 99.2
Person 98.3
Person 98
Person 98
Art 95.9
Person 92.9
Painting 72.4

Clarifai
created on 2019-05-22

people 99.5
painting 99.2
adult 99
woman 98.3
art 96.1
illustration 94.8
man 94.7
child 94.2
group 94.1
wear 94
two 90.9
family 88.8
religion 88.1
print 86.7
one 84.4
veil 84.3
pants 83
furniture 82.7
girl 82.7
three 81

Imagga
created on 2019-05-22

graffito 70.5
decoration 50.6
old 29.9
door 25.8
building 24.4
wall 21.5
architecture 21.1
antique 20.8
art 15.9
vintage 15.7
ancient 15.6
entrance 15.5
retro 14.7
religion 13.4
structure 13.1
culture 12.8
travel 12.7
school 12
street 12
texture 11.8
traditional 11.6
wooden 11.4
town 11.1
grunge 11.1
house 11
city 10.8
urban 10.5
tourism 9.9
comic book 9.8
religious 9.4
window 9.4
stone 9.3
church 9.2
shield 9
doorway 8.8
temple 8.5
frame 8.3
style 8.2
dirty 8.1
man 8.1
history 8
paper 7.8
people 7.8
architectural 7.7
faith 7.7
pattern 7.5
brown 7.4
design 7.3
rough 7.3
armor 7.3
detail 7.2
aged 7.2
sculpture 7.2
box 7.2
textured 7

Google
created on 2019-05-22

Cartoon 86.1
Painting 85.9
Art 85.8
Illustration 83.8
History 73.3
Visual arts 68.6
Miniature 65.2
Watercolor paint 55.4
Child 52

Microsoft
created on 2019-05-22

drawing 98.3
painting 97.1
cartoon 96.6
floor 91.2
child art 85
clothing 84.1
sketch 80.8
person 71.8
illustration 66.2
woman 59.7
book 53.4
old 43.9

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 54%
Sad 49.3%
Surprised 45.6%
Happy 45.7%
Calm 47.7%
Confused 45.7%
Disgusted 45.5%
Angry 45.5%

AWS Rekognition

Age 38-57
Gender Male, 54.5%
Sad 46.6%
Calm 48.8%
Disgusted 46%
Surprised 45.7%
Happy 46%
Angry 46.2%
Confused 45.7%

AWS Rekognition

Age 26-43
Gender Male, 53.9%
Confused 45.5%
Calm 52.1%
Surprised 45.9%
Happy 45.3%
Sad 45.3%
Disgusted 45.3%
Angry 45.6%

AWS Rekognition

Age 9-14
Gender Female, 52.7%
Confused 45.3%
Angry 45.7%
Happy 48.3%
Sad 48.1%
Calm 45.3%
Disgusted 46.7%
Surprised 45.6%

AWS Rekognition

Age 23-38
Gender Male, 54.6%
Disgusted 53.1%
Confused 45.2%
Surprised 45.3%
Calm 45.5%
Happy 45.4%
Angry 45.2%
Sad 45.2%

Feature analysis

Amazon

Person 99.2%
Painting 72.4%

Captions

Microsoft

a group of stuffed animals sitting next to a person 27.1%
a group of people in a room 27%
a person standing next to a stuffed animal 26.9%