Human Generated Data

Title

Album Leaf of Figures
Date

17th-19th century
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.924.1

Human Generated Data

Title

Album Leaf of Figures

People
Date

17th-19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Art 99.3
Painting 99.3
Human 97.2
Person 97.2
Person 96
Person 94.2
Person 89.2
Mammal 60.8
Animal 60.8
Horse 60.8

Clarifai
created on 2019-05-31

painting 99.7
people 99.6
adult 99.5
art 99.1
man 97.2
illustration 95.2
group 94.8
mammal 93.7
woman 93.1
no person 93.1
one 89.6
child 88.8
print 88.5
sand 87.7
desert 86
recreation 85.8
veil 85.6
wear 84.9
motion 81.3
cave 80.6

Imagga
created on 2019-05-31

sand 96
soil 55
earth 41
desert 39
rock 33
landscape 27.5
travel 26.7
mountain 25.9
outdoors 24.7
stone 23.6
canyon 18.8
mountains 17.6
tourism 17.3
sky 16.6
geology 16.5
summer 15.4
dune 15.3
rocks 15.1
sea 15
park 14.8
scenic 14
beach 13.8
adventure 13.3
vacation 13.1
sandstone 12.5
outdoor 12.2
hill 12.2
wall 11.8
valley 11.7
ocean 11.6
ancient 11.2
wilderness 11.2
day 11
national 10.9
sun 10.5
dry 10.2
natural 10
geological 9.8
texture 9.7
cave 9.6
extreme 9.6
brown 9.6
cliff 9.5
stones 9.5
water 9.3
orange 9.2
burlap 9
ascent 8.9
drought 8.9
arid 8.8
monument 8.4
people 8.4
wild 7.8
erosion 7.8
high 7.8
hike 7.8
scenics 7.6
heat 7.4
coast 7.2
holiday 7.2
river 7.1
slope 7

Google
created on 2019-05-31

Painting 89.1
Art 85
Visual arts 83.2
Watercolor paint 74.8
Drawing 69.7
Illustration 62.3

Microsoft
created on 2019-05-31

drawing 99.5
painting 97.8
sketch 97.1
child art 94.9
cartoon 88.7
outdoor 86.6
art 72

Face analysis

Amazon

AWS Rekognition

Age 35-52
Gender Male, 53.4%
Calm 49.6%
Disgusted 45.7%
Sad 46%
Surprised 46%
Happy 46.5%
Confused 45.4%
Angry 45.8%

AWS Rekognition

Age 17-27
Gender Male, 54.2%
Disgusted 45.3%
Calm 48.1%
Surprised 45.4%
Angry 45.5%
Happy 49%
Sad 45.9%
Confused 45.7%

AWS Rekognition

Age 23-38
Gender Female, 53.2%
Confused 45.2%
Angry 45.7%
Sad 45.6%
Calm 45.3%
Disgusted 45.6%
Happy 52.3%
Surprised 45.4%

AWS Rekognition

Age 11-18
Gender Female, 51.1%
Angry 45.8%
Calm 50.5%
Sad 46.3%
Surprised 45.9%
Disgusted 45.5%
Happy 45.7%
Confused 45.4%

Feature analysis

Amazon

Painting 99.3%
Person 97.2%
Horse 60.8%

Captions

Microsoft

a group of sheep standing on top of a mountain 33.2%
a group of sheep standing on top of a hill 25.9%
a group of people standing on top of a mountain 25.8%