Human Generated Data

Title

The Hermit

Date

19th century

People
Classification

Paintings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Selma Munsterberg in memory of Hugo Munsterberg, BR30.56

Human Generated Data

Title

The Hermit

People
Date

19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Painting 99.8
Art 99.8
Person 94.6
Human 94.6
Building 68.3
Housing 68.3
Nature 67.9
Outdoors 59.8

Clarifai
created on 2020-04-23

art 99.4
people 99.4
painting 99.2
woman 98.8
man 98.5
adult 97.3
religion 96.5
two 93.6
one 93.3
Renaissance 92.9
saint 92.8
group 92.1
veil 91.6
pain 90.3
no person 88.8
illustration 88.6
nude 87.7
sculpture 86.5
Mary 86.3
church 84.7

Imagga
created on 2020-04-23

ancient 42.4
architecture 41.6
stone 39.1
old 38.4
building 31.6
history 31.3
grave 30.1
travel 26.8
cave 25.1
tunnel 24.8
tourism 24.8
temple 23.7
wall 23.5
column 22.7
vault 22.3
cemetery 21.7
monument 21.5
historical 20.7
historic 20.2
roof 20.1
rock 20
landmark 19
famous 18.6
arch 17.6
culture 17.1
structure 16.9
city 16.7
religion 15.3
dark 15.1
town 14.9
protective covering 14.1
cell 13.8
tourist 13.7
ruin 13.6
light 13.4
church 13
inside 12.9
passage 12.3
sculpture 12.1
house 12.1
ruins 11.7
geology 11.7
mystery 11.5
passageway 11.3
brick 10.7
geological formation 10.7
art 10.6
entrance 10.6
scene 10.4
construction 10.3
statue 10.2
earth 10.1
park 9.9
limestone 9.9
vacation 9.8
canyon 9.8
heritage 9.7
door 9.5
stones 9.5
covering 9.3
way 9.2
traditional 9.2
landscape 8.9
formations 8.9
underground 8.9
darkness 8.8
castle 8.8
gate 8.8
water 8.7
under 8.7
god 8.6
religious 8.4
outdoor 8.4
east 8.4
exterior 8.3
sky 8.3
national 8.2
natural 8
mountain 8
interior 8
urban 7.9
corridor 7.9
columns 7.9
day 7.9
fort 7.9
tree 7.8
mysterious 7.8
past 7.8
architectural 7.7
facade 7.6
buildings 7.6
rocks 7.5
site 7.5
window 7.3
memorial 7.3
home 7.2
wet 7.2
fortress 7.1

Google
created on 2020-04-23

Microsoft
created on 2020-04-23

painting 99.5
drawing 89.1
building 80.4
art 65.1
person 56.7
fireplace 46.4

Face analysis

Amazon

AWS Rekognition

Age 22-34
Gender Male, 54.3%
Happy 45%
Calm 54.7%
Disgusted 45%
Surprised 45%
Confused 45%
Angry 45%
Fear 45%
Sad 45.2%

AWS Rekognition

Age 21-33
Gender Female, 51.7%
Surprised 45.8%
Angry 50.4%
Happy 45.5%
Fear 46%
Calm 46.2%
Sad 45.5%
Disgusted 45.4%
Confused 45.3%

Feature analysis

Amazon

Painting 99.8%
Person 94.6%

Captions

Microsoft

a group of people standing next to a fireplace 29.2%
a person standing next to a fireplace 28.2%