Human Generated Data

Title

Ossuary in a Capuchin Church, Rome
Date

late 1870s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3562

Human Generated Data

Title

Ossuary in a Capuchin Church, Rome

People

Artist: Unidentified Artist,

Date

late 1870s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.3562

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Architecture 94.2
Building 94.2
Person 93
Human 93
Bird 92.8
Animal 92.8
Painting 81.4
Art 81.4
Person 80.3
Archaeology 77
Temple 71.5
Shrine 66.9
Worship 66.9
Person 63.3
Crypt 59.5
Pillar 57.4
Column 57.4

Clarifai
created on 2023-10-25

people 99.7
group 98.7
man 97.6
adult 97.5
art 96.6
woman 96.1
architecture 94.8
old 92.8
travel 92.3
two 91.9
ancient 91.6
print 91.2
no person 90
temple 89.4
building 89.1
religion 89
illustration 88.5
stone 85.4
veil 84.9
antique 84.8

Imagga
created on 2022-01-09

architecture 43.9
religion 34.1
mosaic 33.3
old 32
travel 29.6
art 29.2
ancient 28.5
church 26.8
building 25.3
sculpture 24.6
history 24.1
landmark 22.6
stone 21.5
tourism 21.5
historic 21.1
temple 20.2
culture 17.9
transducer 17.7
tile 17.4
religious 16.9
cathedral 16.8
antique 16.3
historical 16
holy 15.4
statue 15.2
monument 14.9
arch 14.6
detail 14.5
famous 14
monastery 13.9
door 13.3
electrical device 13.3
wall 13
spirituality 12.5
faith 12.4
gold 12.3
palace 11.9
catholic 11.8
tourist 11.8
city 11.7
ruins 11.7
device 11.6
god 11.5
structure 11.1
decoration 11.1
tunnel 10.8
vintage 10.8
heritage 10.6
architectural 10.6
golden 10.3
east 10.3
window 10.2
traditional 10
vault 9.5
carving 9.3
town 9.3
aged 9
arches 8.8
pray 8.7
past 8.7
artistic 8.7
medieval 8.6
holiday 8.6
grunge 8.5
chandelier 8.4
texture 8.3
passage 8.3
style 8.2
brown 8.1
interior 8
design 8
sacred 7.8
grand 7.8
worship 7.7
middle 7.7
column 7.5
exterior 7.4
retro 7.4
light 7.4
passageway 7.1
roman 7.1
arabesque 7

Google
created on 2022-01-09

Art 83.4
Font 78.2
Building 72.6
Visual arts 70
Holy places 68.1
Illustration 68.1
Arch 67.9
History 67.5
Monochrome 66.8
Room 66.5
Drawing 65.1
Painting 64.8
Stock photography 62.1
Printmaking 60.9
Monochrome photography 58
Suit 57.8
Pattern 57.6
Rectangle 54.9
Paper product 53.6
Still life photography 52.8

Microsoft
created on 2022-01-09

drawing 96.5
text 95.3
person 82.2
clothing 73.8
illustration 66.4
old 66.1
cartoon 60.4
art 57.4
sketch 55
stone 3.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-33
Gender Male, 93.6%
Calm 56.6%
Fear 35.4%
Disgusted 2.1%
Surprised 2.1%
Sad 1.4%
Angry 1.1%
Confused 0.8%
Happy 0.5%

AWS Rekognition

Age 23-31
Gender Male, 57.6%
Sad 80.8%
Calm 13.4%
Fear 2.2%
Happy 1.4%
Angry 0.7%
Disgusted 0.6%
Confused 0.5%
Surprised 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Bird
Painting
Person 93%
Person 80.3%
Person 63.3%
Bird 92.8%
Painting 81.4%

Captions

Microsoft
created on 2022-01-09

an old photo of a person 60.3%
an old photo of a building 60.2%
old photo of a person 54.5%

Text analysis

Amazon

...
Rome
assuary ... capuckiu trunch
assuary
capuckiu
trunch

Google

Reme
Reme