Human Generated Data

Title

Marriage of S. Catherine
Date

1827
People

Artist: Johann Nicolaus Hoff, German 1798 - 1873
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3549

Human Generated Data

Title

Marriage of S. Catherine

People

Artist: Johann Nicolaus Hoff, German 1798 - 1873

Date

1827

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-10

Person 99.4
Human 99.4
Painting 97.6
Art 97.6
Person 96.9
Wood 56.7

Clarifai
created on 2019-08-10

people 99.7
art 99.5
baby 99.2
painting 99
two 98.6
child 98.2
illustration 98.1
religion 97
adult 96.2
woman 96
god 95.7
portrait 95.4
saint 95.3
son 93.9
Renaissance 93.8
print 93.2
Mary 92.4
group 92.2
holy 91.9
three 91.5

Imagga
created on 2019-08-10

sketch 100
drawing 90.7
representation 76.8
currency 31.4
money 28.9
cash 24.7
art 23.5
dollar 23.2
paper 22
finance 19.4
sculpture 19
vintage 19
banking 17.5
bill 17.1
wealth 17.1
business 17
old 16.7
dollars 16.4
stamp 16.3
culture 16.2
bank 16.1
one 14.9
postmark 14.8
letter 14.7
mail 14.4
financial 14.3
antique 14
economy 13.9
envelope 13.7
bills 13.6
post 13.4
close 13.1
savings 13.1
carving 12.8
symbol 12.8
postage 12.8
postal 12.8
banknote 12.6
religion 12.5
history 12.5
ancient 12.1
rich 12.1
banknotes 11.7
museum 11.5
capital 11.4
global 10.9
shows 10.8
printed 10.8
retro 10.6
states 10.6
exchange 10.5
united 10.5
black 10.2
investment 10.1
paintings 9.8
statue 9.8
hundred 9.7
us 9.6
finances 9.6
notes 9.6
fine 9.5
icon 9.5
unique 9.5
man 9.4
religious 9.4
church 9.3
book jacket 9
post mail 8.9
zigzag 8.9
masterpiece 8.9
known 8.9
stamps 8.9
twenty 8.9
renaissance 8.8
product 8.8
closeup 8.8
delivery 8.8
cutting 8.7
painter 8.7
communications 8.6
god 8.6
profit 8.6
architecture 8.6
painted 8.6
grunge 8.5
travel 8.4
stone 8.4
monument 8.4
figure 8.1
newspaper 8.1
detail 8
fame 7.9
wealthy 7.8
portrait 7.8
payment 7.7
pay 7.7
loan 7.7
temple 7.6
creation 7.5
famous 7.4
note 7.4
office 7.2
market 7.1

Google
created on 2019-08-10

Painting 93
Art 86.5
Illustration 82
Picture frame 80.3
Drawing 75
Visual arts 71.1
Stock photography 68.5
Photography 62.4
Artwork 58
Antique 54.2
Sketch 53.6
Still life 52.9
Child 52
Portrait 51.6
Style 51
Modern art 50.6

Microsoft
created on 2019-08-10

gallery 97.8
drawing 96.8
text 93.5
room 92.2
sketch 92.2
baby 89.8
art 86.1
human face 84.7
person 83.3
scene 83
clothing 78
book 53.8
painting 15.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Female, 54.3%
Disgusted 0.1%
Angry 0.3%
Fear 0%
Confused 0.2%
Happy 0%
Calm 98.7%
Surprised 0.5%
Sad 0.1%

AWS Rekognition

Age 9-19
Gender Female, 93.6%
Disgusted 0%
Surprised 0%
Calm 100%
Sad 0%
Happy 0%
Angry 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 15-27
Gender Female, 99.2%
Sad 4.2%
Disgusted 0.3%
Angry 0.5%
Confused 0.6%
Fear 0.7%
Surprised 5%
Happy 0.5%
Calm 88.1%

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 97.6%

Captions

Microsoft

an old photo of a room 62.6%
an old photo of a person 55.3%
an old photo of a person in a room 55.2%

Text analysis

Amazon

da
befinbrt
D
da imei.
ec
oime:
Naglr
imei.
D Grimat 6emside befinbrt Orh ec atnmfuns Drs fifenere Fung SLruenhexf bes oime: Naglr
Grimat
Tthew
Fung
Drs
Orh
atnmfuns
fifenere
SLruenhexf bes
6emside
ay
C img Tthew
img
O
o
C

Google

trursberf
de
J
rs
rfeeng
e
bee
bei
abt
agr
D
befinbet
Samng
d
fir
D Grgine nade befinbet ficb in bee Samng rs rfeeng in trursberf bei abt agr ne d de e fir J
Grgine
nade
ficb
in
ne