Human Generated Data

Title

Holy Family

Date

18th century

People

Artist: Philipp Andreas Kilian, German 1714 - 1759

Artist after: Johann Carl Loth, German 1632-1698

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3987

Human Generated Data

Title

Holy Family

People

Artist: Philipp Andreas Kilian, German 1714 - 1759

Artist after: Johann Carl Loth, German 1632-1698

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3987

Machine Generated Data

Tags

Amazon
created on 2019-07-30

Human 99.7
Person 99.7
Person 97.6
Art 97.5
Painting 96.1
Person 95.9
Photo 62.4
Face 62.4
Portrait 62.4
Photography 62.4

Clarifai
created on 2019-07-30

people 99.9
portrait 98.4
adult 98.2
art 98.1
child 96.6
painting 95.9
two 95
baby 93.5
print 93.3
woman 92.8
wear 92.7
group 92.4
one 92.2
man 91.1
family 89
illustration 89
affection 88.8
offspring 85.5
music 83
retro 82.5

Imagga
created on 2019-07-30

money 41.7
sketch 41.5
book jacket 40.4
currency 39.5
cash 35.7
drawing 33.4
dollar 31.6
jacket 31.5
bank 27.8
paper 27.5
representation 27.3
finance 27
financial 25.8
banking 25.8
bill 25.7
wealth 25.1
dollars 25.1
wrapping 23.9
business 23.1
one 22.4
art 20.1
savings 19.6
close 19.4
exchange 19.1
hundred 18.4
finances 18.3
vintage 18.2
covering 17.6
bills 17.5
us 17.4
banknotes 16.6
rich 15.8
sculpture 15.6
product 15.4
economy 14.8
franklin 14.8
investment 14.7
envelope 14.6
banknote 14.6
culture 14.5
loan 14.4
symbol 14.1
postmark 13.8
letter 13.8
stamp 13.7
mail 13.4
profit 13.4
museum 13.3
capital 13.3
creation 13.2
closeup 12.8
postage 12.8
postal 12.8
newspaper 12.7
states 12.6
old 12.5
pay 12.5
fine 12.4
note 11.9
masterpiece 11.9
shows 11.8
printed 11.8
renaissance 11.8
funds 11.8
painter 11.6
post 11.5
known 10.9
paintings 10.8
market 10.7
notes 10.6
antique 10.5
painted 10.5
united 10.5
unique 10.4
ancient 10.4
black 10.2
church 10.2
post mail 9.9
zigzag 9.9
fame 9.9
religion 9.9
history 9.8
delivery 9.7
cutting 9.7
statue 9.6
communications 9.6
icon 9.5
famous 9.3
global 9.1
office 9
circa 8.9
memorial 8.8
man 8.7
economic 8.7
debt 8.7
god 8.6
comic book 8.5
portrait 8.4
commerce 8.4
retro 8.2
daily 8.1
stamps 7.9
value 7.8
payment 7.7
price 7.7
historical 7.5
religious 7.5
historic 7.3
success 7.2
concepts 7.1
face 7.1
brass 7.1
architecture 7

Google
created on 2019-07-30

Microsoft
created on 2019-07-30

text 98.9
wall 97.6
baby 94.6
human face 93.3
person 92.7
clothing 90.4
painting 88.2
drawing 83.3
toddler 69.1
child 64.7
old 63.2
book 61.1
sketch 58.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 99.8%
Sad 55.5%
Confused 4.4%
Disgusted 11.3%
Angry 5.4%
Calm 16.5%
Surprised 2.2%
Happy 4.7%

AWS Rekognition

Age 26-43
Gender Female, 60.6%
Happy 0.3%
Surprised 0.4%
Sad 89.1%
Angry 1.5%
Calm 1.5%
Disgusted 0.5%
Confused 6.8%

AWS Rekognition

Age 48-68
Gender Male, 95.9%
Disgusted 0.2%
Happy 0.3%
Confused 0.9%
Sad 63%
Calm 32.4%
Surprised 0.6%
Angry 2.6%

Microsoft Cognitive Services

Age 29
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Painting 96.1%

Categories

Imagga

paintings art 99.4%

Text analysis

Amazon

Lotti
e
Gatlene
la
Carto
Comnte
Bruhl
huut
Taea
Premie.
ala
ala a la Gatlene e S.E.. nlont'n Ce Premie. Nonifere Comnte De Bruhl
S"Jamille Taea ae Carto Lotti
Ce
S"Jamille
3
pede
Tomily
nlont'n
S.E..
De
a
proriew
Nonifere
Fur
Laryaert
huut De 3 pede proriew Fur a Laryaert
Hy Tomily
ppate
ae
Hy

Google

Carlo Bremier. Mifere Comte DeBruht ott amille e ta Galeri uast de 3 piede poio fur Fra plate
Carlo
Bremier.
amille
de
3
fur
Fra
Mifere
Comte
DeBruht
ott
e
ta
Galeri
uast
piede
poio
plate