Human Generated Data

Title

The Innocence of Joseph
Date

1812
People

Artist: Conte Carlo Lasinio, Italian 1759 - 1838

Artist after: Benozzo Gozzoli, Italian 1420 - 1497
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G2172

Human Generated Data

Title

The Innocence of Joseph

People

Artist: Conte Carlo Lasinio, Italian 1759 - 1838

Artist after: Benozzo Gozzoli, Italian 1420 - 1497

Date

1812

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G2172

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 98.4
Person 98.4
Person 97.6
Person 97.4
Person 96.6
Person 95.3
Person 95.3
Art 94.8
Person 93.2
Drawing 93.1
Person 88
Person 86.3
Painting 85.6
Person 85.2
Person 84.5
Sketch 83.9
Person 74.6
Person 70.1
Text 67.1
Building 64.5
Architecture 64.5
Person 60.9
People 58.9
Mansion 56
House 56
Housing 56
Person 54.3
Person 52.7
Person 49.8

Clarifai
created on 2019-11-07

art 98.3
illustration 98.3
print 98.3
architecture 98
building 96.4
people 95.7
vintage 95.4
no person 94.3
city 93.8
town 93.3
old 92.7
retro 91.9
engraving 91
antique 90.8
ancient 89.7
group 89.2
travel 89.1
house 87.6
outdoors 86.3
classic 86

Imagga
created on 2019-11-07

sketch 40.5
architecture 36.3
drawing 35.3
structure 34.1
treasury 31.2
building 30.5
history 29.5
landmark 27.1
representation 26.1
ancient 25.9
depository 24.2
memorial 23.2
old 23
vintage 22.3
historic 22
city 21.6
sculpture 20.5
antique 18.9
facility 18.8
grunge 17.9
art 17.7
famous 17.7
travel 17.6
tourism 17.3
paper 16.5
old fashioned 16.2
monument 15.9
house 15.6
retro 15.6
statue 15.5
historical 15.1
arch 14.9
religion 14.3
church 13.9
menorah 13.7
capital 13.3
altar 13.1
sky 12.8
tower 12.5
column 12.3
stucco 12.3
culture 12
texture 11.8
stone 11.8
symbol 11.4
design 11.3
money 11.1
candelabrum 11
aged 10.9
facade 10.8
cathedral 10.7
palace 10.6
style 10.4
triumphal arch 10.4
wall 10.3
finance 10.1
ornate 10.1
currency 9.9
grime 9.8
us 9.6
artistic 9.6
grain 9.2
cash 9.2
business 9.1
marble 9
bank 9
decoration 8.8
crumpled 8.7
urban 8.7
pay 8.6
bill 8.6
construction 8.6
candlestick 8.4
dollar 8.4
town 8.3
frame 8.3
street 8.3
snow 7.8
government 7.8
gate 7.8
ornament 7.8
grave 7.7
winter 7.7
wallpaper 7.7
worn 7.6
banking 7.4
wealth 7.2

Google
created on 2019-11-07

Text 88.1
History 71.8
Paper 69.5
Illustration 68.1
Drawing 66.9
Art 65.5
Paper product 65.2
Stock photography 62.1
Visual arts 55
Antique 54.2
Artwork 52.3

Microsoft
created on 2019-11-07

text 98.3
drawing 96.6
sketch 90.8
illustration 72.3
old 56.5
altar 18.7
arch 17.9

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 27-43
Gender Female, 50.3%
Confused 49.5%
Calm 49.5%
Sad 49.5%
Surprised 49.5%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%
Angry 50.5%

AWS Rekognition

Age 39-57
Gender Male, 50.3%
Fear 50.3%
Sad 49.7%
Disgusted 49.5%
Calm 49.5%
Angry 49.5%
Happy 49.5%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 23-37
Gender Male, 50.4%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Surprised 50.2%
Calm 49.6%
Sad 49.5%
Fear 49.5%
Disgusted 49.5%

Feature analysis

Amazon

Person 98.4%
Painting 85.6%

Categories

Imagga

paintings art 97.4%
interior objects 1.6%

Captions

Microsoft
created on 2019-11-07

an old photo of a building 78%
an old photo of a person 63.7%
old photo of a building 63.6%

Text analysis

Amazon

GIUSEPPE)
(DI
Ani
DE
(INOCEZ) (DI GIUSEPPE) CE) DE (JOSEPHI
CE)
(INOCEZ)
Malagbe
oli.
Gamrhe
(JOSEPHI
ar
(rin
dlilie
nim
Gamrhe lohrve dlilie Malagbe 2.(
rnon
aanhee
Bevira
aanhee oli. Sinshhh feaih Dinettor hl. Ani (rin emiin fmmnr Bevira
lohrve
Ihlrh
el
hl.
2.(
Sinshhh
die
Lar'mmtieme.t
Lar'mmtieme.t rnon die nim /ne C
Dinettor
emiin
feaih
fmmnr
/ne
C

Google

(INNOCENZA) (DI GISEP PE) (1NNOCEN CE) DE (JOSsEPH) deleMedagl
(INNOCENZA)
(DI
GISEP
PE)
(1NNOCEN
CE)
DE
(JOSsEPH)
deleMedagl