Human Generated Data

Title

Holy Family

Date

19th century

People

Artist: Caterina Piotti-Pirola, Italian ca. 1800 - after 1830

Artist after: Andrea Sacchi, Italian 1599-1661

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3561

Human Generated Data

Title

Holy Family

People

Artist: Caterina Piotti-Pirola, Italian ca. 1800 - after 1830

Artist after: Andrea Sacchi, Italian 1599-1661

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R3561

Machine Generated Data

Tags

Amazon
created on 2019-10-29

Person 97.7
Human 97.7
Person 96.6
Art 92.9
Painting 88.2
Person 80.5
Angel 72.7
Archangel 72.7

Clarifai
created on 2019-10-29

people 99.8
art 98.9
two 98.7
baby 98.4
portrait 98.3
adult 98.2
child 97.1
man 96.8
illustration 96.1
woman 95.7
print 95.3
one 94.1
group 93.5
family 91.3
painting 90.5
Renaissance 90.3
love 89.5
son 89.1
old 86.3
retro 85.9

Imagga
created on 2019-10-29

sketch 46.9
representation 35.7
statue 34.1
drawing 33.8
newspaper 32.7
money 30.7
sculpture 30.1
cash 28.4
currency 26.9
product 25.9
dollar 25.1
creation 24.5
ancient 21.6
religion 21.5
bank 21.5
paper 20.4
dollars 19.3
bill 19
close 18.8
stone 18.8
finance 18.6
banking 18.4
old 18.1
wealth 18
culture 18
one 17.9
art 17.7
business 17
antique 16.5
financial 16
franklin 15.8
hundred 15.5
religious 15
monument 15
us 14.5
history 14.3
architecture 14.1
savings 14
banknote 13.6
face 13.5
pay 13.4
carving 13.3
historic 12.8
marble 12.7
banknotes 12.7
states 12.6
finances 12.5
loan 12.5
exchange 12.4
vintage 12.4
capital 12.3
closeup 12.1
bills 11.7
united 11.4
detail 11.3
rich 11.2
portrait 11
decoration 11
god 10.5
temple 10.5
economy 10.2
catholic 9.7
payment 9.6
symbol 9.4
famous 9.3
travel 9.2
figure 9.1
tourism 9.1
book jacket 9.1
reflection 9
people 8.9
man 8.8
debt 8.7
kin 8.6
historical 8.5
church 8.3
human 8.3
picture 8
president 7.9
holy 7.7
spirituality 7.7
profit 7.7
head 7.6
column 7.5
number 7.5
note 7.4
investment 7.3
building 7.1
market 7.1
male 7.1
jacket 7.1

Google
created on 2019-10-29

Microsoft
created on 2019-10-29

baby 97.1
human face 94.3
text 93.5
painting 91.1
art 89.4
drawing 86.4
person 81.5
room 72.3
museum 72
sketch 67.2
toddler 61.6
gallery 52
picture frame 39.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-30
Gender Female, 99.6%
Confused 0.4%
Fear 3.4%
Sad 27.1%
Disgusted 0.7%
Calm 66.3%
Happy 1.1%
Angry 0.8%
Surprised 0.2%

AWS Rekognition

Age 24-38
Gender Male, 94.6%
Sad 4%
Happy 5.9%
Angry 32.2%
Confused 15.1%
Disgusted 8.9%
Fear 1.1%
Calm 31.6%
Surprised 1.2%

AWS Rekognition

Age 30-46
Gender Female, 95.4%
Fear 0.3%
Angry 0.9%
Confused 1.1%
Calm 71.5%
Sad 1.3%
Happy 22.3%
Surprised 1.3%
Disgusted 1.2%

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Painting 88.2%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2019-10-29

an old photo of a person 62.9%
an old photo of a person 60.3%
old photo of a person 57.7%

Text analysis

Amazon

mperatrice
RRAL
IMPERIALE
ALLA
SACBA IMPERIALE RRAL HAESTI
diMLariarme Tlarolira mperatrice Reginl
Tlarolira
HAESTI
SACBA
Reginl
diMLariarme
KC.
Amshe
Amshe eri
th
th nm
nm
eri
Nh

Google

ALLA SACRA IMPERIALE REALE MAESTA di riana olin Imperatrice Reginca C. pi nghi. eg7 byharb
ALLA
SACRA
IMPERIALE
REALE
MAESTA
di
riana
olin
Imperatrice
Reginca
C.
pi
nghi.
eg7
byharb