Human Generated Data

Title

Holy Family with the family of Alfonse I, Duke of Ferrara
Date

18th century
People

Artist: Étienne Fessard, French 1714 - 1777

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R7319

Human Generated Data

Title

Holy Family with the family of Alfonse I, Duke of Ferrara

People

Artist: Étienne Fessard, French 1714 - 1777

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R7319

Machine Generated Data

Tags

Amazon
created on 2019-11-09

Person 99.4
Human 99.4
Person 98.8
Painting 98.1
Art 98.1
Person 95.4
Person 95.1
Person 94.1
Person 74.6
Portrait 60.2
Photography 60.2
Photo 60.2
Face 60.2
Drawing 58.3

Clarifai
created on 2019-11-09

people 99.9
group 99.5
print 98.8
adult 98.4
child 97.8
art 97.7
woman 97.5
man 97.1
engraving 96.9
son 95.5
portrait 95.4
family 95.2
sit 94.2
illustration 94.1
baby 93.8
four 93.4
lithograph 92.2
affection 91.1
leader 89.7
three 88.4

Imagga
created on 2019-11-09

sketch 45
drawing 35.1
money 34.9
representation 31.3
dollar 30.6
cash 29.3
currency 28.7
kin 28.1
paper 25.1
bank 24.2
finance 23.7
wealth 23.3
statue 22.4
dollars 22.2
banking 22.1
financial 21.4
bill 20.9
business 20.6
ancient 19.9
sculpture 19.2
close 18.8
old 18.1
savings 17.7
bills 17.5
newspaper 17.5
us 17.3
art 17.1
franklin 16.7
hundred 16.5
exchange 16.2
closeup 16.2
history 16.1
one 15.7
daily 15.5
pay 14.4
loan 14.4
rich 14
product 13.8
investment 13.7
banknotes 13.7
creation 13.5
architecture 13.3
vintage 13.2
face 12.8
stone 12.7
banknote 12.6
religion 12.5
finances 12.5
economy 12.1
god 11.5
antique 11.5
symbol 11.4
capital 11.4
church 11.1
states 10.6
profit 10.5
comic book 10.5
religious 10.3
funds 9.8
portrait 9.7
detail 9.7
payment 9.6
decoration 9.5
united 9.5
letter 9.2
design 9.1
carving 9.1
aged 9
sign 9
retro 9
philately 8.9
market 8.9
postmark 8.9
man 8.7
economic 8.7
stamp 8.7
holy 8.7
mail 8.6
card 8.5
world 8.5
historical 8.5
historic 8.2
building 7.9
postage 7.9
postal 7.8
wages 7.8
angel 7.8
legal 7.8
debt 7.7
culture 7.7
famous 7.4
note 7.4
message 7.3
people 7.3
success 7.2
travel 7

Google
created on 2019-11-09

Painting 93.1
Art 80.6
Illustration 79.3
Visual arts 71.1
Stock photography 70.9
Photography 62.4
Prophet 60.1
History 54.1
Drawing 53.7
Picture frame 51.9

Microsoft
created on 2019-11-09

text 100
book 99.6
person 93.6
clothing 91.6
drawing 91.1
human face 86.1
painting 84.2
sketch 83.1
woman 72.4
baby 63.5
cartoon 60.1
posing 40.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 8-18
Gender Female, 84.1%
Happy 0%
Angry 0%
Fear 0%
Surprised 0%
Calm 98.5%
Disgusted 0%
Sad 1.2%
Confused 0.1%

AWS Rekognition

Age 40-58
Gender Male, 99.4%
Disgusted 0%
Happy 0%
Angry 0.1%
Calm 91.2%
Surprised 0.1%
Sad 8.3%
Fear 0%
Confused 0.3%

AWS Rekognition

Age 5-15
Gender Female, 94.7%
Angry 0%
Surprised 0%
Sad 0.2%
Happy 0.2%
Disgusted 0%
Confused 0.1%
Calm 99.5%
Fear 0%

AWS Rekognition

Age 7-17
Gender Female, 95.6%
Disgusted 0.9%
Angry 1.3%
Fear 2.3%
Confused 1.7%
Happy 1.2%
Calm 80.5%
Sad 6.5%
Surprised 5.7%

AWS Rekognition

Age 22-34
Gender Male, 53.4%
Happy 45%
Calm 54.3%
Disgusted 45%
Angry 45%
Surprised 45%
Confused 45%
Sad 45.7%
Fear 45%

AWS Rekognition

Age 49-67
Gender Male, 98.8%
Angry 1.1%
Happy 0.1%
Calm 58.6%
Sad 32.6%
Disgusted 0.2%
Fear 0.8%
Surprised 0.6%
Confused 6%

Microsoft Cognitive Services

Age 42
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 69
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Painting 98.1%

Categories

Imagga

paintings art 90.8%
people portraits 8.9%

Text analysis

Amazon

Galleria
Reale
du
di
Gallerie
Tiziano
dalla
Dresde
Vecelli
Cavato
de
Haut
Royale
Ouadro
Ouadro di Tiziano Vecelli Tableau du Tilien
Large
Cavato dalla Galleria Reale di Dresda de lia Gallerie Royale de Dresde N TO.
lia
Onc:
Tilien
Tableau
Pieds
Allo
Dresda
Onc9
5. Preds
Piedi
Allo Piedi Onc: 1. T.argo Piede 5. Onc9 Haut Pieds 1. Poue : Large 5. Preds poue
Piede 5.
T.argo
1.
N TO.
poue
Poue :

Google

E nnand Soulp Quadro di Tiziano Vecelli Cavalo dalla Galleria Reale di Dresda Allo Piedi 4 One: 1. Largo Piedi 5. One 9 Tableau du Tihen de la Gallerie Royale de Dresde Ne 1. Poue: Large 5. Preds 9. Poue Haul 4.Preds
E
nnand
Soulp
Quadro
di
Tiziano
Vecelli
Cavalo
dalla
Galleria
Reale
Dresda
Allo
Piedi
4
One:
1.
Largo
5.
One
9
Tableau
du
Tihen
de
la
Gallerie
Royale
Dresde
Ne
Poue:
Large
Preds
9.
Poue
Haul
4.Preds