Human Generated Data

Title

Holy Family with the Goldfinch

Date

17th century

People

Artist: Schelte Adamsz. Bolswert, Dutch 1586 - 1659

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2262

Human Generated Data

Title

Holy Family with the Goldfinch

People

Artist: Schelte Adamsz. Bolswert, Dutch 1586 - 1659

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2262

Machine Generated Data

Tags

Amazon
created on 2019-08-06

Painting 99.3
Art 99.3
Person 96.3
Human 96.3
Person 95.3
Person 77.9
Person 71.3
Home Decor 56.4

Clarifai
created on 2019-08-06

people 99.9
art 99.5
group 98.7
adult 98.5
baby 98.4
print 97.8
painting 97.5
portrait 96.6
child 96.6
illustration 96.6
religion 96.4
woman 95.3
engraving 94.8
son 94.7
man 94
affection 93.1
reclining 93
two 92.5
one 91.6
book 91.1

Imagga
created on 2019-08-06

sketch 97.5
drawing 69.2
representation 60.7
art 30.6
sculpture 30.5
statue 28.8
architecture 25.5
religion 23.3
ancient 22.5
culture 21.4
history 18.8
stone 17
old 16.7
carving 16.4
god 15.3
figure 15.1
monument 14.9
church 14.8
decoration 14.2
book jacket 14.1
religious 14.1
temple 13.8
holy 13.5
one 12.7
spiritual 12.5
historical 12.2
famous 12.1
detail 12.1
jacket 11.9
historic 11.9
building 11.9
design 11.6
face 11.4
money 11.1
black 10.8
currency 10.8
marble 10.8
antique 10.6
spirituality 10.6
style 10.4
vintage 9.9
catholic 9.7
portrait 9.7
museum 9.7
man 9.6
column 9.4
cash 9.2
landmark 9
cemetery 9
prayer 8.7
window 8.7
artistic 8.7
palace 8.7
golden 8.6
travel 8.5
wrapping 8.3
city 8.3
tourism 8.3
cathedral 8.1
symbol 8.1
carved 7.8
pray 7.8
worship 7.7
meditation 7.7
faith 7.7
roman 7.6
capital 7.6
decorative 7.5
person 7.5
savings 7.5
dollar 7.4
close 7.4
gold 7.4
banking 7.4
artwork 7.3
bank 7.3
people 7.3
wealth 7.2
icon 7.1

Google
created on 2019-08-06

Microsoft
created on 2019-08-06

text 100
book 100
drawing 98.1
painting 97.5
sketch 96.9
person 94.1
human face 93
clothing 76.4
baby 61.8
art 60.2
cartoon 60

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99.2%
Angry 4.3%
Surprised 4.9%
Happy 10.1%
Calm 35.3%
Confused 7.9%
Sad 29%
Disgusted 8.5%

AWS Rekognition

Age 45-63
Gender Male, 78.5%
Surprised 2%
Calm 21.5%
Happy 2.5%
Disgusted 2.1%
Angry 5.8%
Sad 63.3%
Confused 2.8%

AWS Rekognition

Age 20-38
Gender Male, 81.3%
Angry 0.6%
Disgusted 0.1%
Confused 0.3%
Sad 11.4%
Calm 87.4%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 35-55
Gender Female, 96%
Sad 75.2%
Calm 18.5%
Surprised 1.1%
Angry 1.4%
Disgusted 0.9%
Happy 1.2%
Confused 1.7%

AWS Rekognition

Age 26-43
Gender Female, 75.7%
Confused 13.6%
Sad 10.8%
Happy 22.8%
Calm 28.7%
Disgusted 3.8%
Angry 5.9%
Surprised 14.5%

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 34
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.3%
Person 96.3%

Categories

Imagga

paintings art 95.3%
people portraits 3.7%

Captions

Microsoft
created on 2019-08-06

a girl holding a book 40.2%
a person holding a book 40.1%
a person holding a book 40%

Text analysis

Amazon

ESSE
MEE
FILIIS
HOMINV
CVM
DELICIEE MEE ESSE CVM FILIIS HOMINV M. Prou.
DELICIEE
M.
Prou.

Google

DELICIE MEÆ ESSE CVM FILIIS HOMIN VM. Prou. 8. V. n. Ja feerme
Ja
DELICIE
MEÆ
ESSE
CVM
FILIIS
HOMIN
VM.
Prou.
8.
V.
n.
feerme