Human Generated Data

Title

Boy and Girl With a Sparrow
Date

18th century
People

Artist: Pietro Peiroleri, Italian 1741-1777

Artist after: Frans van Mieris the Elder, Dutch 1635 - 1681
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R8890

Human Generated Data

Title

Boy and Girl With a Sparrow

People

Artist: Pietro Peiroleri, Italian 1741-1777

Artist after: Frans van Mieris the Elder, Dutch 1635 - 1681

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 99.1
Person 99.1
Person 99
Art 95.3
Painting 92.5

Clarifai
created on 2019-11-06

people 100
child 99.9
son 99.3
baby 99.1
two 99
offspring 98.8
group 97.1
portrait 96.6
family 96.6
adult 96.2
sibling 94.5
sit 93.7
wear 92.4
three 92.2
affection 91.4
one 90.2
furniture 89.1
woman 88.8
administration 86
facial expression 85.1

Imagga
created on 2019-11-06

money 33.2
cash 31.1
currency 29.6
dollar 24.1
paper 23.5
wealth 21.5
bank 21.5
financial 21.4
culture 21.4
banking 21.1
art 21.1
finance 20.3
bill 20
vintage 19.9
business 19.4
one 19.4
kin 18.5
dollars 18.4
savings 17.7
close 17.7
rich 16.8
old 16.7
ancient 16.4
bills 15.5
postmark 14.8
sculpture 14.7
letter 14.7
stamp 14.5
envelope 14.5
mail 14.4
statue 14.3
face 14.2
closeup 14.2
symbol 14.1
postage 13.8
postal 13.7
banknotes 13.7
portrait 13.6
hundred 13.6
child 13.5
us 13.5
religion 13.4
exchange 13.4
antique 13.1
economy 13
museum 12.9
shows 12.8
franklin 12.8
printed 12.8
renaissance 12.8
states 12.6
finances 12.5
banknote 11.6
history 11.6
fine 11.4
capital 11.4
painter 11.2
church 11.1
note 11
decoration 10.9
masterpiece 10.9
known 10.9
paintings 10.8
retro 10.7
loan 10.5
painted 10.5
post 10.5
united 10.5
mother 10.3
black 10.2
man 10.1
post mail 9.9
zigzag 9.9
fame 9.9
circa 9.9
delivery 9.7
cutting 9.7
pay 9.6
notes 9.6
communications 9.6
profit 9.6
icon 9.5
unique 9.5
architecture 9.5
newspaper 9.4
creation 9.3
investment 9.2
product 9.1
global 9.1
market 8.9
stamps 8.9
office 8.8
funds 8.8
sibling 8.8
letters 8.7
parent 8.6
card 8.5
historical 8.5
religious 8.4
head 8.4
famous 8.4
historic 8.3
people 7.8
stone 7.8
payment 7.7
design 7.6
monument 7.5
detail 7.2
doormat 7.1
travel 7

Google
created on 2019-11-06

Photograph 95.7
Picture frame 92.3
Room 65.7
Illustration 65.5
Stock photography 65.4
Art 62.5
Photography 62.4
Vintage clothing 61.7
Child 61.3

Microsoft
created on 2019-11-06

baby 97.1
text 97
human face 95.5
person 94.9
toddler 93.4
clothing 91.6
child 76.1
picture frame 50.9
old 50.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-20
Gender Female, 97.3%
Fear 0.9%
Confused 16.5%
Happy 1.3%
Angry 1.5%
Disgusted 4.2%
Surprised 0.8%
Calm 32.3%
Sad 42.6%

AWS Rekognition

Age 10-20
Gender Male, 73%
Fear 0%
Surprised 0.1%
Disgusted 0.6%
Calm 93.7%
Angry 0.1%
Happy 5.2%
Sad 0.3%
Confused 0.1%

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 92.5%

Captions

Microsoft

an old photo of a book 50.1%
old photo of a book 46.8%
an old photo of a boy 45.1%

Text analysis

Amazon

Baronis
Domini
grali
incisam
ac
Tabulam
lestimonio,
prepria
animi
Domino
De
Tbier,
cidem
Baronie
inacotbcea Illnstrisssimi Domini Baronis De Tbier, utehi
studio
Tabulam ancam, picla,
inacotbcea
Baronie grali animi ar studio 14111 prepria incisam cidem Domino
ac lestimonio, (.().
picla,
Illnstrisssimi
ancam,
Ctrus
utehi
Ctrus Wauler
14111
(.().
Wauler
ar

Google

247 C Canacotbeca eIlustrissimi Domini Tabulam aneam,c picla, manu Baroni, grati animi studio ac Baronis DeTbiers,uteli propria incisam, cdem Domine lestimonio, D. umillamus ot ohooquentissona Cetrus Cleri iroleri
247
C
Canacotbeca
eIlustrissimi
Domini
Tabulam
aneam,c
picla,
manu
Baroni,
grati
animi
studio
ac
Baronis
DeTbiers,uteli
propria
incisam,
cdem
Domine
lestimonio,
D.
umillamus
ot
ohooquentissona
Cetrus
Cleri
iroleri