Human Generated Data

Title

Boy Playing a Pipe
Date

18th century
People

Artist: C. D. G. Rockstroh, German 18th-19th centuries
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R14284

Human Generated Data

Title

Boy Playing a Pipe

People

Artist: C. D. G. Rockstroh, German 18th-19th centuries

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-10

Human 96.9
Person 96.9
Art 92.2
Painting 90.7
Leisure Activities 73.6
Drawing 58.4

Clarifai
created on 2019-08-10

people 99.9
portrait 99.6
one 99.1
print 98.5
engraving 98.3
antique 97.8
vintage 97.7
retro 97.5
adult 97.5
man 96.9
old 96.7
art 96.3
paper 90.2
wear 89.1
writer 87.1
leader 85.4
illustration 83.8
music 80.3
chair 80
book bindings 75.6

Imagga
created on 2019-08-10

book jacket 94.1
jacket 73.2
wrapping 55.6
covering 38.7
money 34.9
currency 33.2
cash 32.1
dollar 29.7
bank 25.1
bill 24.8
finance 24.5
banking 23
paper 22.9
art 21.6
wealth 19.8
one 17.9
financial 17.8
savings 17.7
close 17.1
ancient 16.4
business 16.4
culture 16.3
dollars 15.5
exchange 15.3
face 14.9
vintage 14.9
portrait 13.6
banknote 13.6
hundred 13.6
us 13.5
loan 13.4
history 13.4
old 13.2
sculpture 13
note 12.9
religion 12.6
statue 12.5
antique 12.1
economy 12.1
investment 11.9
pay 11.5
rich 11.2
architecture 10.9
franklin 10.8
postage 10.8
closeup 10.8
banknotes 10.8
stamp 10.7
finances 10.6
mail 10.5
success 10.5
decoration 10.4
symbol 10.1
product 9.9
postmark 9.9
postal 9.8
bills 9.7
god 9.6
design 9.5
tattoo 9.4
famous 9.3
church 9.3
historic 9.2
museum 8.9
masterpiece 8.9
twenty 8.9
president 8.8
stone 8.6
post 8.6
fine 8.6
temple 8.5
sketch 8.5
creation 8.5
religious 8.4
monument 8.4
figure 8.3
letter 8.3
man 8.1
envelope 8
renaissance 7.9
economic 7.8
pound 7.7
spirituality 7.7
notes 7.7
human 7.5
commerce 7.5
black 7.2
drawing 7.2
market 7.1
male 7.1

Google
created on 2019-08-10

Musical instrument 76.3
Flautist 76
Art 74
Painting 71.9
Illustration 66.9
Portrait 61.5
Flute 55.8
Woodwind instrument 55
Picture frame 51.3

Microsoft
created on 2019-08-10

text 100
book 100
musical instrument 86.3
trumpet 71.6
drawing 66.9
sketch 57
flute 52.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 95.7%
Fear 0%
Surprised 0.1%
Confused 0.2%
Disgusted 0%
Calm 95.1%
Angry 0.1%
Happy 0.2%
Sad 4.2%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.9%

Captions

Microsoft

a person sitting on top of a book 50.1%
a person sitting on a book 48.2%
a person sitting next to a book 44.7%

Text analysis

Amazon

rovence
Srimoud
yenre
s
pinx:
B169
Chaige:D:sRocferohrnl
Srimoud pinx: Nic G s rovence B169 yenre FC Chaige:D:sRocferohrnl
Nic
G
FC

Google

DsRooferohIT
Srimoud
Nic
1699
Cheite: DsRooferohIT Srimoud pina: Nic Gorvence 3 1699 ene
pina:
ene
Cheite:
Gorvence
3