Human Generated Data

Title

Secretary of the Peasants in Rome

Date

1810

People

Artist: Bartolomeo Pinelli, Italian 1781 - 1835

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor C. E. Norton, M75

Human Generated Data

Title

Secretary of the Peasants in Rome

People

Artist: Bartolomeo Pinelli, Italian 1781 - 1835

Date

1810

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor C. E. Norton, M75

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 98.4
Person 98.4
Person 95.6
Art 93.2
Painting 82.5
Person 75.6
Shoe 74
Clothing 74
Footwear 74
Apparel 74
Drawing 73.6
Poster 62.4
Advertisement 62.4
Person 60.1
Sketch 58.1

Clarifai
created on 2019-11-07

people 100
print 99.9
illustration 99
group 98.8
engraving 98.6
art 98.2
man 97.3
adult 97.3
administration 94.2
woodcut 93.2
leader 92.7
military 90.8
vintage 90.1
soldier 90
many 89.4
two 89.2
several 88.9
war 88
old 86.3
vehicle 85.8

Imagga
created on 2019-11-07

drawing 100
sketch 100
representation 86.4
comic book 23.6
paper 22
currency 21.5
vintage 21.5
plan 19.9
old 18.8
money 18.7
design 18
retro 17.2
grunge 17
finance 16.9
economy 16.7
business 16.4
antique 15.8
art 15.8
dollar 14.9
banking 14.7
architecture 14.1
ancient 13.8
cash 13.7
house 13.4
financial 13.4
map 12.9
building 12.7
history 12.5
construction 12
wealth 11.7
bank 11.6
project 11.5
close 11.4
idea 10.7
architect 10.6
us 10.6
travel 10.6
pattern 10.3
frame 10.1
decorative 10
texture 9.7
geography 9.6
black 9.6
capital 9.5
print media 9.4
rich 9.3
puzzle 9.2
investment 9.2
shape 9
structure 8.9
world 8.9
detail 8.9
interior 8.8
decoration 8.8
blueprint 8.8
home 8.8
dollars 8.7
bill 8.6
savings 8.4
city 8.3
painting 8.1
success 8
graphic 8
designer 7.7
wall 7.7
diagram 7.7
profit 7.7
pencil 7.6
silhouette 7.5
letter 7.3
earth 7.3
global 7.3
aged 7.2
border 7.2
market 7.1
atlas 7.1

Google
created on 2019-11-07

Cartoon 82
Illustration 78.7
Art 76.7
Drawing 66.9
Artwork 59.1
Printmaking 58.5
Sketch 54.4
History 54.1

Microsoft
created on 2019-11-07

nintendo 100
text 100
book 99.8
drawing 98.3
sketch 97.6
cartoon 91.7
person 89.8
clothing 84.1
illustration 82.8
man 73.3

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 16-28
Gender Male, 53.8%
Calm 53.7%
Fear 45%
Confused 45.4%
Sad 45.2%
Happy 45%
Surprised 45.3%
Angry 45.3%
Disgusted 45%

AWS Rekognition

Age 23-35
Gender Male, 93.9%
Disgusted 1.6%
Happy 8.8%
Confused 1.2%
Angry 6.2%
Fear 1.4%
Calm 68.1%
Surprised 1%
Sad 11.8%

AWS Rekognition

Age 14-26
Gender Male, 54.5%
Disgusted 45%
Sad 46.2%
Calm 53.1%
Happy 45%
Fear 45%
Angry 45.1%
Confused 45.4%
Surprised 45.2%

Microsoft Cognitive Services

Age 27
Gender Female

Feature analysis

Amazon

Person 98.4%
Shoe 74%
Poster 62.4%

Categories

Captions

Microsoft
created on 2019-11-07

a close up of a book 61.1%
close up of a book 55.8%
a close up of text on a book 46.5%

Text analysis

Amazon

dei
Contadini
in
Secretario
Roma
Pinelli
Amor
Pinelli inve I Secretario dei Contadini in Roma
J
Core
D J
SOIE Amor Core ArO Anime.
Anime.
ArO
inve
D
v
SOIE
I
uwllt
ht

Google

Aeims.
Scretario
dei
Contadini
in
homa
e
uill
rDNE Amor Core Aeims. ro. 00wwww Pinelli inv l Scretario dei Contadini in homa e incine uill
rDNE
Amor
Core
ro.
00wwww
Pinelli
inv
l
incine