Human Generated Data

Title

"What do you think of this?..."

Date

1847

People

Artist: Honoré-Victorin Daumier, French 1808-1879

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Carl Pickhardt, Class of 1931, M17366

Human Generated Data

Title

"What do you think of this?..."

People

Artist: Honoré-Victorin Daumier, French 1808-1879

Date

1847

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Carl Pickhardt, Class of 1931, M17366

Machine Generated Data

Tags

Amazon
created on 2019-11-05

Human 99.6
Person 99.6
Art 96.1
Person 92.8
Person 92.6
Drawing 89.5
Painting 82.6
Sketch 80
Poster 77.5
Advertisement 77.5

Clarifai
created on 2019-11-05

people 100
engraving 99.8
print 99.8
group 99.5
adult 99.2
art 99.1
two 98.7
illustration 98.6
man 96.4
wear 95.8
three 93.9
leader 93.2
administration 92.9
painting 92.5
etching 91.9
portrait 91.7
veil 91.5
royalty 91.2
offspring 91
child 90.3

Imagga
created on 2019-11-05

art 36.2
money 25.5
currency 23.3
sketch 22.6
paper 22.1
close 20.5
cash 20.1
vintage 19.9
dollar 19.5
drawing 19.3
old 18.8
mosaic 18.7
finance 18.6
bill 18.1
banking 17.5
financial 16.9
tray 16.5
container 16.4
tile 15.8
religion 15.2
bank 15.2
business 14.6
wealth 14.4
representation 14
design 13.8
detail 13.7
stamp 13.5
mail 13.4
receptacle 13.3
ancient 13
letter 12.8
culture 12.8
one 12.7
architecture 12.6
dollars 12.5
us 12.5
history 12.5
decoration 12.4
gold 12.3
retro 12.3
savings 12.1
postage 11.8
postal 11.8
banknote 11.6
concepts 11.5
antique 11.4
post 11.4
religious 11.2
church 11.1
postmark 10.8
creation 10.8
hundred 10.6
texture 10.4
envelope 10.3
wall 10.3
china 10.2
portrait 9.7
sculpture 9.7
pattern 9.6
golden 9.4
closeup 9.4
symbol 9.4
rich 9.3
face 9.2
note 9.2
style 8.9
president 8.8
banknotes 8.8
ornament 8.6
god 8.6
exchange 8.6
grunge 8.5
black 8.4
investment 8.2
icon 7.9
printed 7.9
artistic 7.8
states 7.7
holy 7.7
card 7.6
painted 7.6
united 7.6
temple 7.6
commerce 7.5
economy 7.4
color 7.2
vessel 7.1

Google
created on 2019-11-05

Drawing 81.6
Art 74
Sketch 69.6
Illustration 69.1
Visual arts 55
Artwork 53.4
Painting 51.9

Microsoft
created on 2019-11-05

text 99.9
sketch 99.9
drawing 99.8
book 99.5
painting 91.5
child art 87.7
cartoon 79.8
clothing 78.2
person 77.5
photograph 65.6
engraving 55.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-56
Gender Male, 54.2%
Angry 45.3%
Disgusted 45%
Happy 45.1%
Sad 45%
Calm 54.6%
Fear 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 23-37
Gender Male, 52.6%
Disgusted 45%
Confused 45%
Happy 46.7%
Angry 45.3%
Calm 46.7%
Fear 46.6%
Surprised 49.6%
Sad 45.1%

AWS Rekognition

Age 27-43
Gender Female, 50.3%
Happy 45%
Surprised 45.1%
Confused 45%
Calm 45%
Angry 54.6%
Fear 45.1%
Disgusted 45%
Sad 45%

AWS Rekognition

Age 25-39
Gender Male, 52.3%
Calm 47.8%
Angry 51.2%
Disgusted 45.1%
Fear 45.2%
Surprised 45.2%
Happy 45.2%
Sad 45.2%
Confused 45.1%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 82.6%
Poster 77.5%

Categories

Imagga

paintings art 94.5%
interior objects 5.2%

Captions

Microsoft
created on 2019-11-05

a close up of a book 41.2%
close up of a book 35.7%
a person holding a book 35.6%

Text analysis

Amazon

BONS
lait
LES
LES BONS BOURGEOIS.
dait
Saint
du
ne
BOURGEOIS.
jamais
mne
saint
de
vous
jenaipas
avis,
flatte
votre
que
-' L'omment hrauve. vous ce Saint la.... je mne flatte que jenaipas lait du pansif..
je
Raureois.- Je siis de votre avis, uin saint ne dait jamais ayoir jair poussr/..
ayoir
pansif..
hrauve.
un
jair
3/
ce
Raureois.-
poussr/..
uin
la....
-' L'omment
N!' 80.
hele
Je siis
r la Reeae
ISa hele IV r la Reeae un
IV
ISa

Google

LES BONS BOURGEOIS N" 80. Sa lele elaRw Conment Irauve-vaus ce Saint la...e me flate que je nai pas lait du pansil Le Bourgeois- Je suis de votre avis, un samt ne dait jamais avoir Tair poussil 3/X7
LES
BONS
Sa
Irauve-vaus
la...e
flate
nai
lait
Bourgeois-
suis
de
votre
avis,
un
BOURGEOIS
N"
80.
lele
elaRw
Conment
ce
Saint
me
que
je
pas
du
pansil
Le
Je
samt
ne
dait
jamais
avoir
Tair
poussil
3/X7