Human Generated Data

Title

Pitt's Dream

Date

1799

People

Artist: Anonymous, French French, active 1789-1799

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Jakob Rosenberg Fund, M20161

Human Generated Data

Title

Pitt's Dream

People

Artist: Anonymous, French French, active 1789-1799

Date

1799

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-08

Person 99.6
Human 99.6
Art 95.3
Person 94.5
Painting 78.4
Drawing 76.9
Sketch 59.6
Advertisement 58.5
Poster 58.5
Text 57

Clarifai
created on 2019-11-08

illustration 98.9
people 98.7
painting 98.6
print 98.1
furniture 98
room 97.4
adult 97.2
man 96.8
woman 95.8
art 93.7
indoors 93.6
seat 93.4
house 92.5
lithograph 91.7
exhibition 91.7
family 90.9
wall 90.8
group 90.6
wear 89.8
vintage 89.3

Imagga
created on 2019-11-08

billboard 46.9
signboard 37.2
structure 28.9
newspaper 17.8
sketch 16.9
drawing 16.2
old 16
male 15.6
man 15.5
product 14.9
business 14.6
vintage 14.1
musical instrument 13.8
grunge 13.6
people 12.8
silhouette 11.6
building 11.6
sky 11.5
creation 11.1
black 10.8
percussion instrument 10.8
construction 10.3
retro 9.8
marimba 9.8
design 9.6
person 9.6
office 9.5
architecture 9.4
representation 9.2
travel 9.2
sign 9
transportation 9
technology 8.9
businessman 8.8
men 8.6
winter 8.5
poster 8.5
sport 8.3
snow 8.3
pattern 8.2
landscape 8.2
web site 8.2
paint 8.2
graphic 8
work 8
art 7.8
ancient 7.8
sitting 7.7
money 7.7
card 7.7
ice 7.4
water 7.3
transport 7.3
group 7.3
team 7.2
bank 7.2
equipment 7.2
job 7.1

Google
created on 2019-11-08

Microsoft
created on 2019-11-08

cartoon 98.7
drawing 95
text 94.4
furniture 90.9
painting 89.1
gallery 86.3
clothing 81.4
child art 79.4
person 75
chair 73
room 68.8
table 62.4
sketch 58.4
illustration 51.2
businesscard 19.5

Face analysis

Amazon

Google

AWS Rekognition

Age 25-39
Gender Female, 53.7%
Happy 45.3%
Disgusted 45%
Confused 45%
Calm 54.6%
Fear 45%
Surprised 45%
Sad 45.1%
Angry 45%

AWS Rekognition

Age 43-61
Gender Female, 50.3%
Angry 45.6%
Fear 49.2%
Disgusted 45.3%
Happy 45.3%
Surprised 45.7%
Calm 47.6%
Sad 46%
Confused 45.3%

AWS Rekognition

Age 49-67
Gender Male, 89.8%
Sad 0.9%
Confused 0.1%
Fear 0.4%
Angry 23.7%
Surprised 0.1%
Disgusted 0.1%
Calm 74.5%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 78.4%
Poster 58.5%

Captions

Microsoft

a group of people in a room 56.3%
a group of men in a room 39.8%

Text analysis

Amazon

DE
REVE
compere
REVE DE PITT.
beau
Bravo
PITT.
qu'on
Francois.
B
Anonymous
.Chiit...
le
A. Bravo compere Francois. .Chiit... It fait gpuelgue beau Beve.
Milord,
Reve
de
Courage
aime
It fait
Reve de pit
gpuelgue
Anonymous Frenea
B. Courage Milord, 1l aime le beree.
Beve.
beree.
B.
A.
pit
Frenea
OpCArd
LINTVV
1l
ny
RK

Google

В С ОрсARD REVE DE PITT. fait quelgue beau Réve. A. Brano compere François C. Chit... B. Courage Milord; Il aime qu'on le berce. Anonymous French ca Reve de Pit
С
quelgue
beau
A.
Brano
compere
François
C.
В
ОрсARD
REVE
DE
PITT.
fait
qu'on
le
berce.
ca
Pit
Réve.
French
Reve
Chit...
Milord;
B.
Courage
Il
aime
Anonymous
de