Human Generated Data

Title

S. John the Evangelist
Date

19th century
People

Artist: Johann Friedrich Wilhelm Müller, German 1782 - 1816

Artist after: Domenico Zampieri, called Domenichino, Italian 1581 - 1641
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R5369

Human Generated Data

Title

S. John the Evangelist

People

Artist: Johann Friedrich Wilhelm Müller, German 1782 - 1816

Artist after: Domenico Zampieri, called Domenichino, Italian 1581 - 1641

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 98.6
Person 98.6
Art 95.9
Painting 67.6

Clarifai
created on 2019-11-16

people 99
portrait 98.6
art 98.1
woman 97.9
adult 97.6
illustration 96.5
retro 94.9
painting 94.4
picture frame 94.3
one 91.6
desktop 89.5
bill 89
girl 87.7
man 87.6
print 86.2
blank 86.2
person 86
paper 84.6
head 83.1
vintage 82.9

Imagga
created on 2019-11-16

sketch 69.1
drawing 50.8
representation 48.8
money 31.5
currency 28.7
cash 28.4
book jacket 27.8
dollar 24.2
jacket 21.6
banking 21.2
bill 20.9
product 20.7
bank 20.6
creation 20
paper 19.6
wealth 18.9
close 18.8
one 18.7
newspaper 18.3
portrait 18.1
finance 17.8
business 17
financial 16.9
savings 16.8
wrapping 16.4
dollars 16.4
art 14.7
face 14.2
closeup 14.2
symbol 14.1
vintage 14.1
hundred 13.6
black 13.2
culture 12.8
franklin 12.8
bills 12.6
banknote 12.6
finances 12.5
exchange 12.4
economy 12.1
banknotes 11.8
covering 11.6
us 11.6
pay 11.5
loan 11.5
museum 11.1
printed 10.8
stamp 10.8
states 10.6
mail 10.5
sexy 10.4
rich 10.3
model 10.1
investment 10.1
man 10.1
postmark 9.9
postage 9.8
market 9.8
envelope 9.6
fine 9.5
hair 9.5
painter 9.4
letter 9.2
pretty 9.1
attractive 9.1
fashion 9.1
people 8.9
masterpiece 8.9
known 8.9
shows 8.9
detail 8.9
sculpture 8.8
renaissance 8.8
postal 8.8
daily 8.8
paintings 8.8
statue 8.7
painted 8.6
post 8.6
united 8.6
capital 8.5
unique 8.5
expression 8.5
note 8.3
person 8.1
icon 7.9
post mail 7.9
zigzag 7.9
fame 7.9
stamps 7.9
antique 7.8
ancient 7.8
delivery 7.8
economic 7.8
cutting 7.7
debt 7.7
payment 7.7
old 7.7
communications 7.7
head 7.6
global 7.3
office 7.2
body 7.2
adult 7.1
male 7.1

Google
created on 2019-11-16

Photograph 96.3
Painting 86.2
Picture frame 85.7
Art 79.6
Portrait 79.2
Visual arts 68.6
Room 65.7
Photography 62.4
Drawing 60.7
Stock photography 59.4
Illustration 57.7
Artwork 54.3
Modern art 54.3

Microsoft
created on 2019-11-16

drawing 99.2
painting 98.1
gallery 97.8
sketch 97.6
scene 97
room 96.9
human face 89.2
indoor 87.1
text 86.8
art 82.2
person 80.4
clothing 75.9
woman 73.7
portrait 60.5
picture frame 43.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-20
Gender Female, 98.3%
Happy 0.3%
Confused 2.1%
Calm 63.8%
Fear 2.5%
Angry 0.9%
Sad 27.6%
Surprised 2.3%
Disgusted 0.6%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Painting 67.6%

Captions

Microsoft

an old photo of a person 61.1%
an old photo of a person 57.6%
a person taking a selfie in a room 51.1%

Text analysis

Amazon

Mailler
ehan
Schallr
Da
Mlenster
ater
Da Lawe drs Fopl ihusn
aeich
Tolannen
Lawe
Leimem
M ater NL Mlenster Le ehan Gothan. Mailler
o
Gothan.
drs
lil er
lle lil er aeich dene Tolannen Schallr
Kerrme
Fopl ihusn
omnathe.
grandamd
ddo
Le
fkh ddo omnathe. am Kerrme grandamd o hesare
dene
am
lle
NL
hesare
fkh
M

Google

am
Tage
Fnt
er
aneManster
Miller-
Da
des
eine
dite
Siie
Pafaunen
Apal1
than
gevith
Heres
list
rine
Schalle.
Iater
f
ich
is
mir
dew
Tehan
dserr
Da gevith ich am Tage des Heres is eine Fnt xiikun dite list er mir rine Siie deich dew Pafaunen Schalle. Apal1 Leinem Iater aneManster Tehan than Miller- f deGealde dealang dserr
xiikun
deich
Leinem
deGealde
dealang