Human Generated Data

Title

Saint John the Evangelist
Date

19th century
People

Artist: Paolo Toschi, Italian 1788 - 1854

Artist after: Correggio (Antonio Allegri), Italian c. 1489 - 1534
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3878

Human Generated Data

Title

Saint John the Evangelist

People

Artist: Paolo Toschi, Italian 1788 - 1854

Artist after: Correggio (Antonio Allegri), Italian c. 1489 - 1534

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Person 98.8
Human 98.8
Art 87.3
Painting 83.2
Lute 79.9
Musical Instrument 79.9
Leisure Activities 71.7
Drawing 59.7
Text 55.3

Clarifai
created on 2019-11-07

people 98.5
art 96.8
one 95.3
adult 94.6
no person 92.8
portrait 91.9
painting 90.9
man 87.6
print 86.3
text 84.3
picture frame 84
illustration 82.3
two 78.6
museum 77.9
indoors 77.1
group 76.8
religion 75.5
retro 75
woman 74.7
wear 74.6

Imagga
created on 2019-11-07

money 58.7
currency 55.7
cash 48.5
dollar 48.3
paper 43.2
finance 42.3
bill 40.9
bank 39.5
dollars 37.7
wealth 36.8
banking 36.8
business 35.9
product 31.6
book 31.2
financial 30.3
exchange 27.7
hundred 27.1
bills 26.2
savings 26.1
note 25.8
us 25.1
creation 24.7
pay 24
close 24
banknote 23.3
container 23.1
one 22.4
rich 21.4
investment 21.1
loan 18.2
old 17.4
states 17.4
finances 17.4
payment 17.3
structure 16.6
vintage 16.6
envelope 16.1
sign 15.8
book jacket 15.8
economy 14.8
franklin 14.8
retro 14.8
funds 14.7
wages 14.7
symbol 14.1
number 14
binding 13.6
notes 13.4
profit 13.4
covering 13.2
success 12.9
banknotes 12.7
concepts 12.4
united 12.4
save 12.3
jacket 12.3
brass 12.2
debt 11.6
market 11.5
grunge 11.1
buck 10.8
tray 10.7
economic 10.7
price 10.6
memorial 10.6
capital 10.4
texture 10.4
wrapping 10.3
commerce 10.3
pattern 10.3
closeup 10.1
income 9.7
design 9.5
billboard 9.4
buy 9.4
newspaper 8.9
greenback 8.9
president 8.8
object 8.8
rate 8.8
paying 8.7
value 8.7
receptacle 8.7
post 8.6
frame 8.5
doormat 8.4
stock 8.4
black 8.4
board 8.2
box 8.2
backgrounds 8.1
chalkboard 7.8
monetary 7.8
antique 7.8
invest 7.7
buying 7.7
sales 7.7
card 7.7
pile 7.5
letter 7.3
tile 7.2
drawing 7.1

Google
created on 2019-11-07

Photograph 95.4
Picture frame 92.4
Painting 86.7
Art 78.6
Stock photography 71.8
Illustration 70.1
Room 65.7
Visual arts 62.5
Antique 59
History 54.1
Artwork 52.3
Vintage clothing 50.7

Microsoft
created on 2019-11-07

text 95
person 82.9
statue 78.6
museum 68.5
drawing 51.9
clothing 51.5
picture frame 9.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Female, 54.2%
Calm 49.8%
Fear 47.3%
Disgusted 45.2%
Confused 45.8%
Happy 45.2%
Sad 45.5%
Angry 45.5%
Surprised 45.7%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Painting 83.2%

Captions

Microsoft

an old photo of a cat 29.9%
an old photo of a person 29.8%
an old photo of a person 29.7%

Text analysis

Amazon

CIOVANNE
TOANNES
TOANNES VANGELISTA
VANGELISTA
INT
INT 8. CIOVANNE
hiastro.
8.
parte
parte talla rhinss hiastro.
talla
DTI
rhinss
DTI t
t

Google

SACAFTERIS I0ANNES CELIST A IN S. CIOVANNI sll parts dalls is al histre
SACAFTERIS
I0ANNES
CELIST
A
IN
S.
CIOVANNI
sll
parts
dalls
is
al
histre