Human Generated Data

Title

Virgin of Sorrows

Date

18th century

People

Artist: Raphael Morghen, Italian 1758 - 1833

Artist: Vincenzo Biondi, Italian c. 1804 - after 1870

Artist after: Il Sassoferrato, Italian 1609 - 1685

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Fine Arts Library, Harvard University, M22110

Human Generated Data

Title

Virgin of Sorrows

People

Artist: Raphael Morghen, Italian 1758 - 1833

Artist: Vincenzo Biondi, Italian c. 1804 - after 1870

Artist after: Il Sassoferrato, Italian 1609 - 1685

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 98.6
Person 98.6
Apparel 97.1
Clothing 97.1
Bonnet 92.6
Hat 92.6
Art 80.5
Face 75.2
Text 75.2
Drawing 72.6
Advertisement 58.3
Portrait 57.6
Photography 57.6
Photo 57.6
Poster 56.8
Painting 55.9

Clarifai
created on 2019-11-06

people 99.2
portrait 98.9
woman 98.6
one 98.4
adult 97.5
wear 96
art 95.6
girl 89.4
retro 86.7
sepia 85.6
fashion 84.3
antique 82.4
indoors 82
sit 81.6
child 81.5
paper 78.4
veil 76
painting 75.3
book bindings 74.5
old 74.5

Imagga
created on 2019-11-06

representation 23
mug shot 21.2
creation 19.1
photograph 18.9
old 18.8
money 18.7
portrait 18.1
paper 18.1
currency 17.1
vintage 16.5
cash 15.6
adult 15.5
sketch 15.1
people 15.1
bill 14.3
drawing 13.5
hair 13.5
art 13.5
one 13.4
bank 13.4
black 13.4
model 13.2
banking 12.9
culture 12.8
product 12.8
body 12.8
newspaper 12.7
face 12.1
dollar 12.1
letter 11.9
person 11.5
sexy 11.2
finance 11
close 10.8
symbol 10.8
fashion 10.6
wall 10.5
pretty 10.5
ancient 10.4
skin 10.3
wealth 9.9
attractive 9.8
human 9.7
lady 9.7
business 9.7
antique 9.7
museum 9.6
brunette 9.6
grunge 9.4
head 9.2
sensuality 9.1
texture 9
retro 9
financial 8.9
envelope 8.9
postmark 8.9
postage 8.8
postal 8.8
window 8.8
stamp 8.7
mail 8.6
exchange 8.6
savings 8.4
economy 8.3
investment 8.3
sensual 8.2
history 8
office 8
painter 7.9
masterpiece 7.9
known 7.9
printed 7.9
book jacket 7.8
paintings 7.8
banknote 7.8
expression 7.7
memorial 7.7
painted 7.6
post 7.6
fine 7.6
sculpture 7.6
structure 7.6
historical 7.5
figure 7.5
man 7.4
paint 7.2
love 7.1
jacket 7.1

Google
created on 2019-11-06

Microsoft
created on 2019-11-06

human face 98.7
person 96.3
clothing 93.9
woman 92
drawing 86.8
text 84.7
handwriting 79.2
sketch 69.6
art 65.5
portrait 63.3
old 57.3
picture frame 55.5
smile 50.4
room 43.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-33
Gender Female, 83.8%
Disgusted 0.3%
Fear 0.1%
Sad 5%
Happy 0.8%
Surprised 0.7%
Angry 0.7%
Calm 92.2%
Confused 0.3%

Microsoft Cognitive Services

Age 22
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%

Captions

Microsoft

an old photo of a person 47.8%
old photo of a person 40.6%
an old photo of a building 40.5%

Text analysis

Amazon

VERGII
a
DE
Lucca
Duchessa?
seresa
L.A VERGII DE DOLOR1
bliia.
L.A
thama seresa Sfardegnas
Sfardegnas
DOLOR1
thama
B:
Duchessa? Di Lucca 2..
id bliia. B: a Aramjoim:
Di
2..
Wna.oo
Aramjoim:
id

Google

t.A
Voana
ec.
t.A VERGINE DE DOLORI Voana Ierom Duchesea diCacea ce. ec.
ce.
diCacea
VERGINE
DE
DOLORI
Ierom
Duchesea