Human Generated Data

Title

Pietà

Date

18th century

People

Artist: Francesco Rosaspina, Italian 1762 - c. 1841

Artist after: Correggio (Antonio Allegri), Italian c. 1489 - 1534

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3453

Human Generated Data

Title

Pietà

People

Artist: Francesco Rosaspina, Italian 1762 - c. 1841

Artist after: Correggio (Antonio Allegri), Italian c. 1489 - 1534

Date

18th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3453

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Painting 98.8
Art 98.8
Human 97.2
Person 97.2
Person 96.5
Person 94.6
Person 90.6
Person 89
Person 80.8
Person 78.8
Face 59
Photography 59
Portrait 59
Photo 59
Home Decor 56.8

Clarifai
created on 2019-11-16

people 100
art 99.7
adult 99.5
group 99
woman 98.5
portrait 98.5
man 98.4
one 98.3
two 98.2
print 97.3
nude 96.8
furniture 96.8
painting 95.9
illustration 95.8
baby 93
reclining 92.7
baroque 92.6
elderly 91.8
Renaissance 91.6
three 91

Imagga
created on 2019-11-16

newspaper 39.3
product 38.4
creation 31.4
book jacket 27.4
money 23
cash 22
currency 21.5
jacket 21.3
sculpture 21
bank 19.7
dollar 19.5
art 18.8
statue 17.8
daily 17.4
one 17.2
wrapping 16.2
finance 16
savings 15.8
business 15.8
wealth 15.3
banking 14.7
vintage 14.1
old 13.9
dollars 13.5
man 13.4
paper 12.5
financial 12.5
religious 12.2
architecture 11.7
religion 11.6
history 11.6
hundred 11.6
god 11.5
close 11.4
bill 11.4
covering 11.3
culture 11.1
carving 11.1
investment 11
franklin 10.8
symbol 10.8
us 10.6
finances 10.6
pay 10.5
loan 10.5
book 10.1
antique 9.9
printed 9.8
postage 9.8
banknotes 9.8
figure 9.7
stamp 9.7
detail 9.6
spiritual 9.6
mail 9.6
exchange 9.5
ancient 9.5
sketch 9.5
stone 9.4
rich 9.3
economy 9.3
letter 9.2
representation 9.1
black 9
postmark 8.9
postal 8.8
paintings 8.8
bills 8.7
couch 8.7
kin 8.7
sitting 8.6
post 8.6
unique 8.5
capital 8.5
face 8.5
church 8.3
historic 8.2
sofa 8.1
masterpiece 7.9
known 7.9
shows 7.9
museum 7.9
renaissance 7.9
male 7.8
envelope 7.8
painter 7.8
banknote 7.8
cutting 7.7
drawing 7.7
holy 7.7
saint 7.7
sales 7.7
communications 7.7
fine 7.6
united 7.6
temple 7.6
monument 7.5
closeup 7.4
global 7.3
home 7.2
icon 7.1
portrait 7.1
love 7.1
memorial 7
marble 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

text 99.6
drawing 97.6
painting 97.5
sketch 94.9
person 86.3
art 75.4
old 64.2
gallery 59.6
museum 51.5
posing 50.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 11-21
Gender Female, 97.8%
Surprised 0%
Disgusted 0%
Sad 98.4%
Angry 0.1%
Calm 1%
Happy 0.1%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 13-23
Gender Female, 98.9%
Disgusted 1.3%
Sad 22.7%
Calm 9.2%
Fear 0.9%
Happy 0.3%
Confused 2.5%
Angry 62.8%
Surprised 0.3%

AWS Rekognition

Age 21-33
Gender Female, 71.9%
Angry 1.4%
Happy 0.2%
Disgusted 0.2%
Surprised 0.7%
Fear 0.5%
Sad 52.1%
Confused 0.6%
Calm 44.4%

AWS Rekognition

Age 22-34
Gender Male, 90%
Confused 1.5%
Fear 0.5%
Sad 21.8%
Disgusted 0.5%
Happy 0.2%
Angry 1.3%
Calm 73.3%
Surprised 0.9%

AWS Rekognition

Age 22-34
Gender Female, 53.7%
Surprised 45.8%
Confused 45.7%
Sad 46.4%
Disgusted 45.5%
Angry 47.8%
Calm 46.6%
Fear 46.6%
Happy 45.6%

AWS Rekognition

Age 36-54
Gender Male, 54.5%
Confused 45.1%
Surprised 45.2%
Happy 45.7%
Calm 51.7%
Disgusted 45.2%
Sad 46.5%
Angry 45.5%
Fear 45.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.8%
Person 97.2%

Categories

Imagga

paintings art 97.9%
pets animals 1.8%

Captions

Microsoft
created on 2019-11-16

an old photo of a man 78.9%
old photo of a man 76.5%
a old photo of a man 74.1%

Text analysis

Amazon

erdonande
erkene
Mtee
Plasenthre.
oveypier
erdonande erkene Hasp Enpnii Prrrmae Plasenthre. Qstatlae
Qstatlae
Irsum
Enpnii
Funm
Parrma
lte
ptum
Prrrmae
rst Funm oveypier H lte ptum
rst
Perass
Parrma d gsh Perass Irsum Mtee
Hasp
H
gsh
d

Google

ct && Placente e aal fnt e n ng e um edenand Beene Chesti Funns a oem Pamae ad e enceum Pamsus en ttum
ct
&&
Placente
e
aal
fnt
n
ng
um
edenand
Beene
Chesti
Funns
a
oem
Pamae
ad
enceum
Pamsus
en
ttum