Human Generated Data

Title

Pietà

Date

19th century

People

Artist: Moritz Steinla, German 1791 - 1858

Artist after: Fra Bartolommeo della Porta, Italian 1472 - 1517

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R6627

Human Generated Data

Title

Pietà

People

Artist: Moritz Steinla, German 1791 - 1858

Artist after: Fra Bartolommeo della Porta, Italian 1472 - 1517

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R6627

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Person 99.2
Human 99.2
Person 97.2
Art 96.4
Painting 92.2
Person 76
Person 69.9
Portrait 64
Face 64
Photography 64
Photo 64

Clarifai
created on 2019-11-16

people 99.9
adult 98.9
art 98.6
man 96.9
portrait 96.6
one 96.5
painting 94.9
woman 94.8
print 94.5
illustration 90.7
two 90.2
group 88.8
furniture 88.2
reclining 86.3
music 84.1
child 83.3
elderly 82.3
family 82
sit 81.8
wear 81.6

Imagga
created on 2019-11-16

daily 64.3
newspaper 49.8
product 40.7
money 36.6
cash 34.8
currency 33.2
creation 32.2
dollar 31.6
finance 27
bank 25.1
paper 23.5
wealth 23.4
dollars 23.2
business 22.5
financial 22.3
banking 22.1
one 21.7
bill 20.9
hundred 20.3
close 19.4
savings 17.7
us 16.4
banknotes 15.7
pay 15.3
franklin 14.8
bills 14.6
banknote 14.6
finances 14.5
loan 14.4
portrait 13.6
exchange 12.4
rich 12.1
investment 11.9
states 11.6
payment 11.5
man 11.4
statue 11.4
face 11.4
economy 11.1
note 11
funds 10.8
vintage 10.8
united 10.5
culture 10.3
symbol 10.1
old 9.8
notes 9.6
profit 9.6
sculpture 9.5
capital 9.5
people 9.5
closeup 9.4
art 9.4
black 9
economic 8.7
person 8.6
male 8.5
number 8.4
printed 7.9
postage 7.9
wages 7.8
stamp 7.7
debt 7.7
price 7.7
sales 7.7
mail 7.7
sign 7.5
commerce 7.5
hair 7.1
market 7.1
book jacket 7.1
cadaver 7

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

drawing 99.6
painting 98.9
sketch 98.6
art 94.4
room 87.3
gallery 86.5
old 65.9
person 65.3
human face 63.1
posing 47.1
plaque 15.2
picture frame 12

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-40
Gender Female, 53.9%
Fear 45%
Confused 45.1%
Happy 45%
Angry 45.1%
Disgusted 45%
Calm 54.5%
Surprised 45.1%
Sad 45.2%

AWS Rekognition

Age 39-57
Gender Male, 53.3%
Angry 45.2%
Surprised 45.1%
Disgusted 45%
Confused 45.2%
Fear 45.2%
Calm 45.5%
Happy 45.1%
Sad 53.7%

AWS Rekognition

Age 23-35
Gender Female, 52.1%
Surprised 45%
Fear 45%
Angry 45.1%
Happy 45%
Sad 54.2%
Confused 45%
Calm 45.6%
Disgusted 45%

AWS Rekognition

Age 18-30
Gender Female, 51.6%
Calm 53.3%
Confused 45%
Happy 46.1%
Disgusted 45.2%
Surprised 45.1%
Sad 45.1%
Fear 45%
Angry 45.1%

Microsoft Cognitive Services

Age 33
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 92.2%

Categories

Imagga

pets animals 50.5%
paintings art 48.8%

Captions

Microsoft
created on 2019-11-16

an old photo of a person 71.1%
old photo of a person 67.3%
an old photo of a person in a room 67.2%

Text analysis

Amazon

d
Agupto
fweng
afe
AL
ne et PPpdk fweng Agupto afe d afmie
AL bimd 05
05
PPpdk
bimd
afmie
et
ne

Google

Anguoto lardederigo)
Anguoto
lardederigo)