Human Generated Data

Title

Saint John Sleeping

Date

19th century

People

Artist: Luigi Martelli, Italian 19th century

Artist after: Carlo Dolci, Italian 1616 - 1686

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R11043

Human Generated Data

Title

Saint John Sleeping

People

Artist: Luigi Martelli, Italian 19th century

Artist after: Carlo Dolci, Italian 1616 - 1686

Date

19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R11043

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 98.1
Person 98.1
Person 97.8
Art 93.5
Painting 92.8
Person 70

Clarifai
created on 2019-11-06

people 99.9
adult 99.3
art 99.1
man 98.6
group 98.4
two 98
print 97.7
woman 97.3
portrait 97
baby 95
reclining 94.9
religion 94.7
affection 93.9
one 93.9
music 92.7
three 92.6
son 92.1
illustration 91.5
child 91
Renaissance 90

Imagga
created on 2019-11-06

money 60.4
currency 56.6
dollar 52
cash 46.7
finance 44.8
wealth 38.6
bill 38.1
business 37.1
bank 34.6
paper 34.5
banking 34
dollars 33.8
financial 32.1
hundred 31
close 29.7
one 26.9
us 25.1
banknote 24.3
phonograph record 22.5
savings 22.4
franklin 21.7
exchange 21
bills 20.4
pay 20.2
finances 19.3
economy 18.5
states 18.4
investment 18.3
creation 17.9
rich 17.7
loan 16.3
banknotes 15.7
vintage 14.9
closeup 14.8
note 14.7
brass 14.5
united 14.3
president 13.8
funds 13.7
stamp 13.7
book jacket 13.5
profit 13.4
mail 13.4
concepts 13.3
art 13.2
number 13.1
postmark 12.8
symbol 12.8
sign 12.8
portrait 12.3
face 12.1
structure 12
product 11.9
old 11.8
memorial 11.6
market 11.5
capital 11.4
success 11.3
wages 10.8
value 10.7
coin 10.5
post 10.5
jacket 10.5
envelope 10.1
letter 10.1
circa 9.9
postage 9.8
postal 9.8
debt 9.6
payment 9.6
price 9.6
culture 9.4
commerce 9.3
global 9.1
wrapping 8.9
videodisk 8.8
object 8.8
paying 8.7
mosaic 8.7
change 8.7
notes 8.6
card 8.5
stock 8.4
black 8.4
retro 8.2
man 8.1
representation 8
photograph 8
book 8
buck 7.9
shows 7.9
printed 7.9
mug shot 7.9
economic 7.8
fine 7.6
single 7.4
covering 7.3
world 7.3
office 7.2
icon 7.1

Google
created on 2019-11-06

Microsoft
created on 2019-11-06

text 99.8
book 98.4
human face 97.6
baby 95.8
person 94.5
clothing 85.3
toddler 77.8
smile 52.3
posing 46.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-51
Gender Female, 89.6%
Fear 1.1%
Sad 34.4%
Angry 0.1%
Happy 0%
Confused 63.2%
Disgusted 0.2%
Surprised 0.2%
Calm 0.8%

AWS Rekognition

Age 16-28
Gender Female, 84.2%
Disgusted 0.1%
Surprised 0.2%
Sad 5.6%
Angry 0.1%
Confused 0.1%
Calm 93.2%
Fear 0.3%
Happy 0.4%

AWS Rekognition

Age 40-58
Gender Male, 99.8%
Happy 1%
Disgusted 0.1%
Angry 0.2%
Sad 59.9%
Fear 0.1%
Calm 37.7%
Surprised 0.5%
Confused 0.6%

AWS Rekognition

Age 12-22
Gender Female, 99.5%
Disgusted 0%
Happy 2.8%
Fear 0%
Sad 1.3%
Confused 0%
Surprised 0.1%
Angry 0%
Calm 95.7%

AWS Rekognition

Age 5-15
Gender Female, 98.4%
Happy 13%
Confused 0.1%
Surprised 0.2%
Disgusted 0.1%
Sad 0.6%
Calm 86.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 22-34
Gender Female, 75.5%
Fear 0%
Surprised 0%
Disgusted 0%
Angry 0.1%
Happy 0.1%
Calm 94.9%
Sad 4.9%
Confused 0%

Microsoft Cognitive Services

Age 58
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 17
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Likely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.1%
Painting 92.8%

Categories

Imagga

paintings art 99.1%

Text analysis

Amazon

IL
SONNO
IL SONNO DIS.GIOVANNINO
DIS.GIOVANNINO
ECCE
Mlle:
kid.
di.
1l.
Fntiiis
1l. Oue di. g Mlle: Fntiiis
Oue
Buu kid.
Buu
g

Google

LMartalli Fne ino M.Oi d vde Debi dp IL SONNO DI S. GIOVANNINO
Fne
GIOVANNINO
LMartalli
ino
M.Oi
d
vde
Debi
dp
IL
SONNO
DI
S.