Human Generated Data

Title

Entombment

Date

19th century

People

Artist: Natale Schiavoni, Italian 1777 - 1858

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3555

Human Generated Data

Title

Entombment

People

Artist: Natale Schiavoni, Italian 1777 - 1858

Artist after: Titian (Tiziano Vecellio), Italian c. 1488 - 1576

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 99
Person 99
Art 98.6
Painting 98.6
Person 95.9
Person 95.1
Female 86.1
Clothing 84.3
Apparel 84.3
People 84.3
Person 83.5
Person 81.2
Girl 69.3
Person 67.1
Person 66.5
Drawing 63.7
Woman 63.7
Child 62.3
Kid 62.3
Text 60.7
Teen 60.6
Dress 58.2
Face 57.2
Photography 55.6
Photo 55.6
Person 54.5

Clarifai
created on 2019-11-07

people 100
group 99.9
child 99.2
adult 98.6
art 97.9
many 97.5
woman 97.5
man 95.8
son 95.2
sit 94.8
kneeling 94.7
several 93.9
print 91.9
music 91.4
wear 91.4
group together 90.1
illustration 89.9
book series 88.9
furniture 88.8
four 88.3

Imagga
created on 2019-11-07

daily 77.4
newspaper 60.1
product 46.7
creation 36.6
money 30.6
cash 28.4
currency 26.9
dollar 24.1
business 23.7
bank 23.3
finance 22
paper 21.2
wealth 20.6
dollars 20.3
banking 20.2
financial 18.7
vintage 18.2
bill 18.1
man 17.5
hundred 17.4
close 17.1
franklin 16.7
one 16.4
old 16
postmark 15.8
letter 15.6
stamp 15.5
us 15.4
mail 15.3
people 15.1
savings 14.9
pay 14.4
postage 13.8
postal 13.7
banknotes 13.7
envelope 13.6
bills 13.6
male 13.5
loan 13.4
person 13.2
ancient 13
finances 12.5
exchange 12.4
symbol 12.1
circa 11.8
aged 11.8
portrait 11.6
banknote 11.6
sign 11.3
rich 11.2
culture 11.1
printed 10.8
closeup 10.8
states 10.6
art 10.5
adult 10.4
investment 10.1
face 9.9
philately 9.9
retro 9.8
sculpture 9.7
office 9.6
united 9.5
capital 9.5
economy 9.3
message 9.1
shows 8.9
funds 8.8
payment 8.7
post 8.6
unique 8.5
black 8.4
group 8.1
success 8
market 8
memorial 7.9
address 7.8
wages 7.8
economic 7.7
profit 7.7
fine 7.6
statue 7.6
senior 7.5
number 7.5
note 7.3
religion 7.2
history 7.2
love 7.1

Google
created on 2019-11-07

Microsoft
created on 2019-11-07

text 99.8
drawing 96.3
wall 95.7
book 93.2
sketch 92.3
person 91.2
painting 90.7
clothing 89
indoor 86.4
man 72.1
woman 68.8
human face 64.3
old 63.6
posing 59.4
vintage 25.2
picture frame 7.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-32
Gender Female, 55%
Fear 47.4%
Happy 45.1%
Angry 45.6%
Sad 48.7%
Calm 46.9%
Confused 45.4%
Disgusted 45.2%
Surprised 45.8%

AWS Rekognition

Age 20-32
Gender Male, 53.2%
Fear 51.8%
Happy 45%
Disgusted 45%
Calm 45%
Sad 45%
Angry 45.3%
Confused 45.1%
Surprised 47.7%

AWS Rekognition

Age 33-49
Gender Male, 53.3%
Angry 45%
Fear 45%
Calm 54.5%
Confused 45%
Disgusted 45%
Surprised 45%
Sad 45.3%
Happy 45.1%

AWS Rekognition

Age 26-40
Gender Male, 54.8%
Happy 45.3%
Calm 50.4%
Fear 45.3%
Sad 45.9%
Angry 47.4%
Confused 45.1%
Disgusted 45.2%
Surprised 45.4%

AWS Rekognition

Age 40-58
Gender Male, 53%
Calm 52.8%
Angry 45.2%
Happy 45.2%
Fear 45%
Disgusted 45.2%
Confused 45.1%
Surprised 45.3%
Sad 46.1%

AWS Rekognition

Age 48-66
Gender Male, 50.7%
Fear 45%
Disgusted 45%
Surprised 45%
Calm 53%
Angry 46.1%
Sad 45.6%
Confused 45%
Happy 45.2%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Painting 98.6%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 79.2%
a vintage photo of a group of people posing for a picture 79.1%
a vintage photo of a group of people posing for a photo 76.3%

Text analysis

Amazon

hmo
e
uore
r
he
Camhhen
l: Httr: Hy Camhhen r noad hmo uore e Mbile he arlia
Wyiame
Hy
2R
Mbile
arlia
noad
Httr:
l:
1iok