Human Generated Data

Title

Untitled (man, bust-length, three-quarter view)
Date

c. 1856-c. 1910
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.2.B

Human Generated Data

Title

Untitled (man, bust-length, three-quarter view)

People

Artist: Unidentified Artist,

Date

c. 1856-c. 1910

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.2.B

Machine Generated Data

Tags

Amazon
created on 2019-11-07

Human 99.5
Person 99.5
Person 92.2
Painting 87.5
Art 87.5
Advertisement 70.1
Novel 67.7
Book 67.7
Poster 66.6
Text 63.7
Collage 58.5

Clarifai
created on 2019-11-07

people 98.7
vintage 98.2
old 97.5
art 96.6
print 96.6
portrait 96.4
one 95.5
retro 94.9
post 94.6
adult 94.2
painting 94.1
ancient 93.2
antique 93.1
stamp 92.6
man 92.1
illustration 92.1
face 91.7
woman 91.5
religion 88.6
letter 88.5

Imagga
created on 2019-11-07

art 32.7
shield 32.6
vintage 29.8
religion 26.9
old 25.8
armor 25.5
covering 24.4
culture 23.1
stamp 22.3
postage 21.6
protective covering 21
paper 20.4
mail 20.1
post 20
golden 19.8
postmark 19.7
currency 18.8
museum 18.8
ancient 18.2
gold 18.1
postal 17.7
letter 17.4
icon 17.4
retro 17.2
symbol 16.8
masterpiece 16.8
church 16.7
money 16.2
antique 15.2
finance 15.2
mosaic 15.1
one 14.9
painter 14.9
design 14.7
close 14.3
dollar 13.9
printed 13.8
cash 13.7
detail 13.7
frame 13.4
bill 13.3
religious 13.1
pattern 13
envelope 12.8
shows 12.8
paintings 12.7
delivery 12.6
wealth 12.6
financial 12.5
god 12.4
fine 12.4
temple 12.3
face 12.1
banking 11.9
decoration 11.9
historic 11.9
zigzag 11.9
known 11.8
stamps 11.8
renaissance 11.8
history 11.6
cutting 11.6
dollars 11.6
communications 11.5
painted 11.5
unique 11.4
grunge 11.1
architecture 11
global 10.9
post mail 10.9
fame 10.9
closeup 10.8
bank 10.7
device 10.7
banknote 10.7
artist 10.6
office 10.5
portrait 10.4
prayer rug 10.3
bible 9.8
business 9.7
us 9.6
holy 9.6
spirituality 9.6
ornate 9.1
tourism 9.1
black 9
amulet 9
philately 8.9
orthodox 8.8
object 8.8
sacred 8.8
man 8.7
letters 8.7
saint 8.7
faith 8.6
travel 8.4
rug 8.2
collection 8.1
philatelic 7.9
prophet 7.9
book jacket 7.7
blank 7.7
wall 7.7
obsolete 7.7
decorative 7.5
rich 7.4
famous 7.4
paint 7.2
sculpture 7.2
border 7.2
charm 7.1

Google
created on 2019-11-07

Picture frame 92.7
Painting 84.4
Art 80.6
Antique 61.9
Miniature 59

Microsoft
created on 2019-11-07

human face 96.6
text 96.2
person 95.7
clothing 84.3
victorian 80.1
woman 67.6
decorated 25.3
painting 18.9
picture frame 10.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 4-14
Gender Female, 75.1%
Happy 0.1%
Surprised 0.5%
Confused 0.4%
Angry 0.1%
Disgusted 0.3%
Fear 0.5%
Sad 2.3%
Calm 95.8%

AWS Rekognition

Age 22-34
Gender Male, 99.3%
Happy 0.8%
Fear 7.7%
Disgusted 0.6%
Confused 2.4%
Angry 5.6%
Sad 1.7%
Calm 48.7%
Surprised 32.5%

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 87.5%

Categories

Imagga

paintings art 99.7%

Captions

Microsoft
created on 2019-11-07

a painting on the wall 74.3%
a painting on a wall 73.2%
a painting hanging on a wall 73.1%

Text analysis

Amazon

ron
lr
lr p 2
2
sn0
sn0 e
p
e