Human Generated Data

Title

Untitled (man with black tie, seated, half-length, three-quarter view)
Date

1840s-1850s
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.17

Human Generated Data

Title

Untitled (man with black tie, seated, half-length, three-quarter view)

People

Artist: Unidentified Artist,

Date

1840s-1850s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.54.17

Machine Generated Data

Tags

Amazon
created on 2019-11-05

Human 98.4
Person 98.4
Painting 97.7
Art 97.7
Photography 60.5
Portrait 60.5
Photo 60.5
Face 60.5

Clarifai
created on 2019-11-05

people 99.9
one 98.9
portrait 98.4
adult 97.2
art 95.9
man 95.8
painting 93
leader 90.5
scientist 88.4
print 87.4
religion 86.9
lid 86.4
illustration 85
facial hair 83.2
veil 79.7
wear 78.3
mustache 77.2
administration 67.2
old 66.7
chair 66.7

Imagga
created on 2019-11-05

shield 88
armor 70
protective covering 55.1
covering 41.3
stamp 31.9
mail 29.7
postmark 27.6
postage 27.5
vintage 26.5
post 25.7
currency 24.2
postal 23.5
money 23
letter 22.9
finance 21.9
art 21.7
old 21.6
cash 21
paper 20.4
push button 19.4
printed 18.7
dollar 18.6
envelope 18.5
shows 17.7
one 17.2
culture 17.1
bill 16.2
close 16
stamps 15.8
retro 15.6
symbol 15.5
us 15.4
masterpiece 14.8
delivery 14.6
global 14.6
wealth 14.3
icon 14.2
financial 14.2
painter 13.9
banking 13.8
museum 13.7
religion 13.4
black 13.2
church 12.9
cutting 12.6
dollars 12.5
bank 12.5
communications 12.5
fine 12.4
unique 12.3
business 12.1
ancient 12.1
zigzag 11.9
philately 11.8
circa 11.8
renaissance 11.8
paintings 11.7
banknote 11.6
closeup 11.4
painted 11.4
book jacket 11.3
post mail 10.9
fame 10.9
known 10.9
collection 10.8
face 10.6
artist 10.6
binding 10.5
office 10.4
canceled 9.9
history 9.8
sign 9.8
portrait 9.7
book 9.7
pay 9.6
aged 9
jacket 8.8
letters 8.7
hundred 8.7
united 8.6
philatelic 7.9
antique 7.9
god 7.7
mosaic 7.5
religious 7.5
savings 7.5
economy 7.4
man 7.4
object 7.3
device 7.3

Google
created on 2019-11-05

Picture frame 95.7
Portrait 83.5
Gentleman 82.4
Antique 68.8
Art 65.5
Painting 62.2

Microsoft
created on 2019-11-05

human face 98.5
text 98
person 97.3
clothing 92.5
man 90.5
indoor 89.6
old 44.6
painting 35.3
picture frame 22.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 54-72
Gender Male, 93.6%
Angry 4%
Surprised 0.9%
Calm 83.2%
Disgusted 0.1%
Fear 0.4%
Confused 6.3%
Happy 0.1%
Sad 5%

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Painting 97.7%

Categories

Imagga

paintings art 98.5%
people portraits 1%

Captions

Microsoft
created on 2019-11-05

a painting of a person 75.6%
a painting of a person 75.5%
a painting of a book 58.3%