Human Generated Data

Title

A Smoker
Date

18th-19th century
People

Artist: Lambert Antoine Claessens, Flemish 1764 - 1834

Artist after: Adriaen van Ostade, Dutch 1610 - 1685
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G725

Human Generated Data

Title

A Smoker

People

Artist: Lambert Antoine Claessens, Flemish 1764 - 1834

Artist after: Adriaen van Ostade, Dutch 1610 - 1685

Date

18th-19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Person 99.4
Human 99.4
Person 99.2
Person 98.8
Art 96
Apparel 88
Hat 88
Clothing 88
Painting 81.8
Person 77.5
Face 63.8
Photography 63.8
Photo 63.8
Portrait 63.8

Clarifai
created on 2019-10-30

people 99.7
adult 97.2
group 95
child 93.8
wear 92.3
portrait 92
man 91.6
art 90.9
one 89.9
woman 89.8
two 89.4
family 83.4
painting 82.5
retro 76.5
exhibition 75.2
music 74.7
museum 74.7
canine 72.7
mammal 72.5
four 70.4

Imagga
created on 2019-10-30

vintage 23.3
product 21
old 20.9
book jacket 19.7
money 19.6
currency 18.8
newspaper 18.3
stamp 17.5
mail 17.2
creation 16.9
postmark 15.8
banking 15.6
jacket 15.3
envelope 14.7
letter 14.7
bill 14.3
retro 13.9
dollar 13.9
postage 13.8
cash 13.7
culture 13.7
paper 13.4
ancient 13
art 12.8
postal 12.8
business 12.7
one 12.7
black 12.6
bank 12.5
portrait 12.3
people 12.3
antique 12.1
man 12.1
circa 11.8
printed 11.8
wrapping 11.6
post 11.4
covering 11
shows 10.8
symbol 10.8
financial 10.7
finance 10.1
male 10
office 9.9
close 9.7
states 9.7
exchange 9.5
fine 9.5
unique 9.5
historical 9.4
wall 9.4
card 9.3
person 9.3
global 9.1
painter 9
wealth 9
child 8.9
masterpiece 8.9
known 8.9
philately 8.9
museum 8.8
paintings 8.8
cutting 8.7
communications 8.6
painted 8.6
united 8.6
savings 8.4
economy 8.3
plaything 8.3
device 8.3
book 8.2
historic 8.2
history 8
teddy 8
sculpture 7.9
icon 7.9
post mail 7.9
zigzag 7.9
fame 7.9
smile 7.8
delivery 7.8
banknote 7.8
us 7.7
mother 7.5
note 7.3
message 7.3
aged 7.2
religion 7.2
family 7.1
face 7.1
market 7.1
travel 7

Google
created on 2019-10-30

Photograph 96.7
Snapshot 85.4
Picture frame 77.3
Photography 70.6
Art 69.5
Room 65.7
Stock photography 62.1
Illustration 60.2

Microsoft
created on 2019-10-30

room 99.8
gallery 99.7
scene 99.4
human face 93.8
clothing 91.2
person 90.2
drawing 85.9
painting 85.6
text 84.5
picture frame 82.8
hat 70.4
old 55.9
posing 53.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-51
Gender Male, 97.7%
Calm 56.1%
Sad 20.7%
Angry 14.5%
Surprised 1.3%
Disgusted 1.2%
Happy 1.9%
Fear 1.6%
Confused 2.8%

AWS Rekognition

Age 32-48
Gender Female, 54.7%
Calm 46.9%
Happy 51.4%
Confused 45%
Fear 45.1%
Sad 46.2%
Disgusted 45%
Angry 45.3%
Surprised 45.1%

AWS Rekognition

Age 23-35
Gender Male, 53.6%
Happy 45.1%
Calm 54%
Angry 45.4%
Surprised 45.1%
Sad 45.2%
Confused 45.1%
Disgusted 45.1%
Fear 45%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Hat 88%
Painting 81.8%

Captions

Microsoft

a vintage photo of a person 73.6%
a vintage photo of a person 72.5%
a vintage photo of a person in a room 72.4%

Text analysis

Amazon

tafade
Y tafade
Y
Caspens
tncker
T tncker
T

Google

Had bofade Imeker Te
Had
bofade
Imeker
Te