Human Generated Data

Title

Perhaps a Castle

Date

1985

People

Artist: Aaron Fink, American born 1955

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Joan and Roger Sonnabend, M24256

Human Generated Data

Title

Perhaps a Castle

People

Artist: Aaron Fink, American born 1955

Date

1985

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-10-30

Head 97.2
Art 95.4
Collage 94.2
Advertisement 94.2
Poster 94.2
Person 89.9
Human 89.9
Person 81.3
Drawing 75.8
Person 72.9
Art Gallery 69.7
Face 64.1
Sketch 61.9
Modern Art 59.8

Clarifai
created on 2019-10-30

people 99.8
portrait 99.7
adult 98.8
art 98.4
man 97.8
one 97.3
bill 95.9
retro 95.8
facial expression 93.8
print 93.3
woman 93
wear 92.6
illustration 92.5
painting 91.7
leader 85.8
group 85.5
child 84.2
paper 84
two 83.3
picture frame 83.2

Imagga
created on 2019-10-30

book jacket 100
jacket 100
wrapping 100
covering 68.3
stamp 33.1
mail 30.6
vintage 30.6
postmark 27.6
postage 27.5
postal 25.5
letter 24.8
envelope 23
post 21.9
old 19.5
art 18.9
printed 18.7
black 18.6
currency 18
money 17.9
retro 17.2
stamps 16.8
paper 16.5
global 16.4
shows 15.8
masterpiece 14.8
symbol 14.8
philately 14.8
cash 13.7
culture 13.7
delivery 13.6
cutting 13.5
one 13.4
communications 13.4
unique 13.3
office 12.9
painter 12.8
circa 12.8
icon 12.7
museum 12.6
close 12.6
bill 12.4
man 12.1
dollar 12.1
banking 12
post mail 11.9
zigzag 11.9
known 11.8
paintings 11.7
business 11.5
painted 11.5
fine 11.4
portrait 11
fame 10.9
renaissance 10.8
design 10.8
letters 10.6
antique 10.4
finance 10.1
message 10
collection 9.9
bank 9.9
financial 9.8
card 9.4
savings 9.3
church 9.3
face 9.2
note 9.2
aged 9.1
religion 9
people 8.9
banknote 8.7
artist 8.7
grunge 8.5
paint 8.2
wealth 8.1
canceled 7.9
ancient 7.8
dollars 7.7
notes 7.7
international 7.6
exchange 7.6
united 7.6
drawing 7.6
economy 7.4
closeup 7.4
sketch 7.2

Google
created on 2019-10-30

Microsoft
created on 2019-10-30

gallery 99.7
art 99.6
drawing 99.5
scene 99.4
room 99.2
human face 98
sketch 97.4
person 94.9
painting 93
man 91.4
poster 82.6
cartoon 79
illustration 75
text 72
clothing 57.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Male, 72.7%
Calm 98.8%
Sad 0.3%
Disgusted 0%
Confused 0%
Surprised 0.5%
Angry 0.2%
Fear 0.1%
Happy 0%

AWS Rekognition

Age 22-34
Gender Male, 77.2%
Angry 2.5%
Happy 0%
Confused 0.6%
Surprised 0.2%
Disgusted 0.1%
Sad 83.1%
Fear 7.6%
Calm 5.9%

Microsoft Cognitive Services

Age 23
Gender Male

Microsoft Cognitive Services

Age 23
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 89.9%

Captions

Microsoft

a room with art on the wall 65.6%
a room with pictures on the wall 65.5%
a picture of a room 62.7%

Text analysis

Amazon

ferhat
ferhat Cacte Dor
Cacte
Dor

Google

Pecheps Castle
Pecheps
Castle