Human Generated Data

Title

Untitled (unidentified man with beard and moustache, close cropped hair, looking down to the left)
Date

1860-1899
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.30

Human Generated Data

Title

Untitled (unidentified man with beard and moustache, close cropped hair, looking down to the left)

People

Artist: Unidentified Artist,

Date

1860-1899

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.329.30

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Person 98.8
Human 98.8
Face 98.1
Text 85.8
Man 72.8
Portrait 67.8
Photography 67.8
Photo 67.8
Advertisement 60.3
Word 60.3
Head 59.9
Poster 59.1
Skin 56.7

Clarifai
created on 2023-10-28

portrait 99.8
people 99.5
art 98.8
one 98.3
wear 98
adult 97
painting 96.7
vintage 96.7
retro 96.2
man 96.1
old 95
antique 90.7
print 88.4
two 87.7
leader 85.6
paper 85.4
illustration 84.3
veil 83.3
woman 82.9
sepia pigment 82.5

Imagga
created on 2022-02-25

money 40.9
currency 40.4
dollar 36.2
cash 34.8
book jacket 31.2
bill 27.6
finance 27.1
wealth 26.9
paper 24.4
jacket 24.3
financial 23.2
banking 23
close 22.8
bank 22.4
one 21.7
business 21.3
dollars 20.3
us 20.3
art 18.7
wrapping 18.5
hundred 18.4
closeup 16.8
savings 16.8
museum 15.6
covering 15.5
banknote 15.5
exchange 15.3
rich 14.9
pay 14.4
symbol 14.1
face 13.5
portrait 12.9
device 12.8
franklin 12.8
vintage 12.4
culture 12
pick 11.8
president 11.8
mosaic 11.8
finances 11.6
loan 11.5
note 11
investment 11
stamp 10.9
masterpiece 10.9
black 10.8
man 10.8
bills 10.7
mail 10.5
post 10.5
envelope 10.5
icon 10.3
drawing 10.2
economy 10.2
church 10.2
sketch 10
postmark 9.9
old 9.8
profit 9.6
painter 9
sculpture 9
postage 8.8
banknotes 8.8
coin 8.6
painted 8.6
fine 8.6
brass 8.5
commerce 8.4
head 8.4
representation 8.4
letter 8.3
religion 8.1
concepts 8
market 8
memorial 7.9
shows 7.9
printed 7.9
postal 7.9
funds 7.8
ancient 7.8
golden 7.7
payment 7.7
notes 7.7
grunge 7.7
sign 7.5
retro 7.4
success 7.2
office 7.2
male 7.1

Google
created on 2022-02-25

Forehead 98.5
Chin 96.7
Eyebrow 93.7
Jaw 88.1
Sleeve 87.2
Beard 87
Art 84.4
Headgear 82
Tints and shades 76.7
Font 76
Vintage clothing 74.6
Facial hair 74.4
Moustache 73.1
Monochrome 70.8
Visual arts 69.4
Self-portrait 67.7
Monochrome photography 67.2
History 65
Paper 63.4
Stock photography 62.6

Microsoft
created on 2022-02-25

text 99
human face 99
person 98.4
clothing 97.3
man 96.5
old 87
photograph 73.7
drawing 57.2
portrait 55.6
vintage 45.5

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 60.7%
Disgusted 29.8%
Sad 3.9%
Angry 2.1%
Fear 1.5%
Happy 1.1%
Confused 0.6%
Surprised 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 98.8%

Categories

Imagga

paintings art 96.3%
people portraits 2.5%

Captions

Microsoft
created on 2022-02-25

a vintage photo of a book 49.8%
an old photo of a book 49.7%
a vintage photo of a person holding a book 41%