Human Generated Data

Title

Portrait of a Man
Date

c. 1860
People

Artist: Unidentified Artist,

Classification

Drawings
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Philip Hofer, BR71.2

Human Generated Data

Title

Portrait of a Man

People

Artist: Unidentified Artist,

Date

c. 1860

Classification

Drawings

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Philip Hofer, BR71.2

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Person 99.2
Human 99.2
Art 94.6
Drawing 91.4
Painting 79.3
Text 72.3
Sketch 65.9
Photo 63.1
Photography 63.1
Apparel 60.5
Clothing 60.5

Clarifai
created on 2020-05-02

people 99.7
one 99.3
portrait 98.7
adult 97.4
man 97
print 96.7
no person 95.4
two 94.2
art 93.1
painting 91.9
administration 88.7
monochrome 86.2
woman 86
illustration 85.8
wear 85.4
medical practitioner 83.2
leader 83.2
military 82.1
paper 81.4
retro 79.2

Imagga
created on 2020-05-02

money 35.7
currency 33.2
cash 30.2
dollar 29.7
bill 29.5
finance 27
paper 24.9
wealth 24.2
business 23.7
banking 23
financial 22.3
dollars 22.2
bank 22.1
close 21.1
hat 19.9
one 19.4
savings 16.8
banknote 16.5
man 15.4
us 15.4
male 14.9
portrait 14.9
hundred 14.5
photograph 14.1
sombrero 13.4
exchange 13.4
rich 13
old 12.5
finances 12.5
headdress 12.5
pay 12.5
art 12.4
people 12.3
mug shot 12
bills 11.6
face 11.4
economy 11.1
investment 11
adult 11
franklin 10.8
symbol 10.8
banknotes 10.8
religion 10.7
device 10.6
loan 10.5
person 10.5
profit 10.5
closeup 10.1
note 10.1
clothing 9.8
states 9.7
god 9.6
culture 9.4
toilet seat 9.3
office 9
market 8.9
funds 8.8
serious 8.6
capital 8.5
painter 8.4
black 8.4
commerce 8.4
vintage 8.3
seat 8.2
happy 8.1
success 8
museum 8
masterpiece 7.9
president 7.9
representation 7.8
economic 7.7
sitting 7.7
men 7.7
debt 7.7
furniture 7.7
notes 7.7
united 7.6
laptop 7.6
sign 7.5
human 7.5
church 7.4
covering 7.4
creation 7.3
computer 7.3
cowboy hat 7.2
history 7.2
concepts 7.1
working 7.1
work 7.1

Google
created on 2020-05-02

Photograph 97.2
Snapshot 86.3
Stock photography 80.4
Portrait 77.2
Photography 72.5
Photographic paper 71.3
Black-and-white 68.3
Style 51
Illustration 50.4
Art 50.2

Microsoft
created on 2020-05-02

text 98.6
drawing 97.6
sketch 97.2
human face 96.4
person 92.1
man 87.2
black and white 68.7
clothing 66.4
portrait 61.2
gallery 60.8
painting 57.5
posing 55.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 51-69
Gender Male, 97.3%
Disgusted 0%
Surprised 0%
Confused 0.3%
Calm 97.5%
Happy 0.1%
Sad 1.9%
Fear 0%
Angry 0.2%

Microsoft Cognitive Services

Age 58
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Categories

Imagga

paintings art 70.3%
people portraits 24.4%
food drinks 1.6%
cars vehicles 1.4%
interior objects 1.1%

Captions

Microsoft
created on 2020-05-02

a vintage photo of a person 83.6%
a vintage photo of a person 80.4%
a person posing for a photo 80.3%