Human Generated Data

Title

Chief Justice Lemuel Shaw (1781-1861)
Date

c. 1855
People

Artist: Southworth & Hawes, American active 1843-1863
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sam Pratt, P2003.302

Human Generated Data

Title

Chief Justice Lemuel Shaw (1781-1861)

People

Artist: Southworth & Hawes, American active 1843-1863

Date

c. 1855

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Sam Pratt, P2003.302

Machine Generated Data

Tags

Amazon
created on 2022-05-28

Clothing 97.4
Apparel 97.4
Person 95.4
Human 95.4
Suit 80.4
Coat 80.4
Overcoat 80.4
Face 78.2
Painting 72.7
Art 72.7
Man 70
Portrait 61.6
Photography 61.6
Photo 61.6
Head 60.6

Clarifai
created on 2023-10-30

portrait 100
people 99.9
one 98.7
art 98.1
adult 97.2
leader 97
wear 95.7
administration 93.8
vintage 91
man 90.1
woman 88.6
music 88.3
old 86.9
lid 86.7
painting 86.6
two 84.3
retro 83.9
facial expression 83.1
outerwear 81.5
writer 80.7

Imagga
created on 2022-05-28

book jacket 67.1
jacket 52.4
wrapping 39.6
covering 28.6
currency 25.1
money 24.7
art 22.7
cash 22
dollar 20.4
statue 20.1
religion 18.8
one 18.7
sculpture 18.6
bank 17.9
finance 17.7
business 17.6
paper 17.3
ancient 17.3
wealth 17.1
banking 16.6
god 16.3
financial 16
close 15.4
bill 15.2
face 14.9
culture 14.5
religious 14.1
savings 14
church 13.9
portrait 13.6
old 13.2
vintage 13.2
antique 13
man 12.8
banknote 12.6
dollars 12.6
history 12.5
holy 12.5
us 11.6
historical 11.3
economy 11.1
symbol 10.8
blackboard 10.7
artist 10.6
pay 10.5
exchange 10.5
person 10.4
figure 10.3
painter 10.3
closeup 10.1
historic 10.1
investment 10.1
museum 9.7
finances 9.6
loan 9.6
stone 9.5
golden 9.5
rich 9.3
marble 8.9
banknotes 8.8
catholic 8.8
hundred 8.7
architecture 8.7
prayer 8.7
saint 8.7
black 8.7
spiritual 8.6
spirituality 8.6
profit 8.6
male 8.5
head 8.4
temple 8.4
people 8.4
human 8.3
gold 8.2
success 8
icon 7.9
masterpiece 7.9
bible 7.8
expression 7.7
capital 7.6
note 7.4

Google
created on 2022-05-28

Coat 88.8
Sleeve 87.2
Collar 84
Art 79.4
Suit 78.7
Blazer 78.2
Tints and shades 76.9
Vintage clothing 73.6
Rectangle 71.3
Visual arts 67.3
Facial hair 65.2
History 64.4
Stock photography 63.9
Self-portrait 63.7
Button 62.1
Classic 61.6
Portrait 59.4
Room 59.4
Moustache 59.3
Formal wear 59.2

Microsoft
created on 2022-05-28

text 99.9
human face 99.2
clothing 98.8
old 98.4
person 96.8
book 92.5
man 91
window 86.4
portrait 83.3
white 78.8
photograph 75.1
posing 70
vintage clothing 55.9
vintage 34.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 62-72
Gender Male, 99.9%
Sad 98.9%
Calm 23.5%
Confused 7.6%
Surprised 7.1%
Fear 6.8%
Angry 4.9%
Disgusted 1.4%
Happy 0.8%

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Possible
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.4%
Painting 72.7%

Categories

Imagga

paintings art 73.6%
streetview architecture 22.7%
events parties 3.3%

Captions

Microsoft
created on 2022-05-28

a vintage photo of a man 94%
an old photo of a man 93.9%
a vintage photo of a man in a suit and tie 93.8%

Text analysis

Google

VOYONGAT