Human Generated Data

Title

Joseph Alden Shaw, Sudbury, Massachusetts (1836-1915)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2056

Human Generated Data

Title

Joseph Alden Shaw, Sudbury, Massachusetts (1836-1915)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2056

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.2
Human 99.2
Text 99.2
Clothing 95.2
Apparel 95.2
Tie 84.1
Accessories 84.1
Accessory 84.1
Suit 81.2
Coat 81.2
Overcoat 81.2
Handwriting 80.2
Shirt 71.1
Label 69
Painting 67.7
Art 67.7
Signature 58.2
Autograph 58.2
Photography 56.6
Photo 56.6
Glasses 56.2

Clarifai
created on 2023-10-25

one 99.3
portrait 98.8
people 97.8
art 97.6
adult 97.4
man 97
music 96.9
wear 96
no person 95.7
retro 95.6
two 95.4
musician 91.8
veil 91.3
artistic 89.3
sepia 88.6
facial expression 85.7
illustration 85.1
old 84
woman 82.1
side view 81.1

Imagga
created on 2022-01-08

money 34.9
currency 34.1
cash 27.4
finance 25.3
vintage 20.8
dollar 20.4
bank 19.7
banking 19.3
bill 19
old 18.8
close 18.2
financial 16.9
paper 16.5
retro 16.4
art 15.7
wealth 14.4
dollars 13.5
pay 13.4
coin 13.3
stamp 12.9
business 12.7
card 12.5
mail 12.4
symbol 12.1
one 11.9
object 11.7
coins 11.6
us 11.6
closeup 11.4
rich 11.2
planet 11.1
economy 10.2
moon 10
sombrero 9.9
postmark 9.8
hat 9.8
postage 9.8
banknote 9.7
hundred 9.7
mug shot 9.6
letter 9.2
representation 9.1
envelope 9.1
collection 9
philately 8.9
ancient 8.6
black 8.4
photograph 8.4
savings 8.4
sign 8.3
creation 8.1
icon 7.9
collect 7.9
postal 7.8
states 7.7
finances 7.7
exchange 7.6
post 7.6
historical 7.5
greeting 7.4
device 7.4
note 7.3
aged 7.2
portrait 7.1
face 7.1
love 7.1

Google
created on 2022-01-08

Handwriting 88.1
Coat 87.6
Oval 84.4
Collar 83.2
Art 80.5
Blazer 76.6
Suit 76.5
Font 76.4
Tints and shades 76.3
Facial hair 75.4
Vintage clothing 75.1
Moustache 73
Circle 70.3
Formal wear 69.6
Sleeve 68.5
Collectable 66.1
Illustration 65.5
Beard 65.2
Tie 64.9
History 64.6

Microsoft
created on 2022-01-08

text 99.1
book 94.8
handwriting 93
human face 92
man 91.6
person 89.4
clothing 74.5
letter 68.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 99.9%
Calm 100%
Angry 0%
Confused 0%
Sad 0%
Surprised 0%
Happy 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 84.1%
Painting 67.7%

Categories

Imagga

paintings art 96.6%
food drinks 2.8%

Captions

Microsoft
created on 2022-01-08

a man holding a book 46.2%
a close up of a man holding a book 37.1%
close up of a man holding a book 34.9%

Text analysis

Amazon

Joseph
Joseph to. Shaw
to.
Shaw
Jou
Sudbury
Sudbury Авар.
Jou 4,183g.
Авар.
4,183g.

Google

A. Shad. 4 1836.
A.
Shad.
4
1836.