Human Generated Data

Title

Amory Pollard Sawyer, Boston (1833-1860)

Date

1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2025

Human Generated Data

Title

Amory Pollard Sawyer, Boston (1833-1860)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2025

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.2
Human 99.2
Text 99
Handwriting 88.5
Art 86.8
Drawing 82.9
Painting 69.9
Signature 56.7
Autograph 56.7

Clarifai
created on 2023-10-25

portrait 99.8
one 99.7
people 99.5
adult 99.3
man 99.2
music 98.2
wear 98.1
veil 98
art 98
lid 96.7
two 96
musician 95.2
profile 93.6
facial expression 93.4
illustration 91.3
side view 89.9
facial hair 89.2
mustache 89.2
retro 87.4
instrument 87.2

Imagga
created on 2022-01-08

money 20.4
hat 18.3
currency 17.9
cash 13.7
finance 13.5
moon 12.8
dollar 12.1
close 12
one 11.9
toilet seat 11.9
vintage 11.9
art 11.8
sombrero 11.6
closeup 11.4
bank 10.7
financial 10.7
bill 10.5
black 10.3
headdress 9.7
us 9.6
coin 9.5
round 9.5
seat 9.3
globe 9.3
banking 9.2
old 9
clothing 9
sign 9
cartoon 8.9
graphics 8.9
world 8.9
paper 8.7
business 8.5
planet 8.4
silhouette 8.3
symbol 8.1
object 8.1
metal 8
night 8
icon 7.9
holiday 7.9
rich 7.4
earth 7.4
man 7.4
light 7.3
design 7.3
global 7.3
light bulb 7.1
furniture 7.1
person 7.1

Google
created on 2022-01-08

Oval 88.2
Sleeve 87.1
Coat 86.2
Handwriting 83.6
Collar 83.2
Suit 78
Blazer 78
Vintage clothing 77.4
Facial hair 76.2
Tints and shades 75.1
Art 74.4
Formal wear 72.7
Font 67.1
Circle 66.8
Moustache 66.5
History 64.2
Collectable 63.2
Visual arts 61.5
Illustration 60.9
Fashion accessory 58.6

Microsoft
created on 2022-01-08

text 98.4
man 92.4
person 91
human face 89
clothing 86.1
handwriting 82.5
letter 59.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 95.6%
Confused 4.1%
Angry 0.1%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 69.9%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2022-01-08

an old photo of a person 49.3%
old photo of a person 43.6%

Text analysis

Amazon

1833
Mass-
Oct. 30. 1833
30.
Bolton Mass-
Oct.
Bolton
Annory

Google

Bolin Mendh- Oet 30. 833
Bolin
Mendh-
Oet
30.
833