Human Generated Data

Title

Amory Pollard Sawyer, Boston (1833-1860)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2025

Human Generated Data

Title

Amory Pollard Sawyer, Boston (1833-1860)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.2
Human 99.2
Text 99
Handwriting 88.5
Art 86.8
Drawing 82.9
Painting 69.9
Signature 56.7
Autograph 56.7

Imagga
created on 2022-01-08

money 20.4
hat 18.3
currency 17.9
cash 13.7
finance 13.5
moon 12.8
dollar 12.1
close 12
one 11.9
toilet seat 11.9
vintage 11.9
art 11.8
sombrero 11.6
closeup 11.4
bank 10.7
financial 10.7
bill 10.5
black 10.3
headdress 9.7
us 9.6
coin 9.5
round 9.5
seat 9.3
globe 9.3
banking 9.2
old 9
clothing 9
sign 9
cartoon 8.9
graphics 8.9
world 8.9
paper 8.7
business 8.5
planet 8.4
silhouette 8.3
symbol 8.1
object 8.1
metal 8
night 8
icon 7.9
holiday 7.9
rich 7.4
earth 7.4
man 7.4
light 7.3
design 7.3
global 7.3
light bulb 7.1
furniture 7.1
person 7.1

Google
created on 2022-01-08

Oval 88.2
Sleeve 87.1
Coat 86.2
Handwriting 83.6
Collar 83.2
Suit 78
Blazer 78
Vintage clothing 77.4
Facial hair 76.2
Tints and shades 75.1
Art 74.4
Formal wear 72.7
Font 67.1
Circle 66.8
Moustache 66.5
History 64.2
Collectable 63.2
Visual arts 61.5
Illustration 60.9
Fashion accessory 58.6

Microsoft
created on 2022-01-08

text 98.4
man 92.4
person 91
human face 89
clothing 86.1
handwriting 82.5
letter 59.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 95.6%
Confused 4.1%
Angry 0.1%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0%
Happy 0%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 69.9%

Captions

Microsoft

an old photo of a person 49.3%
old photo of a person 43.6%

Text analysis

Amazon

1833
Mass-
Oct. 30. 1833
30.
Bolton Mass-
Oct.
Bolton
Annory

Google

Bolin Mendh- Oet 30. 833
Bolin
Mendh-
Oet
30.
833