Human Generated Data

Title

James Percival Townsend, Taunton, Massachusetts (1839-1906)

Date

1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2027

Human Generated Data

Title

James Percival Townsend, Taunton, Massachusetts (1839-1906)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 97
Person 97
Suit 96.2
Clothing 96.2
Overcoat 96.2
Coat 96.2
Apparel 96.2
Tuxedo 81.8
Text 79.7
Accessory 75.7
Tie 75.7
Accessories 75.7
Face 60.9
Performer 56.2
Portrait 55.5
Photography 55.5
Photo 55.5
Tie 54.5

Imagga
created on 2022-01-08

money 26.3
currency 23.3
finance 17.7
hat 16.7
cash 16.5
coin 16.2
old 14.6
vintage 14.6
object 13.9
close 13.7
bank 13.4
closeup 12.8
headdress 12.2
round 12.1
dollar 12.1
one 11.9
antique 11.8
financial 11.6
cowboy hat 11.5
coins 10.6
metal 10.4
paper 10.3
china 10.3
planet 10.2
banking 10.1
symbol 10.1
retro 9.8
food 9.5
light 9.3
art 9.3
gold 9
banknote 8.7
clothing 8.7
us 8.7
fruit 8.6
sombrero 8.6
holiday 8.6
bill 8.6
two 8.5
wealth 8.1
business 7.9
porcelain 7.8
color 7.8
ancient 7.8
pay 7.7
decoration 7.7
rusty 7.6
container 7.6
traditional 7.5
black 7.2
ball 7.2
glass 7.1
silver 7.1

Google
created on 2022-01-08

Forehead 98.5
Face 98.5
Chin 96.7
Hairstyle 95.1
Eyebrow 94
Jaw 88
Handwriting 86.4
Oval 84.6
Collar 82.9
Art 75.9
Tints and shades 75.7
Vintage clothing 75.6
Facial hair 74.5
Moustache 70.5
Suit 70.1
Font 68.2
History 66.2
Collectable 65.5
Formal wear 65.4
Circle 63.4

Microsoft
created on 2022-01-08

text 99.7
human face 96
person 92.2
man 89.1
clothing 83.2
handwriting 68.3
old 56.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 98.5%
Calm 99.8%
Sad 0.1%
Confused 0%
Angry 0%
Surprised 0%
Happy 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%
Tie 75.7%

Captions

Microsoft

an old photo of a person 65.3%
old photo of a person 59.4%
a old photo of a person 59.3%

Text analysis

Amazon

Feb
16
Feb 16 it 1839,
1839,
it
Jaunton.
I
I Perceival Somusend
Perceival
Somusend

Google

Sauntm.
Sauntm.