Human Generated Data

Title

Josiah Brandlee, Boston (1837-1902)

Date

1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2090

Human Generated Data

Title

Josiah Brandlee, Boston (1837-1902)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.8
Human 98.8
Text 97.8
Handwriting 81.1
Art 76.6
Drawing 73.4
Plant 69.4
Girl 58.9
Female 58.9
Signature 56.9
Autograph 56.9

Imagga
created on 2022-01-08

hat 43.9
headdress 33.5
cowboy hat 28.5
sombrero 27
clothing 22.2
currency 16.1
device 15.1
money 14.5
close 14.3
covering 14.1
food 14.1
pick 13.4
fruit 12.6
old 11.8
consumer goods 11.6
coin 11.4
texture 11.1
cash 11
finance 11
closeup 10.8
vintage 10.7
percussion instrument 10.6
coins 10.6
symbol 10.1
bank 9.8
musical instrument 9.8
art 9.8
design 9.7
object 9.5
brown 8.8
gong 8.6
tasty 8.4
health 8.3
healthy 8.2
love 7.9
penny 7.9
gold 7.4
retro 7.4
banking 7.4
meal 7.3
aged 7.2
black 7.2
wealth 7.2
vegetarian 7.1
silver 7.1
decoration 7

Google
created on 2022-01-08

Art 83.2
Tints and shades 76.3
Facial hair 70.9
Visual arts 67.4
Moustache 66.9
Rectangle 66.5
Vintage clothing 65.6
Collar 64.5
Paper product 64.2
Beard 62.9
Circle 62.7
Font 61.9
Oval 60
Paper 59.3
History 58.7
Illustration 54.8
Suit 53.9
Portrait 53.8

Microsoft
created on 2022-01-08

text 99.6
human face 93.4
handwriting 90.2
person 84
letter 80.5
man 61

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 90.4%
Angry 8.4%
Confused 0.3%
Happy 0.3%
Surprised 0.2%
Fear 0.2%
Sad 0.2%
Disgusted 0.1%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a close up of a box 59.6%
close up of a box 54.3%
a close up of a box on a table 38.4%

Text analysis

Amazon

Dec.17
Bradlee
the
Boston
Dec.17 the 1837
I. Bradlee
I.
1837
Rizelon

Google

J. 13radllee
J.
13radllee