Human Generated Data

Title

James Jackson Lowell, Cambridge, Massachusetts (1837-1864)

Date

1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2024

Human Generated Data

Title

James Jackson Lowell, Cambridge, Massachusetts (1837-1864)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2024

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Tie 99.9
Accessories 99.9
Accessory 99.9
Person 99.2
Human 99.2
Art 91.7
Text 91.4
Painting 83
Clothing 74.3
Apparel 74.3
Face 69.5
Portrait 68.4
Photography 68.4
Photo 68.4
Drawing 66
Handwriting 58.3
Suit 57.5
Coat 57.5
Overcoat 57.5

Clarifai
created on 2023-10-25

one 99.8
people 99.7
portrait 99.7
adult 99.7
man 99.5
two 98.1
art 97.6
music 97.5
wear 97.1
veil 97
woman 96.8
lid 96.1
facial expression 93.1
musician 92.7
illustration 91.6
retro 91.2
side view 88.2
profile 87.8
mustache 85.5
no person 84.4

Imagga
created on 2022-01-08

hat 69.5
sombrero 48.5
headdress 40.2
clothing 27.5
cowboy hat 18.2
currency 17
money 17
close 14.8
covering 14.8
portrait 14.2
consumer goods 13.7
closeup 13.5
man 13.4
cash 12.8
person 12.6
dollar 12.1
paper 11.9
finance 11.8
bill 11.4
one 11.2
black 10.8
symbol 10.8
museum 10.7
happy 10.6
love 10.2
financial 9.8
bank 9.2
face 9.2
banking 9.2
dark 9.2
art 9.1
business 9.1
wealth 9
light 8.7
male 8.5
vintage 8.4
sexy 8
banknote 7.8
us 7.7
attractive 7.7
old 7.7
depository 7.5
style 7.4
people 7.2
holiday 7.2
facility 7

Google
created on 2022-01-08

Forehead 98.5
Face 98.4
Hair 98.3
Chin 96.7
Outerwear 95.4
Hairstyle 95.1
Eyebrow 93.8
Oval 83.7
Collar 82.2
Handwriting 80.4
Vintage clothing 77
Tints and shades 76.9
Facial hair 76.7
Suit 75.7
Blazer 75.5
Font 75
Formal wear 68
Moustache 67.6
Collectable 66.2
History 65.2

Microsoft
created on 2022-01-08

text 99.3
human face 96.6
person 93
book 91.5
man 90.5
handwriting 86.2
clothing 82.3
drawing 72.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 99.9%
Sad 0%
Confused 0%
Angry 0%
Happy 0%
Surprised 0%
Disgusted 0%
Fear 0%

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.9%
Person 99.2%

Categories

Captions

Microsoft
created on 2022-01-08

a close up of a book 39.8%
close up of a book 35.4%
a close up of a book cover 35.3%

Text analysis

Amazon

1837
15th
Oct. 15th 1837
Oct.
ambridge
I
в
Lowell
I I Lowell
в ambridge Mafs.
Mafs.

Google

I I. Lowel. Oet. 15 1837 6 ambidy- Map.
I
I.
Lowel.
Oet.
15
1837
6
ambidy-
Map.