Human Generated Data

Title

Thomas Jefferson Spur, Worcester, Massachusetts (1838-1862)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1985

Human Generated Data

Title

Thomas Jefferson Spur, Worcester, Massachusetts (1838-1862)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1985

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.8
Human 98.8
Text 96.7
Tie 93.3
Accessories 93.3
Accessory 93.3
Art 77.1
Handwriting 70.8
Tie 67.7
Necktie 66.6
Clothing 61.9
Apparel 61.9
Painting 55.6

Clarifai
created on 2023-10-25

one 99.5
portrait 99.4
adult 98.9
people 98.9
man 98.4
wear 96.9
two 96.4
art 95.7
no person 93.6
facial expression 92.6
woman 92.3
retro 91.2
music 90.3
veil 88.5
illustration 85.5
mammal 84.3
sepia 83.2
ball-shaped 82.4
leader 79.2
painting 78.5

Imagga
created on 2022-01-08

hat 24.1
currency 19.7
money 19.5
sombrero 16.9
close 16.5
headdress 15.9
cash 15.5
finance 14.3
clothing 13.7
closeup 13.5
bank 13.4
dollar 13
love 12.6
bill 12.4
black 12.1
banking 11.9
art 11.7
financial 11.6
wealth 10.8
us 10.6
symbol 10.1
valentine 10
vintage 9.9
representation 9.9
banknote 9.7
paper 9.4
cowboy hat 9.2
one 9
fruit 8.9
style 8.9
light 8.7
creation 8.5
business 8.5
old 8.4
covering 8.1
brown 8.1
object 8.1
decoration 8
amulet 7.9
food 7.8
device 7.7
dollars 7.7
texture 7.6
fashion 7.5
rich 7.4
graphics 7.3

Google
created on 2022-01-08

Forehead 98.5
Face 98.4
Head 97.3
Chin 96.6
Eyebrow 94.7
Jaw 87.6
Oval 86.9
Collar 83.2
Tints and shades 76.9
Vintage clothing 76.9
Facial hair 75.9
Moustache 72.7
Suit 69
Tie 67.6
Blazer 67.5
Formal wear 66.9
Art 66.6
History 65.5
Circle 65.2
Font 64.9

Microsoft
created on 2022-01-08

text 98.9
human face 95.6
necktie 95.4
man 94.2
person 93.9
clothing 88.5
old 82.9
posing 38.5
vintage 33

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 19-27
Gender Male, 99.9%
Calm 96.9%
Confused 2.4%
Angry 0.2%
Sad 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 32
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Tie 93.3%

Categories

Imagga

paintings art 95.7%
people portraits 3.1%
food drinks 1.2%

Captions

Microsoft
created on 2022-01-08

a vintage photo of a person 75.5%
a person posing for the camera 75.4%
an old photo of a person 74.6%

Text analysis

Amazon

map
moraster map
purr
moraster

Google

Thonas
pum
inap
Thonas pum mrceter inap
mrceter