Human Generated Data

Title

James May, Petersburg, Virginia (1837-1876)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2100

Human Generated Data

Title

James May, Petersburg, Virginia (1837-1876)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2100

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Text 99.8
Person 98.2
Human 98.2
Handwriting 95.5
Signature 73.7
Autograph 73.7
Clothing 71.5
Apparel 71.5
Photography 65.9
Photo 65.9
Art 63.2
Portrait 60.5
Face 60.5
Head 58.2
Drawing 55.1

Clarifai
created on 2023-10-25

one 98.8
people 97.6
no person 97.2
portrait 97.2
man 96.1
art 94.9
retro 94.2
wear 93.8
adult 93.5
two 90.5
travel 89.1
old 88.2
conceptual 87.7
woman 87.6
hanging 86.9
painting 86.8
Easter 85.7
indoors 85.4
food 83.5
antique 83

Imagga
created on 2022-01-08

book jacket 24.2
money 22.9
old 22.3
vintage 20.7
cash 20.1
retro 19.6
currency 18.8
jacket 18.8
grunge 18.7
paper 18.1
art 17.2
drawing 16.2
finance 16
device 15.3
covering 15
bank 14.3
wrapping 14.3
banking 13.8
dollar 13
design 12.7
aged 12.7
financial 12.5
bill 12.4
symbol 12.1
antique 12.1
close 12
texture 11.8
phonograph record 11.7
black 11.4
style 11.1
frame 10.8
wealth 10.8
dollars 10.6
business 10.3
diagram 10.3
representation 10.3
graphic 10.2
card 10.2
stamp 10
dirty 9.9
envelope 9.7
one 9.7
pattern 9.6
pick 9.5
closeup 9.4
economy 9.3
banknote 8.7
us 8.7
mail 8.6
rich 8.4
notebook 8
banknotes 7.8
finances 7.7
pay 7.7
floral 7.7
exchange 7.6
photograph 7.5
silhouette 7.4
letter 7.3
painting 7.2
mug shot 7.2
material 7.1
portrait 7.1
love 7.1
lute 7

Google
created on 2022-01-08

Coat 88.9
Beard 83.7
Art 81
Suit 78.3
Facial hair 78.1
Tints and shades 76
Collar 75.1
Moustache 72
Rectangle 69.7
Vintage clothing 68
Collectable 67.9
Visual arts 67.5
Paper product 64.2
Illustration 63.7
Self-portrait 62.5
Paper 62.1
History 58.9
Circle 56.8
Interior design 53.9
Font 53.5

Microsoft
created on 2022-01-08

text 99.5
human face 90.4
handwriting 89.7
man 88.9
person 87.1
letter 64.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-24
Gender Male, 96.3%
Calm 99.8%
Sad 0%
Surprised 0%
Angry 0%
Confused 0%
Fear 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%

Categories

Imagga

paintings art 95.1%
food drinks 2.6%
interior objects 1.2%

Captions

Microsoft
created on 2022-01-08

text 63.8%

Text analysis

Amazon

11.
Apric
Apric 11. 1837
Virginia
1837
Petusburg Virginia
Petusburg
pany