Human Generated Data

Title

William Frederick Milton, Jamaica Plain, Massachusetts (1837-1905)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2099

Human Generated Data

Title

William Frederick Milton, Jamaica Plain, Massachusetts (1837-1905)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Text 98.9
Person 98.8
Human 98.8
Face 88.8
Handwriting 81.5
Art 81.1
Drawing 76.5
Photography 67.3
Photo 67.3
Clothing 66.5
Apparel 66.5
Portrait 65.8
Head 57.6
Doodle 55.8

Imagga
created on 2022-01-08

pick 36.9
device 34.3
diagram 21
drawing 20.5
money 17.9
currency 16.1
cash 15.5
representation 15.5
close 14.3
finance 13.5
design 13
vintage 12.4
dollar 12.1
banking 11.9
graphic 11.7
black 11.4
paper 11.1
style 11.1
business 10.9
symbol 10.8
bank 10.7
financial 10.7
art 10.6
bill 10.5
pattern 10.2
envelope 10
light bulb 10
old 9.7
cone 9.6
closeup 9.4
blank 9.4
rich 9.3
card 9.2
silhouette 9.1
sign 9
wealth 9
color 8.9
dollars 8.7
love 8.7
us 8.7
space 8.5
grunge 8.5
texture 8.3
one 8.2
object 8.1
electric lamp 8
hat 8
silver 8
icon 7.9
disk 7.8
banknotes 7.8
lamp 7.8
circle 7.8
frame 7.5
technology 7.4
cartoon 7.1
shiny 7.1
moon 7.1

Google
created on 2022-01-08

Coat 91.7
Jaw 87.9
Beard 83.2
Art 82.9
Facial hair 79.7
Tints and shades 76.2
Font 75.9
Suit 75.5
Moustache 73.6
Oval 71
Collar 70.3
Vintage clothing 68.3
Visual arts 67
Collectable 65.8
Circle 62.3
Paper product 60.7
Illustration 60.4
Monochrome 60.2
History 58.3
Formal wear 57.7

Microsoft
created on 2022-01-08

text 99.7
human face 91.7
handwriting 86.2
person 83.8
man 81.5
letter 79.7
clothing 51.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 98.1%
Confused 1.1%
Angry 0.3%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0%

Microsoft Cognitive Services

Age 43
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

text 73.3%

Text analysis

Amazon

William
1837
Feb
Feb 26th 1837 Boston
Boston
26th
Jamaica
Plain
Jamaica Plain Mars
William I milling
Mars
Begilers
I milling

Google

Seb 464 Jamaica ain Thae
Seb
464
Jamaica
ain
Thae