Human Generated Data

Title

Gideon Allen, New Bedford, Massachusetts (1837-?)

Date

1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2002

Human Generated Data

Title

Gideon Allen, New Bedford, Massachusetts (1837-?)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 97.8
Human 97.8
Tie 88.6
Accessories 88.6
Accessory 88.6
Art 88.4
Text 84.8
Painting 75.4
Drawing 68
Photography 65.1
Photo 65.1
Clothing 62.3
Apparel 62.3
Face 59.7
Portrait 56.9

Imagga
created on 2022-01-08

money 22.9
currency 22.4
cash 16.5
vintage 15.7
art 15.6
finance 15.2
moon 14.9
close 14.8
old 13.9
amulet 13.7
closeup 13.5
food 12.8
bank 12.5
sombrero 12.5
dollar 12.1
fruit 11.7
hat 11.7
financial 11.6
banking 11
charm 10.8
retro 10.6
coin 10.5
bill 10.5
one 10.4
round 10.3
object 10.2
paper 10.2
card 9.6
decoration 9.6
love 9.5
headdress 8.8
dollars 8.7
coins 8.7
ancient 8.6
holiday 8.6
texture 8.3
planet 8.3
wealth 8.1
symbol 8.1
business 7.9
banknote 7.8
us 7.7
two 7.6
healthy 7.5
traditional 7.5
creation 7.5
antique 7.4
metal 7.2
black 7.2
percussion instrument 7.2

Google
created on 2022-01-08

Forehead 98.5
Brown 98
Eyebrow 94.4
Jaw 87.8
Oval 84.3
Collar 83.3
Art 80.5
Facial hair 77.5
Vintage clothing 75.4
Tints and shades 74.4
Moustache 73
Font 69.6
Suit 68.3
Blazer 66.1
History 64.8
Circle 64.4
Visual arts 62.5
Paper product 62
Formal wear 61.9
Portrait 60.3

Microsoft
created on 2022-01-08

text 99.7
human face 95
man 93.7
person 92.6
clothing 79.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 100%
Sad 0%
Surprised 0%
Confused 0%
Angry 0%
Fear 0%
Happy 0%
Disgusted 0%

Microsoft Cognitive Services

Age 31
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%
Tie 88.6%
Painting 75.4%

Captions

Microsoft

text 11.2%

Text analysis

Amazon

Allen
27.
1837
ono 27. 1837
reford
News reford
News
ono

Google

mo 27, 1837
mo
27,
1837