Human Generated Data

Title

John Buttrick Noyes, Cambridge (1838-1908)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2022

Human Generated Data

Title

John Buttrick Noyes, Cambridge (1838-1908)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.4
Human 99.4
Clothing 97.9
Apparel 97.9
Tie 96.2
Accessories 96.2
Accessory 96.2
Suit 95.9
Overcoat 95.9
Coat 95.9
Text 93.9
Art 85.1
Tuxedo 73.9
Painting 69
Face 64.8
Photography 64.3
Photo 64.3
Portrait 63.5
Drawing 58.5
Handwriting 56.5

Imagga
created on 2022-01-08

currency 36.8
money 35.7
cash 28.4
finance 27.9
hat 25.1
close 22.2
bank 19.7
sombrero 19.5
dollar 19.5
banking 19.3
financial 18.7
headdress 18.2
old 17.4
one 17.2
coin 17.2
bill 17.1
pay 16.3
museum 15.2
art 15.1
business 14.6
closeup 14.1
vintage 13.5
symbol 13.5
paper 13.4
object 13.2
wealth 12.6
coins 12.5
clothing 11.7
banknote 11.6
us 11.6
face 10.6
dollars 10.6
cowboy hat 10.6
black 10.3
head 10.1
portrait 9.7
finances 9.6
depository 9.6
ancient 9.5
historical 9.4
economy 9.3
retro 9
numismatics 8.9
china 8.8
amulet 8.8
man 8.7
hundred 8.7
ball 8.4
covering 8.4
collection 8.1
history 8
metal 8
round 7.8
golden 7.7
commerce 7.5
facility 7.4
rich 7.4
gold 7.4
antique 7.3
holiday 7.2

Google
created on 2022-01-08

Outerwear 95.3
Jaw 88
Sleeve 86.8
Coat 85.9
Collar 84
Oval 83.1
Facial hair 79
Art 78.2
Suit 78.1
Blazer 77.8
Tints and shades 76.6
Vintage clothing 76.5
Font 74
Moustache 73.4
Handwriting 70.6
Formal wear 68.7
Beard 68
History 62.9
Stock photography 62.9
Illustration 60.5

Microsoft
created on 2022-01-08

text 99.6
human face 96.4
man 95.2
person 94.7
clothing 91.1
drawing 60.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 98.1%
Confused 0.9%
Sad 0.5%
Surprised 0.3%
Angry 0.1%
Fear 0.1%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 96.2%

Captions

Microsoft

a close up of a book 37.7%
close up of a book 34.1%
a hand holding a book 34%

Text analysis

Amazon

March
1838
John
Cambridge
March 2 1838
B.
John B. Nayer
2
Nayer

Google

lehn B.Naja Cambidge March 2 1S35-
lehn
B.Naja
Cambidge
March
2
1S35-