Human Generated Data

Title

Henry Augustus Richardson, Cambridge (1836-1863)
Date

1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2059

Human Generated Data

Title

Henry Augustus Richardson, Cambridge (1836-1863)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.8
Human 98.8
Clothing 97.4
Apparel 97.4
Text 93.6
Tie 92.7
Accessories 92.7
Accessory 92.7
Suit 90.7
Overcoat 90.7
Coat 90.7
Face 83.4
Portrait 65.1
Photography 65.1
Photo 65.1
Shirt 64.8
Art 61.3
Tuxedo 58.8
Performer 57

Imagga
created on 2022-01-08

currency 25.1
money 24.6
hat 22.1
cash 20.1
close 20
museum 19
finance 17.7
bill 17.1
dollar 16.7
closeup 16.2
bank 15.3
sombrero 15.3
headdress 15.1
banking 14.7
depository 14.2
banknote 12.6
paper 12.6
clothing 12.5
financial 12.5
facility 12.2
wealth 11.7
us 11.6
one 11.2
business 10.9
fruit 10.8
dollars 10.6
art 9.9
portrait 9.7
amulet 9.5
cowboy hat 9.5
love 9.5
symbol 9.4
gold 9
representation 8.4
old 8.3
device 8.3
note 8.3
object 8.1
light 8
food 8
president 7.8
round 7.8
hundred 7.7
pay 7.7
exchange 7.6
coin 7.6
charm 7.5
apple 7.5
man 7.4
black 7.3
cone 7.2

Google
created on 2022-01-08

Face 98.3
Head 97.3
Chin 96.7
Outerwear 95.2
Hairstyle 95.1
Eyebrow 94.1
Facial expression 93.3
Coat 91.5
Oval 86.1
Collar 83.7
Suit 80.4
Facial hair 78.6
Vintage clothing 78
Blazer 78
Tints and shades 76.7
Font 73.8
Sleeve 72.6
Signature 72.3
Formal wear 72.2
Moustache 70.8

Microsoft
created on 2022-01-08

text 99.8
man 95.9
person 92.7
human face 91.5
clothing 89.5
suit 63.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-35
Gender Male, 100%
Calm 97.8%
Confused 1.1%
Sad 0.7%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%
Happy 0%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%
Tie 92.7%

Captions

Microsoft

a close up of a book 39.9%
close up of a book 35.7%
a hand holding a book 35.6%

Text analysis

Amazon

a.
Nov
Nov 20th 1836
20th
1836
Hemy. a. Richardson
Hemy.
Cambrige
Richardson

Google

Hemy. Cambrige Nr 20h 1836.
Hemy.
Cambrige
Nr
20h
1836.