Human Generated Data

Title

Tolman, Concord, Mass.
Date

c. 1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2035

Human Generated Data

Title

Tolman, Concord, Mass.

People

Artist: John Adams Whipple, American 1822 - 1891

Date

c. 1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.4
Human 98.4
Tie 96.3
Accessories 96.3
Accessory 96.3
Text 90.7
Art 75.3
Face 67.9
Photography 60.6
Photo 60.6
Portrait 58.5
Painting 57.5
Handwriting 56.8

Imagga
created on 2022-01-08

hat 34.6
headdress 23.8
cowboy hat 23.5
currency 19.7
money 18.7
clothing 16.8
sombrero 15.6
china 14.3
closeup 14.1
art 13.9
cash 13.7
finance 13.5
old 13.2
paper 12.7
close 12.5
covering 12.2
bank 11.6
person 11.4
black 11.4
porcelain 11.1
banknote 10.7
face 10.6
bill 10.5
one 10.4
dollar 10.2
banking 10.1
vintage 10.1
symbol 10.1
attractive 9.8
body 9.6
ceramic ware 9.5
wealth 9
financial 8.9
man 8.7
coin 8.6
business 8.5
portrait 8.4
health 8.3
fashion 8.3
human 8.2
consumer goods 8.2
antique 8.2
style 8.2
sexy 8
light 8
texture 7.6
decoration 7.6
head 7.5
happy 7.5
metal 7.2
lampshade 7.2
love 7.1
skin 7

Google
created on 2022-01-08

Coat 90.5
Jaw 88
Oval 86.4
Collar 84
Sleeve 83.7
Suit 80.4
Facial hair 77.7
Blazer 77.1
Tints and shades 76.3
Moustache 75.1
Formal wear 73.7
Art 73.5
Vintage clothing 72.9
Font 68.4
Handwriting 65.8
History 62.1
Circle 61.5
Paper product 60.2
Illustration 59
Visual arts 57.3

Microsoft
created on 2022-01-08

human face 97.8
text 94.4
person 94.3
man 92.9
clothing 90.4
old 87
drawing 78.5
handwriting 77.5
sketch 65.3
vintage 61.7
portrait 52.2
posing 44.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 21-29
Gender Male, 100%
Calm 99.4%
Confused 0.3%
Sad 0.1%
Happy 0.1%
Angry 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

Microsoft Cognitive Services

Age 27
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Tie 96.3%

Captions

Microsoft

a vintage photo of a man 79%
a vintage photo of a man holding a sign posing for the camera 51.6%
a vintage photo of a man holding a sign 51.5%

Text analysis

Amazon

Tobman
Cincord

Google

Triman mae
Triman
mae