Human Generated Data

Title

Untitled (unidentified sitter)
Date

c. 1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2013

Human Generated Data

Title

Untitled (unidentified sitter)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

c. 1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.2
Human 99.2
Art 90.7
Drawing 85.7
Tie 85
Accessories 85
Accessory 85
Painting 81.8
Text 71.9
Suit 61.3
Clothing 61.3
Coat 61.3
Overcoat 61.3
Apparel 61.3

Imagga
created on 2022-01-08

hat 65
sombrero 46
headdress 43.5
clothing 29.9
cowboy hat 22.6
portrait 20.7
currency 18.8
covering 17
money 17
man 16.1
finance 16
dollar 15.8
person 15.1
people 14.5
consumer goods 14.5
bill 14.2
cash 13.7
male 13.6
one 12.7
financial 12.5
face 12.1
wealth 11.7
adult 11.6
close 11.4
banknote 10.7
banking 10.1
dark 10
black 9.6
paper 9.5
happy 9.4
business 9.1
bank 8.9
handsome 8.9
symbol 8.7
dollars 8.7
old 8.4
outdoors 8.2
closeup 8.1
looking 8
president 7.8
pretty 7.7
attractive 7.7
serious 7.6
sign 7.5
percussion instrument 7.4
music 7.2

Google
created on 2022-01-08

Hair 98.5
Forehead 98.5
Face 98.4
Head 97.3
Chin 96.7
Eyebrow 95.3
Eye 94.1
Oval 91.8
Sleeve 85
Collar 83.3
Headgear 83.1
Tints and shades 77.3
Vintage clothing 76.7
Art 76.3
Blazer 74.7
Suit 70.5
Circle 69
Facial hair 68.1
Formal wear 68
History 66.8

Microsoft
created on 2022-01-08

text 96
human face 95.7
man 91
clothing 88.4
old 88.2
black 87.1
white 87
person 86.1
portrait 73.6
posing 65.6
suit 61.5
oval 58.8
photograph 55.9
vintage 48.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-30
Gender Male, 99.7%
Calm 99.7%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%
Surprised 0%
Disgusted 0%
Happy 0%

Microsoft Cognitive Services

Age 29
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 85%
Suit 61.3%

Captions

Microsoft

a vintage photo of a person 83.3%
a vintage photo of a person in a suit and tie 83.2%
a vintage photo of a person wearing a suit and tie 83.1%