Human Generated Data

Title

Untitled (unidentified sitter)

Date

c. 1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2017

Human Generated Data

Title

Untitled (unidentified sitter)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

c. 1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.7
Human 98.7
Art 93.6
Face 91.1
Painting 88.4
Drawing 85.4
Portrait 61.8
Photography 61.8
Photo 61.8

Imagga
created on 2022-01-08

man 38.3
toilet seat 37
male 32.1
face 31.2
portrait 29.7
seat 29.3
person 26.4
black 22.8
furniture 21.9
hat 21
head 20.1
adult 19.4
people 19
serious 17.2
dark 16.7
one 15.7
furnishing 15.7
attractive 15.4
mustache 14.5
expression 13.6
model 13.2
eyes 12
happy 11.9
hair 11.9
handsome 11.6
old 11.1
stress 10.5
look 10.5
human 10.5
sexy 10.4
looking 10.4
money 10.2
currency 9.9
beard 9.9
guy 9.8
close 9.7
skin 9.4
hand 9.1
fashion 9
health 9
light 8.7
pain 8.6
men 8.6
casual 8.5
eye 8
posing 8
body 8
boy 7.8
masculine 7.8
headdress 7.8
banknote 7.8
cowboy hat 7.7
studio 7.6
covering 7.6
senior 7.5
dollar 7.4
style 7.4
emotion 7.4
business 7.3
smile 7.1
love 7.1

Google
created on 2022-01-08

Forehead 98.5
Head 97.4
Chin 96.7
Outerwear 95.1
Eyebrow 95
Oval 91.2
Beard 90.9
Jaw 87.9
Coat 87.9
Sleeve 85.8
Collar 83.9
Headgear 83
Art 79.2
Facial hair 79
Blazer 77.6
Tints and shades 76.9
Vintage clothing 75.4
Moustache 74.5
Suit 74.4
Circle 67.8

Microsoft
created on 2022-01-08

human face 98.1
wall 97.9
man 97.8
black 94.5
text 94
clothing 92.2
person 89.2
white 86.8
old 84.8
posing 74
portrait 72.5
suit 64.7
vintage 59.7
oval 56.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 28-38
Gender Male, 100%
Calm 92.2%
Confused 4.9%
Sad 1.6%
Angry 0.5%
Disgusted 0.2%
Happy 0.2%
Surprised 0.2%
Fear 0.2%

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a vintage photo of Charles Sanders Peirce 88%
a vintage photo of Charles Sanders Peirce in a suit and tie 87.9%
a vintage photo of Charles Sanders Peirce in a suit posing for the camera 87.8%