Human Generated Data

Title

Untitled (unidentified sitter)
Date

c. 1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.1995

Human Generated Data

Title

Untitled (unidentified sitter)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

c. 1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.2
Human 99.2
Tie 97.8
Accessories 97.8
Accessory 97.8
Clothing 92.9
Apparel 92.9
Text 84.3
Face 82.1
Coat 80.8
Overcoat 80.8
Art 79.4
Portrait 66.4
Photography 66.4
Photo 66.4
Suit 65.3
Painting 56.4

Imagga
created on 2022-01-08

punching bag 23.2
male 23
portrait 22
person 21.8
man 21.5
people 19.5
face 19.2
hat 17.3
adult 16.1
attractive 16.1
happy 15.6
game equipment 14.7
black 13.9
one 12.7
model 12.4
fashion 12
human 12
sexy 11.2
dad 11.1
casual 11
happiness 11
lifestyle 10.8
smile 10.7
health 10.4
body 10.4
posing 9.8
fun 9.7
guy 9.7
hair 9.5
clothing 9.5
women 9.5
smiling 9.4
expression 9.4
pretty 9.1
equipment 9
world 8.9
ball 8.8
love 8.7
cute 8.6
old 8.3
joy 8.3
child 8.3
father 8.1
lady 8.1
screw 7.9
look 7.9
men 7.7
sombrero 7.6
serious 7.6
studio 7.6
vintage 7.6
dark 7.5
headdress 7.4
cheerful 7.3
business 7.3
fitness 7.2
parent 7

Google
created on 2022-01-08

Forehead 98.5
Face 98.4
Hair 98.3
Chin 96.6
Eyebrow 95
Facial expression 93.2
Oval 89.6
Jaw 87.6
Collar 83.6
Headgear 82.6
Art 78.6
Tints and shades 77.3
Facial hair 76.3
Blazer 76
Vintage clothing 75.7
Moustache 71.6
Formal wear 71.2
Suit 67.9
History 65.9
Monochrome 64.6

Microsoft
created on 2022-01-08

wall 97.9
human face 97.4
text 95.4
man 95.2
person 92.6
clothing 91
black 89.7
white 85.2
suit 81.3
old 76.1
portrait 69.5
posing 56
vintage 47.1
necktie 27.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 98.2%
Confused 0.5%
Sad 0.4%
Surprised 0.3%
Angry 0.3%
Fear 0.1%
Disgusted 0.1%
Happy 0.1%

Microsoft Cognitive Services

Age 33
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 97.8%
Suit 65.3%

Captions

Microsoft

a vintage photo of a man in a suit and tie 96.4%
a vintage photo of a man wearing a suit and tie 95.3%
a vintage photo of a man in a suit 95.2%