Human Generated Data

Title

Untitled (unidentified sitter)

Date

c. 1858

People

Artist: John Adams Whipple, American 1822 - 1891

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2006

Human Generated Data

Title

Untitled (unidentified sitter)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

c. 1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 95.3
Human 95.3
Art 86.8
Face 78.7
Apparel 75.6
Clothing 75.6
Painting 74.6
Text 72.1
Photography 62.8
Portrait 62.8
Photo 62.8

Imagga
created on 2022-01-08

bow tie 78.9
necktie 68.2
portrait 36.9
man 34.9
male 34.9
garment 32.3
person 30.9
adult 30.4
clothing 26.3
face 25.6
people 24.5
attractive 22.4
hair 20.6
human 19.5
spectacles 18.1
fashion 18.1
handsome 17.8
model 17.1
expression 17.1
happy 15.7
black 15.6
serious 15.3
cute 15.1
suit 14.5
youth 14.5
smile 14.3
one 14.2
hat 13.8
eyes 13.8
optical instrument 13.7
love 13.4
business 13.4
businessman 13.2
sexy 12.9
looking 12.8
casual 12.7
old 11.8
beard 11.7
guy 11.7
look 11.4
shirt 11.2
men 11.2
head 10.9
smiling 10.9
close 10.8
lifestyle 10.8
posing 10.7
pretty 10.5
boy 10.4
money 10.2
studio 9.9
adolescent 9.8
style 9.6
brunette 9.6
senior 9.4
elegance 9.2
dress 9
currency 9
lady 8.9
body 8.8
couple 8.7
instrument 8.6
culture 8.5
tie 8.5
hand 8.4
glasses 8.3
fun 8.2
teenager 8.2
make 8.2
closeup 8.1
juvenile 8
family 8
sad 7.7
stress 7.7
joy 7.5
mature 7.4
lips 7.4
emotion 7.4
alone 7.3
confident 7.3
sensual 7.3
sensuality 7.3
eye 7.1
women 7.1
happiness 7.1
jacket 7

Google
created on 2022-01-08

Forehead 98.5
Chin 96.6
Outerwear 95.3
Coat 94.2
Eyebrow 94
Eye 93.5
Jaw 88.3
Suit 84.7
Collar 84
Art 83.3
Facial hair 82.4
Blazer 77.8
Vintage clothing 77.2
Oval 76.1
Moustache 75.7
Bow tie 74.4
Tints and shades 72.5
Formal wear 71.7
White-collar worker 69.5
Beard 68.8

Microsoft
created on 2022-01-08

person 98.5
human face 98
wall 97.9
clothing 92.9
sketch 92.5
suit 91.5
drawing 90.2
portrait 90
text 89.5
white 76.1
old 71.8
man 67.1
posing 42.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-33
Gender Male, 100%
Calm 99.9%
Confused 0%
Sad 0%
Angry 0%
Surprised 0%
Happy 0%
Fear 0%
Disgusted 0%

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 95.3%

Captions

Microsoft

a vintage photo of a person wearing a suit and tie 93.2%
a vintage photo of a person in a suit and tie 93.1%
a person wearing a suit and tie 93%