Human Generated Data

Title

Untitled (unidentified sitter)
Date

c. 1858
People

Artist: John Adams Whipple, American 1822 - 1891
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of Arthur S. Eldredge, 2.2002.2012

Human Generated Data

Title

Untitled (unidentified sitter)

People

Artist: John Adams Whipple, American 1822 - 1891

Date

c. 1858

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 97.5
Human 97.5
Art 92.7
Painting 82.5
Drawing 76.8
Face 75.1
Tie 73
Accessories 73
Accessory 73
Text 71.8
Portrait 55.3
Photography 55.3
Photo 55.3

Imagga
created on 2022-01-08

hat 52.4
portrait 33.6
person 31.8
face 30.5
adult 27.8
clothing 27.1
headdress 26.7
smile 22.8
attractive 22.4
eyes 22.4
people 21.7
fashion 20.3
model 20.2
sombrero 19.2
covering 18.8
happy 17.5
hair 17.4
expression 17
sexy 16.9
black 16.8
man 16.8
pretty 16.8
male 16.7
cute 15.8
lady 15.4
skin 14.5
head 14.3
cowboy hat 14
look 13.1
smiling 13
make 12.7
dark 12.5
toilet seat 11.7
child 11.5
studio 11.4
eye 10.7
posing 10.7
seat 10.5
culture 10.2
consumer goods 10.2
casual 10.2
lifestyle 10.1
human 9.7
one 9.7
brunette 9.6
boy 9.6
hairstyle 9.5
ethnic 9.5
lips 9.2
health 9
cheerful 8.9
style 8.9
veil 8.8
women 8.7
love 8.7
bride 8.6
facial 8.6
serious 8.6
youth 8.5
old 8.4
makeup 8.3
fun 8.2
pose 8.1
religion 8.1
handsome 8
furniture 8
umbrella 8
mask 7.9
mystery 7.7
hand 7.6
elegance 7.6
close 7.4
cloak 7.4
blond 7.4
teen 7.3
vessel 7.3
nice 7.3
girls 7.3
bonnet 7.1

Google
created on 2022-01-08

Hair 98.6
Forehead 98.5
Face 98.3
Head 97.3
Chin 96.8
Outerwear 95.6
Eyebrow 95.1
Hairstyle 95.1
Coat 93.8
Eye 93.7
Facial expression 93.3
Oval 91.6
Headgear 83.4
Collar 83.4
Vintage clothing 78.8
Facial hair 76
Blazer 75.3
Suit 75
Tints and shades 74.5
Sleeve 71.4

Microsoft
created on 2022-01-08

wall 99.8
human face 98.2
text 94
old 90.8
clothing 90.5
man 90.1
black 88.6
person 87.2
white 85.1
portrait 75.6
vintage 73.8
suit 73.3
drawing 65
posing 50.1
necktie 17.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 97.5%
Angry 1.4%
Confused 0.5%
Sad 0.3%
Surprised 0.1%
Happy 0.1%
Disgusted 0.1%
Fear 0%

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Tie 73%

Captions

Microsoft

a vintage photo of a man 90.2%
a vintage photo of a man in a suit and tie 90.1%
a vintage photo of a man in a suit 90%