Human Generated Data

Title

Untitled (Full-length portrait of a woman with a skirt, sash, cane, and hat)
Date

19th century
People

Artist: Lemuel Wallace Cook, American active 1860s-1890s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Fund for the Acquisition of Photographs, 2019.161

Human Generated Data

Title

Untitled (Full-length portrait of a woman with a skirt, sash, cane, and hat)

People

Artist: Lemuel Wallace Cook, American active 1860s-1890s

Date

19th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-10-08

Clothing 97.8
Apparel 97.8
Person 93.6
Human 93.6
Art 91.3
Painting 85.6
Crypt 55.6

Clarifai
created on 2019-10-08

people 99.3
wear 99.2
one 98.5
adult 97.7
woman 96.1
veil 95.6
print 93.3
art 92.5
portrait 91.7
dress 90.5
necklace 87.6
jewelry 84.9
costume 83.8
outfit 83.5
skirt 82
retro 81.3
man 79.4
monarch 79.1
outerwear 77.4
gown (clothing) 77.2

Imagga
created on 2019-10-08

skirt 100
garment 88.8
clothing 70.5
dress 68.7
fashion 43
costume 33.1
covering 31.6
portrait 30.4
consumer goods 30.1
bride 29.7
model 29.6
adult 27.2
hair 27
wedding 26.7
attractive 25.9
posing 25.8
people 25.7
face 25.6
pretty 25.2
cute 25.1
person 23.9
happy 23.8
smile 23.5
style 21.5
love 21.3
marriage 20.9
studio 20.5
lady 20.3
sexy 20.1
elegant 19.7
elegance 19.3
happiness 18.8
sensuality 17.3
clothes 16.9
gown 16.7
women 16.6
pose 16.3
veil 15.7
cheerful 15.4
makeup 14.6
one 14.2
bouquet 14.2
celebration 13.6
fun 13.5
married 13.4
lifestyle 13
holiday 12.9
sensual 12.7
fashionable 12.3
standing 12.2
human 12
joy 11.7
bridal 11.7
brunette 11.3
color 11.1
day 11
smiling 10.9
outdoor 10.7
hand 10.6
hairstyle 10.5
flowers 10.4
black 10.2
long 10.1
make 10
traditional 10
gorgeous 10
fantasy 9.9
dancer 9.9
romance 9.8
dance 9.7
vertical 9.6
looking 9.6
glamor 9.6
expression 9.4
flower 9.2
stylish 9
wed 8.8
body 8.8
ceremony 8.7
charming 8.5
dinner dress 8.5
child 8.3
holding 8.3
romantic 8
lovely 8
bright 7.9
couple 7.8
femininity 7.7
modern 7.7
dancing 7.7
culture 7.7
youth 7.7
wife 7.6
laughing 7.6
pink 7.5
feminine 7.5
hat 7.4
20s 7.3
art 7.3
groom 7.3
figure 7.2
blond 7.2
summer 7.1

Google
created on 2019-10-08

Lady 94.3
Victorian fashion 89.4
Fashion 77.7
Vintage clothing 71.7
Dress 59.7
Stock photography 59.4
Costume design 53.7
Retro style 51.3
Art 50.2

Microsoft
created on 2019-10-08

dress 95
painting 90.6
clothing 87.9
drawing 87.2
costume design 84.3
sketch 80
old 79.8
victorian 77
hoopskirt 59.1
fabric 55.6
woman 50.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 24-38
Gender Male, 80%
Sad 0.5%
Disgusted 0.2%
Angry 0.4%
Happy 8.3%
Calm 89%
Surprised 0.5%
Fear 0.1%
Confused 1%

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 93.6%
Painting 85.6%

Captions

Microsoft

a vintage photo of a person wearing a costume 65.9%
a vintage photo of a person 65.8%
an old photo of a person 65.7%