Human Generated Data

Title

Frances Clayton

Date

19th century

People

Artist: Samuel Masury, American 1818 - 1874

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2019.148

Human Generated Data

Title

Frances Clayton

People

Artist: Samuel Masury, American 1818 - 1874

Date

19th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-10-04

Apparel 98.7
Clothing 98.7
Furniture 95.3
Chair 95.3
Human 95
Person 95
Fashion 81.5
Female 75.7
Art 74.4
Robe 74
Gown 63.9
Woman 59.3
Sitting 58.1
Evening Dress 57.8
Face 57.4
Portrait 57.4
Photography 57.4
Photo 57.4

Clarifai
created on 2019-10-04

people 100
one 99.2
adult 98.7
portrait 97.9
wear 97
print 95.7
administration 95.5
leader 95.4
man 94.1
art 94.1
veil 94
engraving 93
royalty 92.7
seat 92.5
monarch 90.5
outfit 88.8
gown (clothing) 88.1
facial hair 87
furniture 83.8
military 83.7

Imagga
created on 2019-10-04

skirt 100
garment 78.1
clothing 56.5
covering 34.8
consumer goods 26.8
dress 25.3
statue 24
costume 20.5
face 19.9
people 19
fashion 18.8
portrait 17.5
person 17
lady 15.4
old 14.6
sculpture 14.5
religion 14.3
adult 14.2
ancient 13.8
happy 13.8
art 13.7
pretty 13.3
attractive 13.3
cute 12.9
culture 12.8
style 12.6
antique 12.2
hair 11.9
elegance 11.8
catholic 11.7
traditional 11.6
man 11.4
sexy 11.2
monument 11.2
black 11.2
elegant 11.1
model 10.9
history 10.7
religious 10.3
happiness 10.2
studio 9.9
cloak 9.6
faith 9.6
holiday 9.3
smile 9.3
hand 9.1
posing 8.9
detail 8.9
women 8.7
love 8.7
bride 8.6
god 8.6
hat 8.6
clothes 8.4
feminine 8.4
church 8.3
vintage 8.3
historic 8.3
figure 8.2
sensuality 8.2
gorgeous 8.2
decoration 8
brunette 7.8
tourism 7.4
tradition 7.4
wedding 7.4
smiling 7.2
celebration 7.2
lovely 7.1
interior 7.1

Google
created on 2019-10-04

Microsoft
created on 2019-10-04

clothing 93.8
person 85.6
dress 84.6
text 76.5
old 75
victorian 67.8
woman 60.7
sketch 56.7
vintage clothing 55.6
costume design 50.8
dressed 27.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 25-39
Gender Female, 82.5%
Happy 0.1%
Fear 0.1%
Disgusted 0.1%
Sad 4.3%
Calm 93.5%
Surprised 0.3%
Confused 0.8%
Angry 0.6%

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Chair 95.3%
Person 95%

Captions

Microsoft

a vintage photo of Frances Clalin 84%
a vintage photo of Frances Clalin wearing a suit and tie 83.9%
a vintage photo of Frances Clalin in a suit and tie 83.8%

Text analysis

Google

DS
DS