Human Generated Data

Title

Mary Smith Clark (Mrs. Benjamin Clark) (1782-1858)
Date

1840
People

Artist: Asahel Lynde Powers, American 1813 - 1843
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Mr. and Mrs. John S. Barss, 1979.316

Human Generated Data

Title

Mary Smith Clark (Mrs. Benjamin Clark) (1782-1858)

People

Artist: Asahel Lynde Powers, American 1813 - 1843

Date

1840

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Art 96.8
Painting 85.3
Person 84.1
Human 84.1

Clarifai
created on 2018-03-23

people 99.7
adult 98.5
veil 98.3
portrait 98.2
woman 97.3
one 97
necklace 96.1
wear 95.8
costume 94.9
royalty 93.9
religion 92.3
dress 90.9
jewelry 90.2
painting 87.9
outfit 86.4
lid 86.2
retro 83.3
princess 83.1
leader 82.4
crown 81.2

Imagga
created on 2018-03-23

costume 100
person 29
hat 25.5
crown 24.4
people 23.4
portrait 23.3
dress 20.8
attractive 20.3
adult 20.1
face 19.9
pretty 19.6
fashion 18.9
model 18.7
crown jewels 18.2
smile 17.1
culture 17.1
lady 17
traditional 16.6
religion 16.1
clothing 15.7
happy 15.7
gold 14.8
tradition 14.8
expression 14.5
women 14.2
smiling 13.8
sexy 13.7
headdress 12.8
ruler 12.5
art 12.4
black 12.2
wearing 11.4
human 11.3
golden 11.2
make 10.9
cute 10.8
posing 10.7
ethnic 10.5
looking 10.4
style 10.4
love 10.3
happiness 10.2
man 10.1
cap 10
studio 9.9
cheerful 9.8
one 9.7
bride 9.6
antique 9.5
hair 9.5
religious 9.4
clothes 9.4
holiday 9.3
rustic 9.3
wedding 9.2
vintage 9.1
regalia 9.1
gorgeous 9.1
fun 9
mask 8.6
old 8.4
church 8.3
nice 8.2
pose 8.2
romantic 8
interior 8
princess 7.9
brunette 7.8
veil 7.8
carnival 7.8
ancient 7.8
spirituality 7.7
spiritual 7.7
temple 7.6
gown 7.6
inside 7.4
20s 7.3
decoration 7.2
celebration 7.2
colorful 7.2
white 7.1

Google
created on 2018-03-23

portrait 92.7
painting 90.7
lady 88.9
art 67.5
gentleman 62.5
artwork 60.1
girl 52.3
abbess 50.3

Microsoft
created on 2018-03-23

person 91.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 97.7%
Calm 69.6%
Surprised 2%
Happy 16.3%
Sad 4.4%
Disgusted 1.1%
Confused 2.4%
Angry 4.2%

Microsoft Cognitive Services

Age 73
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 85.3%
Person 84.1%

Captions

Microsoft

a person standing in front of a statue 81.8%
a statue of a person 81.7%
a woman standing in front of a statue of a man 73.3%