Human Generated Data

Title

Susan M. Sherman Farrar (Mrs. Ezra Farrar) (1821-1891)
Date

1846
People

Artist: Mrs. Darling, American

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Miss Edith Marshall, 1957.49

Human Generated Data

Title

Susan M. Sherman Farrar (Mrs. Ezra Farrar) (1821-1891)

People

Artist: Mrs. Darling, American

Date

1846

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-07

Pendant 100
Human 98.6
Person 98.6
Accessories 81.2
Jewelry 81.2
Accessory 81.2
Locket 81.2
Necklace 59.4

Clarifai
created on 2018-03-23

fashion 95.1
retro 94.8
woman 94.7
portrait 94.6
people 94.5
art 94
one 93.8
antique 92.1
illustration 91.6
desktop 90.8
vintage 89.7
wear 87.9
love 87.7
style 87.5
old 87.1
symbol 86.3
girl 86.1
face 85.2
jewelry 84.7
cute 84.4

Imagga
created on 2018-03-23

sombrero 100
hat 100
headdress 81.4
clothing 57.2
percussion instrument 40.4
gong 34.2
musical instrument 30.3
covering 28.3
consumer goods 27.2
pretty 20.3
portrait 19.4
face 17.7
fashion 17.3
person 17.2
attractive 16.8
chime 16.3
sexy 16.1
people 15.1
happy 14.4
smile 14.2
closeup 14.1
model 14
gorgeous 13.6
hair 13.5
close 13.1
old 12.5
adult 12.3
lady 12.2
currency 11.7
retro 11.5
fun 11.2
money 11
smiling 10.8
women 10.3
holiday 10
straw 9.6
black 9.6
brown 9.6
season 9.3
cute 9.3
traditional 9.1
leisure 9.1
make 9.1
outdoors 9
cowboy 8.8
antique 8.6
eyes 8.6
art 8.5
vintage 8.3
makeup 8.2
cash 8.2
one 8.2
sensual 8.2
style 8.2
blond 8.1
lovely 8
brunette 7.8
summer 7.7
child 7.5
symbol 7.4
decoration 7.4
metal 7.2
lifestyle 7.2
bank 7.2
financial 7.1
posing 7.1
kid 7.1

Google
created on 2018-03-23

fashion accessory 83.9
jewellery 83.5

Microsoft
created on 2018-03-23

woman 96.7
person 94.9
beautiful 60.8
posing 58.5
accessory 34.7
pretty 25.1
locket 18.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 99%
Confused 2.9%
Calm 66.1%
Angry 12.3%
Sad 10.3%
Surprised 5.2%
Disgusted 1.3%
Happy 1.9%

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.6%
Locket 81.2%

Captions

Microsoft

a woman wearing a costume posing for the camera 84.1%
a woman posing for a picture 84%
a person posing for the camera 83.9%