Human Generated Data

Title

Portrait of an Elderly Lady

Date

1690-1700

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Grenville L. Winthrop, 1943.216

Human Generated Data

Title

Portrait of an Elderly Lady

People

Artist: Unidentified Artist,

Date

1690-1700

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Clothing 98.5
Apparel 98.5
Art 96.8
Painting 96.5
Human 84.1
Person 84.1
Bonnet 71.6
Hat 71.6

Clarifai
created on 2018-03-16

woman 98.6
religion 97.1
spirituality 95.6
people 94.5
one 93.5
gown (clothing) 93.3
wear 92.6
veil 91.8
fashion 91.8
nun 90.2
indoors 88.2
portrait 87.6
dark 85.7
scarf 85.4
adult 83.3
adolescent 82.9
hijab 81.5
gown 80.5
hood 77.1
Madonna 76.8

Imagga
created on 2018-03-16

cloak 65.8
covering 52
person 49.8
white 47.7
portrait 34.3
face 34.1
adult 25.9
clothing 25
people 24
robe 23.5
man 22.8
model 21
attractive 21
ruler 19.9
eyes 19.8
fashion 19.6
happy 19.4
expression 18.8
male 18.4
smile 17.8
garment 17
clothes 16.9
black 16.8
pretty 16.8
hat 15.5
cute 14.3
costume 14.2
lady 13
sexy 12.8
human 12.7
religion 12.5
dark 12.5
handsome 12.5
traditional 11.6
smiling 11.6
wearing 11.4
one 11.2
casual 11
20s 11
posing 10.7
winter 10.2
head 10.1
pose 10
hood 9.8
scarf 9.8
hair 9.5
youth 9.4
nice 9.2
gorgeous 9.1
dress 9
blond 9
veil 8.8
looking 8.8
lifestyle 8.7
ethnic 8.6
cap 8.4
studio 8.4
cheerful 8.1
lovely 8
women 7.9
mask 7.7
fashionable 7.6
religious 7.5
make 7.3

Google
created on 2018-03-16

Microsoft
created on 2018-03-16

person 96

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Female, 99.1%
Confused 0.7%
Sad 1.5%
Surprised 0.8%
Calm 95.4%
Happy 0.5%
Disgusted 0.5%
Angry 0.6%

Microsoft Cognitive Services

Age 59
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 96.5%
Person 84.1%

Captions

Microsoft

Freda Jackson looking at the camera 90.1%
Freda Jackson wearing a black shirt 83.5%
Freda Jackson in a black shirt 83.4%