Human Generated Data

Title

Maria Margaret La Primaudaye Pollen (Mrs. Hungerford Pollen) (d. 1919)

Date

1915

People

Artist: H. Harris Brown, British 1864 - 1948

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1938.6

Human Generated Data

Title

Maria Margaret La Primaudaye Pollen (Mrs. Hungerford Pollen) (d. 1919)

People

Artist: H. Harris Brown, British 1864 - 1948

Date

1915

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 97.2
Face 97.2
Painting 95.3
Art 95.3
Person 94.9
Photography 77.2
Photo 77.2
Portrait 77.2
Clothing 69.8
Apparel 69.8
Text 66.5
Head 60.9

Clarifai
created on 2020-04-24

portrait 100
people 99.9
one 99.7
engraving 99.3
adult 99.1
art 98.6
leader 98.1
scientist 97
print 96.5
writer 96
man 95.3
illustration 94.1
poet 93.5
politician 92.7
old 92.7
painting 92.6
philosopher 91.3
wear 90.4
elderly 89.6
facial expression 87.1

Imagga
created on 2020-04-24

portrait 37.5
person 29
face 27.7
blond 25.2
people 23.4
senior 23.4
adult 22.6
grandma 20.4
man 20.2
hair 19.8
old 19.5
one 19.4
expression 18.8
black 18.1
mature 17.7
crazy 17.6
elderly 16.3
mask 15.5
lady 15.4
attractive 14.7
retired 14.5
happy 14.4
retirement 14.4
smile 14.3
male 14.2
pretty 14
grandmother 13.7
human 12.8
head 11.8
clothing 11.3
eyes 11.2
covering 10.8
mother 10.7
fashion 10.6
attire 10.5
look 10.5
looking 10.4
wig 10
gray 9.9
god 9.6
happiness 9.4
lifestyle 9.4
model 9.3
hand 9.1
negative 9
pension 8.9
body 8.8
smiling 8.7
age 8.6
health 8.3
aged 8.1
currency 8.1
skin 8
art 8
depression 7.8
golden 7.7
men 7.7
elegant 7.7
culture 7.7
pain 7.7
money 7.7
sculpture 7.6
close 7.4
costume 7.4
closeup 7.4
emotion 7.4
alone 7.3
business 7.3
sexy 7.2
hairpiece 7.2
cute 7.2
love 7.1
film 7.1

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

drawing 99.6
painting 99.6
sketch 99.4
human face 98.9
text 98.5
person 94
portrait 93.9
old 93.7
black and white 82.1
picture frame 81.8
clothing 77.6
blackboard 76.9
child art 74.4
woman 73.8
black 69
plaque 37.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 50-68
Gender Female, 94.7%
Fear 0.4%
Confused 2.1%
Calm 81.6%
Angry 3.5%
Surprised 1%
Sad 10.8%
Disgusted 0.3%
Happy 0.4%

Microsoft Cognitive Services

Age 57
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 95.3%
Person 94.9%

Captions

Microsoft

an old photo of a person 85.2%
an old photo of a person 82.4%
old photo of a person 82.3%

Text analysis

Google

2952A22A AGASNY
2952A22A
AGASNY