Human Generated Data

Title

Susannah Powell Mason (Mrs. Jonathan Mason)
Date

1803-1804
People

Artist: Gilbert Stuart, American 1755 - 1828
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Florence H. Phillips in memory of Mason and Florence Pierson Hammond, 2013.31

Human Generated Data

Title

Susannah Powell Mason (Mrs. Jonathan Mason)

People

Artist: Gilbert Stuart, American 1755 - 1828

Date

1803-1804

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Clothing 99
Apparel 99
Person 97.1
Human 97.1
Bonnet 95.8
Hat 95.8
Painting 89.8
Art 89.8
Lace 73.2
Linen 57.4
Home Decor 57.4

Clarifai
created on 2020-04-23

portrait 99.2
people 99.2
wear 98.4
princess 96.4
girl 96.1
one 95.1
dress 94
lid 93.3
wedding 92.6
art 91.9
veil 91.6
tiara 90.5
queen 90
fashion 89.4
woman 89.3
necklace 89
jewelry 87.2
child 87
bride 85.9
painting 80.4

Imagga
created on 2020-04-23

shower cap 100
cap 100
headdress 100
clothing 71.6
consumer goods 35.3
portrait 35
covering 34.4
smile 32.1
face 29.9
person 29
attractive 28
people 24.6
happy 24.5
hair 23.8
pretty 23.1
eyes 22.4
adult 22
smiling 21.7
looking 21.6
bride 21.1
model 20.2
fashion 18.9
cute 18
wedding 17.5
love 17.4
happiness 17.3
blond 15.4
lady 14.6
curler 14.5
sexy 14.5
dress 14.5
human 14.3
child 14.2
cheerful 13.8
veil 13.7
women 12.7
hat 12.6
studio 12.2
one 12
expression 12
girls 11.9
mechanical device 11.6
youth 11.1
skin 11
20s 11
make 10.9
natural 10.7
kid 10.6
brunette 10.5
friendly 10.1
care 9.9
health 9.7
lifestyle 9.4
male 9.2
joy 9.2
fresh 9.2
alone 9.1
gorgeous 9.1
little 8.8
boy 8.7
mechanism 8.6
life 8.6
casual 8.5
head 8.4
purity 8.3
long 8.3
fun 8.2
sensual 8.2
costume 8.1
man 8.1
celebration 8
holiday 7.9
couple 7.8
married 7.7
style 7.4
teenager 7.3
black 7.2
body 7.2
home 7.2
childhood 7.2
posing 7.1
day 7.1

Google
created on 2020-04-23

Hair 97.4
Headpiece 87.8
Hairstyle 86.9
Portrait 81
Headgear 74.2
Bridal accessory 71
Painting 64.6
Hair accessory 64.1
Fashion accessory 57.7
Vintage clothing 55.9
Child 52
Art 50.2

Microsoft
created on 2020-04-23

person 99.3
human face 97
fashion accessory 94.2
painting 94.1
indoor 89.9
text 88.5
portrait 81.8
art 80
clothing 76.6
posing 41.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 31-47
Gender Female, 98%
Angry 3.2%
Sad 5.4%
Fear 1.2%
Surprised 1.2%
Happy 2.2%
Confused 5.7%
Calm 76.5%
Disgusted 4.6%

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.1%
Painting 89.8%

Captions

Microsoft

a person posing for the camera 93.6%
a woman posing for a picture 93.5%
a little girl posing for a picture 73%