Human Generated Data

Title

Portrait of Consuelo, Duchess of Manchester (Consuelo Yznaga)
Date

1907
People

Artist: John Singer Sargent, American 1856 - 1925
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1942.53

Human Generated Data

Title

Portrait of Consuelo, Duchess of Manchester (Consuelo Yznaga)

People

Artist: John Singer Sargent, American 1856 - 1925

Date

1907

Classification

Drawings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Grenville L. Winthrop, Class of 1886, 1942.53

Machine Generated Data

Tags

Amazon
created on 2020-05-02

Art 97.2
Painting 97.2
Human 81.5
Person 81.5

Clarifai
created on 2020-05-02

portrait 98.6
woman 98.1
art 98.1
painting 98
people 97.3
artistic 94.5
one 94.3
fashion 92.8
old 92
man 91.1
festival 89.7
girl 89
face 86.4
dirty 85.3
messy 84.7
model 83.9
fun 83.6
adult 82.4
fantasy 82.3
religion 82.1

Imagga
created on 2020-05-02

portrait 37.6
costume 29.7
bride 28.8
person 27.6
face 26.3
wedding 25.8
adult 25.2
pretty 24.5
people 24
love 23.7
sexy 23.3
attractive 22.4
model 21
dress 20.8
smile 20.7
hair 20.6
fashion 20.4
happy 20.1
lady 18.7
body 18.4
crown 18.3
bath 18
water 18
skin 17.1
wet 17
sensual 16.4
clean 15.9
veil 15.7
princess 15.6
joy 15
happiness 14.9
crown jewels 14.9
smiling 13.7
cute 13.6
bridal 13.6
married 13.4
eyes 12.9
shower 12.6
head 12.6
bouquet 12.5
women 11.9
spa 11.7
care 11.5
one 11.2
health 11.1
aristocrat 11
summer 10.9
lifestyle 10.8
erotic 10.8
romantic 10.7
posing 10.7
seductive 10.5
human 10.5
fun 10.5
marriage 10.4
charming 10.4
gown 10.3
blond 10.2
man 10.1
flower 10
groom 9.9
washing 9.7
look 9.6
bathroom 9.6
brunette 9.6
child 9.5
day 9.4
expression 9.4
feminine 9.3
pure 9.3
relaxation 9.2
makeup 9.2
studio 9.1
sensuality 9.1
gorgeous 9.1
boy 8.7
flowers 8.7
hands 8.7
clothing 8.6
life 8.5
fresh 8.5
pleasure 8.5
two 8.5
outdoor 8.4
purity 8.3
drop 8.2
style 8.2
cheerful 8.1
lovely 8
looking 8
celebration 8
wed 7.9
couple 7.8
crazy 7.8
male 7.8
naked 7.7
hand 7.6
relax 7.6
healthy 7.6
outdoors 7.5
top 7.4
regalia 7.4
joyful 7.4
girls 7.3
make 7.3
wig 7.2
kid 7.1

Google
created on 2020-05-02

Painting 95.8
Portrait 93
Watercolor paint 89.5
Art 89.4
Self-portrait 86.7
Visual arts 68.6
Artist 61.1
Acrylic paint 50.6

Microsoft
created on 2020-05-02

painting 99.4
drawing 97.5
sketch 96.9
human face 94.8
art 91.6
child art 86.4
portrait 73.7
person 63.5
text 61.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-42
Gender Female, 97.7%
Surprised 0.1%
Disgusted 0%
Angry 0.2%
Fear 0%
Calm 97.5%
Confused 0.6%
Happy 0.1%
Sad 1.6%

Microsoft Cognitive Services

Age 60
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97.2%
Person 81.5%

Categories

Imagga

people portraits 53%
pets animals 35.9%
events parties 5.8%
paintings art 4.3%

Captions

Microsoft
created on 2020-05-02

a close up of a person 73.1%
a person taking a selfie 49.7%
close up of a person 49.6%

Text analysis

Amazon

h