Human Generated Data

Title

The Gypsy Girl, after Hals
Date

1902
People

Artist: Giovanni Battista Troccoli, American 1882 - 1940

Artist after: Frans Hals, Dutch 1581 - 1666
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Denman W. Ross, Class of 1875, 1936.150.106

Human Generated Data

Title

The Gypsy Girl, after Hals

People

Artist: Giovanni Battista Troccoli, American 1882 - 1940

Artist after: Frans Hals, Dutch 1581 - 1666

Date

1902

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Painting 98.4
Art 98.4
Human 70.7
Person 70.7

Clarifai
created on 2020-04-23

art 99.5
painting 99.5
people 99.5
portrait 99.4
one 98.3
wear 98
woman 97.5
adult 97.3
print 94.1
dress 89.8
queen 87.2
book bindings 85
vintage 84.2
veil 83.2
retro 82.2
illustration 79.1
necklace 77.3
jewelry 76.8
royalty 76.7
literature 76.4

Imagga
created on 2020-04-23

attractive 40.6
adult 36.9
love 35.6
pretty 34.3
couple 32.3
sexy 31.4
portrait 29.2
hair 28.6
person 27
man 26.9
people 26.8
male 25.8
happy 24.5
model 23.4
lady 21.9
together 21.9
sensual 21.9
happiness 21.2
brunette 20.9
smile 20.7
fashion 20.4
mother 19.6
erotic 18.5
face 17.8
two 16.1
gorgeous 15.4
looking 15.2
smiling 15.2
romance 15.2
lifestyle 15.2
lovely 15.1
girls 14.6
cute 14.4
hugging 13.7
expression 13.7
girlfriend 13.5
loving 13.4
eyes 12.9
youth 12.8
casual 12.7
kiss 12.7
joy 12.5
family 12.5
lips 12
body 12
parent 11.9
sensuality 11.8
husband 11.7
hug 11.6
lovers 11.6
romantic 11.6
posing 11.6
married 11.5
skin 11.4
look 11.4
cheerful 11.4
black 11.3
passion 11.3
relationship 11.3
sitting 11.2
women 11.1
brown 11.1
cover girl 10.8
handsome 10.7
boyfriend 10.6
clothing 10.6
groom 10.2
long 10.1
teenager 10
wig 10
dress 10
kissing 9.8
human 9.8
style 9.7
bride 9.6
boy 9.6
seductive 9.6
world 9.6
lingerie 9.5
guy 9.3
elegance 9.2
teen 9.2
make 9.1
costume 8.9
intimacy 8.9
blond 8.9
hands 8.7
serious 8.6
elegant 8.6
close 8.6
marriage 8.6
studio 8.4
holding 8.3
pose 8.2
passionate 7.9
embrace 7.8
affection 7.7
naked 7.7
sexual 7.7
laugh 7.7
wife 7.6
dark 7.5
friends 7.5
fun 7.5
one 7.5
outdoors 7.5
wedding 7.4
joyful 7.4
makeup 7.3
child 7.3
valentine 7.3
hairpiece 7.2
garment 7

Google
created on 2020-04-23

Painting 97.6
Portrait 95.5
Self-portrait 90.9
Art 88.5
Visual arts 72.2
Watercolor paint 71.5
Iris 67.8
Artist 64.8
Modern art 59.2
Artwork 59.1
Long hair 56.4

Microsoft
created on 2020-04-23

painting 99.9
drawing 99.8
sketch 99.6
person 98.1
human face 96.7
child art 92.4
portrait 91
text 81.8
woman 78.4
art 76.1

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 13-23
Gender Female, 96.8%
Fear 0.2%
Calm 17.6%
Disgusted 0.5%
Happy 78.2%
Angry 0.3%
Sad 0.4%
Surprised 2.4%
Confused 0.4%

Microsoft Cognitive Services

Age 26
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.4%
Person 70.7%

Captions

Microsoft

a person taking a selfie 80%
a person sitting on a bed 51.3%
a person sitting on a couch 51.2%

Text analysis

Amazon

1902
.B.TrOCeOLI. 1902
.B.TrOCeOLI.

Google

G.B.TroccolI,
G.B.TroccolI, 1902
1902