Human Generated Data

Title

Portrait of a Boy with a Bird

Date

c. 1800

People

Artist: Augustin Esteve, Spanish 1753 - 1820

Previous attribution: Unidentified Artist,

Previous attribution: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Charles E. Dunlap, 1966.49

Human Generated Data

Title

Portrait of a Boy with a Bird

People

Artist: Augustin Esteve, Spanish 1753 - 1820

Previous attribution: Unidentified Artist,

Previous attribution: Francisco José de Goya y Lucientes, Spanish 1746 - 1828

Date

c. 1800

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Clothing 99.7
Apparel 99.7
Person 97.6
Human 97.6
Hat 96.9
Female 70.7
Art 69.6
Painting 69.6
Shoe 68.5
Footwear 68.5
Girl 63.2
Portrait 61
Photography 61
Face 61
Photo 61
Bonnet 58.7
Costume 56.9

Clarifai
created on 2020-04-24

people 99.9
one 99.6
adult 99.1
portrait 99
wear 97.4
royalty 96.2
woman 95.6
lid 94
veil 92.3
print 91.9
outfit 91.6
leader 91.6
administration 91.1
art 90.7
engraving 84.9
man 84.6
actress 84.3
music 84
outerwear 82.7
coat 81.8

Imagga
created on 2020-04-24

fashion 30.9
model 26.4
clothing 24.7
hat 24.7
people 24
person 23.3
sexy 23.3
portrait 22.6
adult 22.1
posing 20.4
attractive 20.3
headdress 20.2
style 17.8
pretty 17.5
hair 17.4
lady 17
cowboy hat 16.6
covering 16.5
black 15.3
cute 15.1
sensual 14.5
elegance 14.3
blond 14.2
standing 13.9
elegant 13.7
sensuality 13.6
human 13.5
face 13.5
sombrero 13.1
urban 13.1
wall 12.8
one 12.7
dress 12.7
interior 12.4
man 12.1
garment 12
casual 11.9
vintage 11.6
body 11.2
make 10.9
prayer rug 10.8
skirt 10.4
skin 10.2
street 10.1
happy 10
consumer goods 9.8
old 9.8
vogue 9.7
brunette 9.6
women 9.5
expression 9.4
clothes 9.4
male 9.4
outfit 9.3
city 9.1
alone 9.1
pose 9.1
building 8.7
lifestyle 8.7
jeans 8.6
rug 8.6
legs 8.5
modern 8.4
outdoors 8.2
teenager 8.2
stylish 8.1
performer 8
sculpture 8
architecture 7.9
indoors 7.9
high 7.8
sitting 7.7
youth 7.7
grunge 7.7
hairstyle 7.6
cover girl 7.6
erotic 7.6
head 7.6
art 7.4
world 7.4
retro 7.4
smiling 7.2
looking 7.2
lovely 7.1
look 7

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 7-17
Gender Female, 87.1%
Sad 0.5%
Disgusted 0.7%
Angry 0.5%
Fear 0.4%
Surprised 25.3%
Happy 3.9%
Calm 66.4%
Confused 2.3%

Microsoft Cognitive Services

Age 19
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.6%
Hat 96.9%
Painting 69.6%
Shoe 68.5%

Captions

Microsoft

a person standing in front of a door 91.2%
a person standing in front of a building 85.9%
a person standing in a doorway 85.8%