Human Generated Data

Title

Madonna of the Goldfinch

Date

18th century

People

Artist: Raphael Morghen, Italian 1758 - 1833

Artist: Manuel Esquivel Sotomayor, Spanish 1777-1842

Artist: Antonio Morghen, Italian 18th-19th centuries

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R12721

Human Generated Data

Title

Madonna of the Goldfinch

People

Artist: Raphael Morghen, Italian 1758 - 1833

Artist: Manuel Esquivel Sotomayor, Spanish 1777-1842

Artist: Antonio Morghen, Italian 18th-19th centuries

Artist after: Raphael, Italian 1483 - 1520

Date

18th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 96.9
Human 96.9
Art 94.5
Person 93.1
Person 91.6
Painting 86.1
Portrait 61.7
Face 61.7
Photography 61.7
Photo 61.7
Drawing 60.7
Person 51.6

Imagga
created on 2022-01-22

hog 100
swine 100
ungulate 46.2
mother 22.6
man 20.8
family 20.5
people 20.1
adult 20
farm 19.6
piglet 19
happy 17.5
couple 17.4
love 17.4
male 17.1
person 16.5
pig 16.4
child 16.1
together 15.8
cute 15.1
portrait 14.9
couch 14.5
smiling 14.5
lifestyle 13.7
home 13.6
smile 13.5
face 13.5
pork 13.4
parent 13.2
fun 12.7
hair 12.7
life 12.7
attractive 12.6
mammal 12.5
piggy 12.5
husband 12.5
wife 12.3
pink 11.7
elderly 11.5
senior 11.2
sitting 11.2
old 11.1
snout 10.8
outdoors 10.4
father 10.2
model 10.1
relaxing 10
domestic 9.9
agriculture 9.6
baby 9.5
togetherness 9.4
happiness 9.4
blond 9.3
outdoor 9.2
fashion 9
summer 9
pigs 8.9
sexy 8.8
looking 8.8
body 8.8
sofa 8.7
casual 8.5
two 8.5
warthog 8.4
joy 8.4
pet 8.3
cheerful 8.1
women 7.9
caring 7.9
livestock 7.8
sleeping 7.8
sleep 7.8
retired 7.8
affection 7.7
retirement 7.7
loving 7.6
hand 7.6
healthy 7.6
human 7.5
one 7.5
mature 7.4
animals 7.4
adorable 7.4
lady 7.3
dirty 7.2
dress 7.2
romance 7.1
skin 7.1
interior 7.1

Google
created on 2022-01-22

Art 82.5
Adaptation 79.2
People 77.8
Vintage clothing 72.5
Toddler 70.9
Baby 69.2
Illustration 67.4
Visual arts 65.9
Stock photography 63.3
Photo caption 63.2
Sitting 62
Painting 61.9
History 60
Handwriting 57.8
Antique 56.6
Room 56
Happy 55.7
Plant 55.6
Child 54.5
Retro style 53.3

Microsoft
created on 2022-01-22

baby 98.9
text 98.5
human face 96.9
person 96.5
toddler 96.1
clothing 94.6
smile 81.2
boy 65.1
picture frame 64.9
child 62.8
old 50.8
posing 40.5
vintage 32.1

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 20-28
Gender Male, 55.2%
Sad 63.7%
Calm 22.4%
Angry 3.3%
Confused 3.3%
Happy 3.1%
Disgusted 1.9%
Surprised 1.7%
Fear 0.6%

AWS Rekognition

Age 1-7
Gender Male, 99.5%
Calm 93.8%
Sad 3.9%
Angry 0.9%
Confused 0.4%
Fear 0.3%
Surprised 0.3%
Happy 0.3%
Disgusted 0.2%

AWS Rekognition

Age 18-24
Gender Female, 97.4%
Calm 75.2%
Sad 18.5%
Confused 1.7%
Angry 1.4%
Surprised 1%
Disgusted 0.8%
Happy 0.7%
Fear 0.6%

Microsoft Cognitive Services

Age 28
Gender Female

Feature analysis

Amazon

Person 96.9%
Painting 86.1%

Captions

Microsoft

a vintage photo of a person 77.3%
a vintage photo of a person 75.2%
a vintage photo of a man and a woman posing for a picture 45.5%

Text analysis

Amazon

MATER
delle
PULCRAE
MATER PULCRAE DILECTIONIS
Belle
DILECTIONIS
Arti
Presidente
Belle Arti de
O. Auntore delle
Ocbi Sly Presidente
de
H96
O.
Sly
Nicoli
Ocbi
Nicoli Saleette
Auntore
Saleette
Baltizio
(Fierentino
Black
Black windo
good.
د good.
windo
د
Mont

Google

PULCRAE
Sdoeth
MATER PULCRAE DILECTIONIS Nwle Sdoeth Twrentine O fuutere delle Belle Arti &.
O
fuutere
Arti
MATER
Belle
&.
DILECTIONIS
Nwle
Twrentine
delle