Human Generated Data

Title

Madonna of the Goldfinch

Date

19th-20th century

People

Artist: Timothy Cole, American 1852 - 1931

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gray Collection of Engravings Fund, G7118

Human Generated Data

Title

Madonna of the Goldfinch

People

Artist: Timothy Cole, American 1852 - 1931

Artist after: Raphael, Italian 1483 - 1520

Date

19th-20th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 97.4
Human 97.4
Person 95.1
Art 93.9
Painting 93.9
Person 90.2

Imagga
created on 2022-02-26

mother 45
parent 40.7
child 30.7
adult 29.2
people 29
happy 27.6
man 26.9
portrait 25.2
sitting 24.9
together 24.5
male 24.2
family 24
smiling 22.4
father 22.4
couple 21.8
attractive 19.6
couch 19.3
dad 19.2
person 19.1
love 18.9
casual 18.6
kin 18.6
home 18.3
sofa 17.8
smile 17.8
lifestyle 16.6
face 16.3
lady 16.2
wife 15.2
happiness 14.9
cute 14.3
model 14
pretty 14
looking 13.6
husband 13.6
fun 13.5
women 13.4
daughter 13.3
boy 13
sexy 12.8
hair 12.7
jeans 12.4
outdoors 11.9
two 11.9
relaxing 11.8
togetherness 11.3
fashion 11.3
senior 11.2
relationship 11.2
room 11.2
old 11.1
grandma 11.1
joy 10.9
life 10.8
kid 10.6
loving 10.5
cheerful 9.8
human 9.7
interior 9.7
one 9.7
elderly 9.6
brother 9.5
sit 9.5
relaxed 9.4
relax 9.3
garden 9.2
playing 9.1
park 9.1
dress 9
chair 8.8
brunette 8.7
youth 8.5
son 8.4
mature 8.4
handsome 8
mum 7.8
black 7.8
grandfather 7.7
affection 7.7
outdoor 7.6
hand 7.6
laughing 7.6
elegance 7.6
head 7.6
aged 7.2
body 7.2
posing 7.1
summer 7.1
indoors 7

Google
created on 2022-02-26

Musical instrument 87.7
Art 80.8
Baby 74.2
Vintage clothing 73.9
Toddler 66.8
Illustration 66
Visual arts 64.8
Sitting 63.9
History 63.7
Child 62.1
Room 61.8
Antique 61
Wood 57.7
Ball 55.4
Painting 55.2
Folk instrument 54.1
Retro style 51.9

Microsoft
created on 2022-02-26

wall 99.9
person 95.4
indoor 94.7
baby 94.4
clothing 93.8
human face 90.9
gallery 87.5
text 87.3
toddler 84
child 78.9
smile 77.7
room 71.5
posing 43.7
painting 18.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-24
Gender Female, 99.8%
Calm 96%
Sad 1.9%
Disgusted 0.5%
Happy 0.5%
Confused 0.5%
Angry 0.4%
Surprised 0.2%
Fear 0.2%

AWS Rekognition

Age 2-8
Gender Male, 81.1%
Calm 96.8%
Angry 1.6%
Sad 0.5%
Disgusted 0.3%
Confused 0.3%
Surprised 0.3%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Female, 98.8%
Calm 41.8%
Happy 23.7%
Angry 19%
Disgusted 6%
Sad 3.7%
Surprised 2%
Fear 1.9%
Confused 1.9%

Microsoft Cognitive Services

Age 24
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Painting 93.9%

Captions

Microsoft

a person sitting in front of a mirror posing for the camera 39.9%
a person standing in front of a mirror posing for the camera 39.8%
a painting of a person 39.7%

Text analysis

Amazon

Limothy
Coll
Limothy Coll MLA
MLA