Human Generated Data

Title

Madonna and Child with Putti
Date

c. 1475-1500
People

Artist: Master of the Naumberg Madonna and Child, Italian active 1475 - 1500

Previous attribution: Lorenzo di Credi, Italian c. 1456 - 1536
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Nettie G. Naumburg, 1930.195

Human Generated Data

Title

Madonna and Child with Putti

People

Artist: Master of the Naumberg Madonna and Child, Italian active 1475 - 1500

Previous attribution: Lorenzo di Credi, Italian c. 1456 - 1536

Date

c. 1475-1500

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Painting 99.2
Art 99.2
Person 97.1
Human 97.1
Person 87.6
Person 82.4
Person 79.5
Animal 79.4
Bird 79.4

Clarifai
created on 2018-05-08

people 99.5
adult 98.7
child 98.3
baby 97.8
two 97.6
family 96.9
woman 96.7
son 95.6
offspring 95.2
girl 93.3
portrait 93.1
man 92.2
facial expression 92
group 89.2
affection 87.8
love 86.1
wear 86
painting 86
interaction 85.6
three 85.3

Imagga
created on 2018-05-08

family 46.3
child 45.8
mother 44.7
male 40.4
happy 39.5
love 35.5
together 34.2
pajama 33.8
man 31.6
couple 31.4
home 30.3
parent 29.8
father 28.7
adult 28.6
people 27.4
daughter 26.9
smiling 26.1
son 25.5
grandfather 24.7
fun 24
happiness 23.5
clothing 23
smile 22.1
casual 21.2
children 21
boy 20.9
kid 20.4
sitting 19.8
attractive 19.6
nightwear 19.4
brother 19.4
cute 19.4
couch 19.3
husband 19.2
grandma 18.7
lifestyle 18.1
portrait 17.5
loving 16.2
wife 16.1
kids 16
indoors 15.8
person 15.8
playing 15.5
dad 15.5
togetherness 15.1
outdoors 14.9
hug 14.5
two 14.4
laughing 14.2
30s 13.5
little 13.3
cheerful 13
play 12.9
expression 12.8
handsome 12.5
covering 12.4
enjoying 12.3
senior 12.2
mature 12.1
outside 12
joy 11.7
affection 11.6
relationship 11.2
old 11.2
adorable 11.1
20s 11
relaxing 10.9
hugging 10.7
face 10.7
affectionate 10.7
consumer goods 10.6
elderly 10.5
youth 10.2
day 10.2
blond 10.2
baby 10
childhood 9.9
grandmother 9.8
interior 9.7
mom 9.7
sofa 9.6
jeans 9.6
house 9.2
leisure 9.1
pretty 9.1
domestic 9.1
life 8.9
laugh 8.6
offspring 8.5
care 8.2
indoor 8.2
active 8.2
women 7.9
bond 7.9
brunette 7.8
mum 7.8
parents 7.8
parenthood 7.8
bonding 7.8
boyfriend 7.7
married 7.7
trouser 7.6
living 7.6
adults 7.6
sit 7.6
pair 7.6
darling 7.5
relaxed 7.5
room 7.5
holding 7.4
girls 7.3

Google
created on 2018-05-08

painting 90.8
infant 80.3
child 79
mother 77.3
portrait 67.2
art 62.5
girl 59.3
daughter 58.6
artwork 54.3
toddler 52.7

Microsoft
created on 2018-05-08

person 99.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 98.7%
Calm 20.7%
Angry 6.6%
Disgusted 35.1%
Sad 27%
Surprised 2.2%
Happy 4.3%
Confused 4.1%

AWS Rekognition

Age 2-5
Gender Female, 51%
Surprised 2.8%
Confused 18.3%
Disgusted 1.7%
Calm 60.8%
Angry 4.5%
Sad 11.3%
Happy 0.5%

AWS Rekognition

Age 6-13
Gender Male, 57.6%
Sad 35.6%
Confused 1.3%
Happy 0.4%
Disgusted 0.8%
Angry 0.9%
Surprised 1.3%
Calm 59.7%

AWS Rekognition

Age 4-9
Gender Female, 64.1%
Calm 74.5%
Disgusted 10.3%
Angry 2.2%
Happy 2.7%
Confused 1%
Surprised 1.7%
Sad 7.7%

Microsoft Cognitive Services

Age 66
Gender Male

Microsoft Cognitive Services

Age 46
Gender Female

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.2%
Person 97.1%
Bird 79.4%

Captions

Microsoft

a person holding a baby 51.4%
a boy holding a teddy bear 28%
a person holding a baby 27.9%