Human Generated Data

Title

The Virgin and Child in a Landscape
Date

c. 1536-1537
People

Artist: Girolamo Mazzola Bedoli, Italian c. 1505 - c. 1570
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift in part of Barbara B. Paine and purchase in part from Mrs. Ernest Angell Trust Fund and Richard Norton Fund, 1972.22

Human Generated Data

Title

The Virgin and Child in a Landscape

People

Artist: Girolamo Mazzola Bedoli, Italian c. 1505 - c. 1570

Date

c. 1536-1537

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-01

Painting 99.8
Art 99.8
Human 97.3
Person 97.3
Person 82.6
Person 62.9

Clarifai
created on 2018-04-18

baby 99.3
people 98.7
child 98.2
adult 97.3
woman 97.3
reclining 97
two 96.2
son 95.5
girl 95.2
family 91.7
offspring 87.1
ma 85.8
sit 83.4
painting 80.9
recreation 80.8
portrait 80.3
outdoors 79.5
love 79.4
affection 78.9
nude 78.4

Imagga
created on 2018-04-18

outdoors 31.6
people 26.8
summer 25.1
person 24.6
happy 24.4
male 23.4
smiling 23.2
park 22.2
man 22.2
tree 20.9
adult 20.7
smile 20.7
fun 20.2
sitting 18.9
happiness 18.8
child 18.8
grass 18.2
love 17.4
rustic 16.5
outside 16.3
attractive 16.1
leisure 15.8
couple 15.7
lifestyle 15.2
relax 15.2
family 15.1
cute 15.1
together 14.9
portrait 14.9
outdoor 14.5
women 14.2
joy 14.2
cheerful 13.8
relaxing 13.6
youth 13.6
forest 13.3
face 12.8
blond 12.8
natural 12.7
country 12.3
boy 12.2
spring 11.9
vacation 11.5
water 11.3
pretty 11.2
two 11
model 10.9
garden 10.2
relaxation 10.1
mother 10
activity 9.9
standing 9.6
day 9.4
girls 9.1
husband 8.9
kid 8.9
hair 8.7
affection 8.7
mammal 8.6
loving 8.6
sit 8.5
casual 8.5
hay 8.4
mature 8.4
field 8.4
calm 8.2
children 8.2
sexy 8
trees 8
sunny 7.8
wife 7.6
togetherness 7.6
relaxed 7.5
one 7.5
holding 7.4
parent 7.4
lake 7.3
lady 7.3
playing 7.3
sun 7.2
meadow 7.2
romance 7.1
river 7.1

Google
created on 2018-04-18

painting 93.9
tree 76.9
art 71.1
girl 64.4
grass 60.5
woodland 58.4
mythology 56.7
portrait 56.4
forest 55
artwork 51.2

Microsoft
created on 2018-04-18

person 96.1
outdoor 90.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 11-18
Gender Female, 99.8%
Angry 4.3%
Confused 3.1%
Calm 77.5%
Sad 7.4%
Disgusted 2%
Happy 3.7%
Surprised 1.8%

AWS Rekognition

Age 2-5
Gender Female, 94.6%
Happy 3.6%
Angry 1.9%
Confused 2.4%
Sad 6.2%
Disgusted 1.4%
Surprised 1.1%
Calm 83.4%

Microsoft Cognitive Services

Age 56
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.8%
Person 97.3%

Captions

Microsoft

a person sitting next to a body of water 66.8%
a person sitting next to a body of water 66.6%
a person sitting next to a body of water 56%