Human Generated Data

Title

Holy Family with Infant Saint John

Date

c. 1670

People

Artist: Bartolomé Esteban Murillo, Spanish 1618 - 1682

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Nettie G. Naumburg, 1930.189

Human Generated Data

Title

Holy Family with Infant Saint John

People

Artist: Bartolomé Esteban Murillo, Spanish 1618 - 1682

Date

c. 1670

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-23

Art 99.9
Painting 99.9
Person 99.2
Human 99.2
Person 99
Person 97.7
Person 91.1

Clarifai
created on 2020-04-23

art 99.7
woman 99.3
people 99.2
painting 98.5
baby 97.8
son 97.8
man 97.6
child 97.3
family 97
Renaissance 96.8
adult 96.6
two 95.8
affection 95.6
love 94.8
portrait 94.6
Mary 94.5
group 92.1
sit 92.1
religion 91.2
saint 89.7

Imagga
created on 2020-04-23

kin 74.5
mother 52.7
family 45.4
couple 41.8
male 38.9
love 37.9
man 37.7
people 35.7
together 35.1
adult 34.3
happy 33.2
parent 32.2
portrait 30.4
child 30
happiness 28.2
home 27.9
attractive 26.6
smiling 26.1
husband 24.3
father 24.2
two 23.7
daughter 23.2
brother 22.3
loving 22
smile 20.7
casual 20.3
son 19.4
wife 19
person 18.8
hug 18.4
room 18.3
relationship 17.8
sofa 17.2
sitting 17.2
joy 16.7
hair 16.7
women 16.6
boy 16.5
cute 16.5
affectionate 16.5
face 16.3
pretty 16.1
romance 16.1
lifestyle 15.9
fun 15.7
affection 15.5
cheerful 15.5
boyfriend 15.4
girlfriend 15.4
group 14.5
couch 14.5
sexy 14.5
looking 14.4
interior 14.2
lady 13.8
dad 13.7
expression 13.7
fashion 13.6
handsome 13.4
togetherness 13.2
indoors 13.2
girls 12.8
hugging 11.7
leisure 11.6
kid 11.5
youth 11.1
children 10.9
married 10.6
human 10.5
laughing 10.4
friends 10.3
model 10.1
buddy 10.1
relaxing 10
embracing 9.8
30s 9.6
play 9.5
adults 9.5
20s 9.2
sensuality 9.1
posing 8.9
life 8.8
embrace 8.8
lovers 8.7
clothing 8.6
men 8.6
close 8.6
bed 8.5
living 8.5
sit 8.5
passion 8.5
black 8.4
holding 8.3
childhood 8.1
little 8
living room 7.8
parents 7.8
sister 7.8
bonding 7.8
desire 7.7
four 7.7
jeans 7.7
lifestyles 7.6
one 7.5
joyful 7.4
sensual 7.3
dress 7.2
romantic 7.1

Google
created on 2020-04-23

Painting 96.4
Art 83.9
Visual arts 76.4
Portrait 70.3
Mythology 64.4
Still life 54.5

Microsoft
created on 2020-04-23

painting 99.7
art 98.2
person 98.2
indoor 92.5
baby 91.4
text 91.1
human face 88.3
drawing 84.7
woman 62.3
crowd 0.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 16-28
Gender Female, 73.3%
Calm 32%
Angry 2%
Confused 31%
Fear 2.5%
Happy 0.2%
Surprised 0.8%
Sad 31.2%
Disgusted 0.3%

AWS Rekognition

Age 7-17
Gender Female, 98.9%
Fear 0.1%
Disgusted 0.1%
Confused 0.1%
Sad 3%
Happy 0.1%
Surprised 0.1%
Angry 0.2%
Calm 96.2%

AWS Rekognition

Age 37-55
Gender Male, 96.1%
Fear 0.2%
Sad 90%
Happy 0.4%
Angry 0.4%
Calm 8%
Disgusted 0.1%
Surprised 0.1%
Confused 0.8%

AWS Rekognition

Age 2-8
Gender Male, 76%
Happy 10.9%
Fear 3%
Disgusted 2.7%
Calm 40%
Surprised 5.1%
Sad 3.5%
Confused 1.5%
Angry 33.2%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 99.9%
Person 99.2%

Captions

Microsoft

a group of people around each other 70.8%
a group of people posing for the camera 70.7%
a group of people posing for a picture 70.6%

Text analysis

Amazon

ECCE

Google

ECCE AGNV
ECCE
AGNV