Human Generated Data

Title

Madonna and Child

Date

15th century

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Miss Belle Da Costa Greene, 1938.13

Human Generated Data

Title

Madonna and Child

People

Artist: Unidentified Artist,

Date

15th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Miss Belle Da Costa Greene, 1938.13

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Art 95.2
Human 92.1
Person 91.4
Person 91.4
Painting 87.5
Face 85.6
Drawing 78.7
Photo 72.5
Portrait 72.5
Photography 72.5
Apparel 69.6
Clothing 69.6
People 66.8
Sketch 59.7
Poster 57.5
Advertisement 57.5
Collage 57.5

Clarifai
created on 2020-04-24

people 99.8
child 99.5
two 98.5
portrait 98
wear 96.5
baby 95.8
one 95.5
princess 94.2
offspring 93.6
art 92.7
son 91.3
adult 91
group 90.7
three 89.6
family 87.6
royalty 87.6
sibling 85.6
retro 84.5
facial expression 82.6
monochrome 81.7

Imagga
created on 2020-04-24

mother 61.8
parent 49.5
child 42.3
portrait 30.4
swing 30.3
plaything 24.7
happy 24.4
adult 23.3
pretty 23.1
mechanical device 22.3
cute 22.2
fashion 21.1
model 21
people 20.6
sexy 19.3
hair 19
dress 19
attractive 18.9
smile 18.5
park 18.1
happiness 18
daughter 17.7
mechanism 16.6
face 16.3
love 15.8
person 15.7
joy 15
childhood 14.3
fun 14.2
lady 13.8
girls 13.7
family 13.3
youth 12.8
human 12.8
posing 12.4
outdoors 11.9
expression 11.9
lifestyle 11.6
kid 11.5
outdoor 11.5
brunette 11.3
looking 11.2
old 11.2
skin 11
children 10.9
sensuality 10.9
cheerful 10.6
bride 10.6
outside 10.3
adorable 10.2
blond 10
gorgeous 10
princess 9.9
summer 9.6
style 9.6
look 9.6
body 9.6
kids 9.4
wedding 9.2
art 9.1
little 8.8
sibling 8.7
women 8.7
smiling 8.7
male 8.5
brother 8.2
hat 8
autumn 7.9
grass 7.9
costume 7.8
domestic 7.8
standing 7.8
culture 7.7
two 7.6
hand 7.6
one 7.5
emotion 7.4
slim 7.4
sensual 7.3
black 7.2
together 7

Google
created on 2020-04-24

Microsoft
created on 2020-04-24

person 99.7
human face 97.4
baby 92.7
clothing 90.9
toddler 84.9
text 78.5
smile 77
white 64.3
posing 51.5
old 48

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 88.8%
Fear 0.3%
Happy 0.1%
Calm 69.8%
Surprised 0.2%
Confused 16.3%
Sad 12.7%
Angry 0.5%
Disgusted 0.2%

AWS Rekognition

Age 2-8
Gender Male, 74.2%
Calm 81.7%
Disgusted 0.2%
Happy 0%
Surprised 0.1%
Sad 17.3%
Confused 0.4%
Fear 0.1%
Angry 0.1%

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 5
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 91.4%
Painting 87.5%

Categories

Imagga

paintings art 50.5%
people portraits 49.4%