Human Generated Data

Title

The Virgin and Child with the Infant Saint John the Baptist
Date

17th century
People

Artist: Nicolas-Pierre Loir, French 1624 - 1679
Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Tucker Murray, 1938.86

Human Generated Data

Title

The Virgin and Child with the Infant Saint John the Baptist

People

Artist: Nicolas-Pierre Loir, French 1624 - 1679

Date

17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Professor and Mrs. John Tucker Murray, 1938.86

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 96.1
Person 96.1
Art 95.6
Person 95
Person 93.8
Painting 91.9
Face 59.4
Baby 59.1
Photography 56.8
Portrait 56.8
Photo 56.8

Clarifai
created on 2020-04-24

people 100
two 99.6
adult 99.1
child 99.1
baby 99
group 98.6
portrait 98
three 97.8
administration 97.5
man 96.9
art 96.8
woman 96.7
son 96.4
affection 96.3
painting 94.1
wear 93.1
one 92.9
four 92.4
military 91.9
offspring 91.4

Imagga
created on 2020-04-24

man 21.5
person 19.6
brother 19.5
portrait 19.4
face 18.5
statue 17.7
male 16.7
people 16.7
sculpture 16.6
parent 16.5
old 16
hair 15.8
sexy 15.3
adult 14.9
mother 14.5
dad 14.4
human 14.2
model 14
fashion 13.6
one 13.4
art 13.1
ancient 13
body 12.8
father 12.3
black 12
religion 11.6
child 11.4
skin 11.2
love 11
girls 10.9
attractive 10.5
sibling 10.4
sensuality 10
fan 9.8
antique 9.5
culture 9.4
stone 9.3
head 9.2
relaxation 9.2
hand 9.1
lady 8.9
lifestyle 8.7
men 8.6
females 8.5
religious 8.4
grandfather 8.1
history 8
world 7.9
follower 7.9
couple 7.8
kin 7.8
pray 7.8
pretty 7.7
expression 7.7
bath 7.6
dark 7.5
looking 7.2
wet 7.2
women 7.1
family 7.1
posing 7.1

Google
created on 2020-04-24

Photograph 96.1
Stock photography 78.5
Photography 73.8
Black-and-white 68.3
Art 65.5
Painting 63.8

Microsoft
created on 2020-04-24

painting 97.6
baby 96.5
drawing 94.7
text 93.4
sketch 93.1
human face 91.5
person 88.8
toddler 80.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 22-34
Gender Female, 88.6%
Angry 0.1%
Disgusted 0.1%
Sad 3.6%
Calm 94.5%
Confused 1.5%
Happy 0.1%
Fear 0%
Surprised 0.2%

AWS Rekognition

Age 5-15
Gender Male, 82.4%
Calm 10%
Fear 16.9%
Angry 3.4%
Sad 8%
Surprised 12.1%
Disgusted 5.2%
Happy 0.3%
Confused 44.2%

Microsoft Cognitive Services

Age 8
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.1%
Painting 91.9%

Categories

Imagga

people portraits 82.6%
paintings art 17%

Captions

Microsoft
created on 2020-04-24

a man sitting on a bed 59.8%
a man sitting on a bus 25.3%
a man and a woman sitting on a bed 25.2%