Human Generated Data

Title

Madonna with S. Jerome and S. Francis
Date

19th century
People

Artist: August Hoffmann, German 1810 - 1873

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of the heirs of Mrs. Mary Hemenway, M832

Human Generated Data

Title

Madonna with S. Jerome and S. Francis

People

Artist: August Hoffmann, German 1810 - 1873

Artist after: Raphael, Italian 1483 - 1520

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Human 98.9
Person 98.9
Person 98.5
Art 96.9
Person 96.5
Painting 93.6
Person 75.2
Clothing 73.7
Hat 73.7
Apparel 73.7
Photography 66.2
Photo 66.2
Face 66.1
Portrait 66.1

Clarifai
created on 2019-11-06

people 99.2
portrait 98.5
woman 97.5
adult 97.1
art 96
wear 95
two 94.8
child 93.5
retro 92.5
group 91
man 90
facial expression 89.4
one 89.1
girl 88.9
love 86.3
bill 83.8
music 82.1
son 80.9
offspring 78.2
painting 78.1

Imagga
created on 2019-11-06

kin 57.6
child 41.8
portrait 33
mother 32.3
parent 29
people 28.5
adult 24.6
hair 23.8
face 23.4
cute 23
model 21.8
person 21.7
love 21.3
human 20.2
attractive 19.6
happy 19.4
fashion 18.9
family 18.7
sexy 18.5
brunette 18.3
man 18.1
smiling 17.4
lady 17
skin 16.9
happiness 16.5
pretty 16.1
kid 16
women 15.8
smile 15.7
black 15.6
male 15.4
expression 15.4
body 15.2
boy 14.8
youth 14.5
fun 14.2
father 14.1
looking 13.6
cheerful 13
baby 12.8
home 12.8
elegance 12.6
children 11.8
joy 11.7
childhood 11.6
daughter 11.6
brother 11.4
couple 11.3
one 11.2
casual 11
sibling 10.9
head 10.9
dad 10.9
lifestyle 10.8
studio 10.6
eyes 10.3
room 10
sensuality 10
modern 9.8
hand 9.1
care 9.1
group 8.9
together 8.8
look 8.8
two 8.5
dark 8.4
emotion 8.3
girls 8.2
relaxing 8.2
make 8.2
dress 8.1
close 8
little 8
son 7.9
culture 7.7
husband 7.6
wife 7.6
kids 7.5
passion 7.5
mouth 7.5
cosmetics 7.5
vintage 7.4
style 7.4
sketch 7.4
makeup 7.3
teenager 7.3
sensual 7.3
gorgeous 7.3
handsome 7.1
lovely 7.1

Google
created on 2019-11-06

Photograph 96.4
Picture frame 90.4
Painting 84
Snapshot 83.6
Art 80.6
Visual arts 73.1
Photography 72.5
Stock photography 70.4
Room 65.7
Portrait 62.5
Modern art 58.3
Black-and-white 56.4
Drawing 53.7

Microsoft
created on 2019-11-06

gallery 100
scene 99.9
room 99.9
wall 99.8
baby 98.6
human face 98.1
person 96.3
toddler 94.8
clothing 93.6
smile 84.3
posing 82.3
art 79.8
text 73.4
child 66.9
picture frame 61
museum 56.7
boy 54.6
painting 15.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-20
Gender Female, 99.4%
Calm 97%
Angry 0.2%
Fear 0.1%
Happy 1.4%
Disgusted 0.1%
Sad 0.8%
Surprised 0.1%
Confused 0.2%

AWS Rekognition

Age 32-48
Gender Male, 94.8%
Calm 25.9%
Happy 0.1%
Fear 0.2%
Sad 3.6%
Surprised 28.8%
Angry 0.4%
Disgusted 0.1%
Confused 40.9%

AWS Rekognition

Age 1-5
Gender Female, 81.3%
Calm 97.1%
Sad 0.4%
Angry 1.7%
Fear 0%
Happy 0.1%
Surprised 0.3%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 32-48
Gender Male, 89.7%
Surprised 0.1%
Angry 0.5%
Disgusted 0.1%
Confused 0.3%
Happy 0%
Calm 82.4%
Sad 16.5%
Fear 0.1%

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 2
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%
Hat 73.7%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 56.1%
a person standing in front of a mirror posing for the camera 56%
a group of people in front of a mirror posing for the camera 54.9%