Human Generated Data

Title

The Madonna of the Lord Mayor

Date

19th century

People

Artist: Hermann Walde, German 1827 - 1883

Artist after: Hans Holbein the Younger, German 1497/98 - 1543

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R14808

Human Generated Data

Title

The Madonna of the Lord Mayor

People

Artist: Hermann Walde, German 1827 - 1883

Artist after: Hans Holbein the Younger, German 1497/98 - 1543

Date

19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-08-09

Person 99.5
Human 99.5
Art 97
Person 96.5
Person 91.9
Painting 79.6
Person 57.2

Clarifai
created on 2019-08-09

people 99.9
adult 99
one 98.5
art 98
two 97.6
veil 96.8
man 96.7
leader 96.5
portrait 96.1
wear 96
woman 94.8
religion 93.7
group 92.6
painting 92
illustration 91.8
print 91.4
gown (clothing) 90.9
three 82.1
monarch 80
kneeling 80

Imagga
created on 2019-08-09

book jacket 47.2
jacket 36.8
sculpture 28.6
wrapping 27.9
art 27.8
architecture 26.9
building 25.6
statue 22.9
old 22.3
monument 21.5
covering 20.7
history 20.6
culture 20.5
structure 19.8
church 19.4
ancient 19
religion 17.9
vintage 17.4
wall 17.1
antique 16.5
tourism 16.5
marble 16.5
door 16.2
famous 15.8
city 15.8
historic 15.6
column 14.9
memorial 14.5
landmark 14.4
detail 13.7
historical 13.2
arch 12.9
travel 12.7
entrance 12.6
decoration 12.2
religious 12.2
symbol 12.1
facade 11.9
stone 11.6
carving 11.4
brass 11.1
god 10.5
museum 10.4
window 10.3
renaissance 9.8
altar 9.8
cathedral 9.8
holy 9.6
architectural 9.6
retro 9
saint 8.7
faith 8.6
black 8.6
unique 8.5
exterior 8.3
painter 8.3
letter 8.3
tourist 8.2
palace 8
design 8
figure 7.9
envelope 7.9
postmark 7.9
postage 7.9
postal 7.8
paintings 7.8
roman 7.8
catholic 7.8
stamp 7.7
house 7.7
mail 7.7
post 7.6
photograph 7.5
national 7.3
creation 7.2
icon 7.1
paper 7.1

Google
created on 2019-08-09

Microsoft
created on 2019-08-09

room 99.5
gallery 99.4
scene 98.5
clothing 98.1
person 97.9
wall 97.8
drawing 94.3
indoor 86
painting 85.8
woman 84.6
text 82.9
posing 79.5
sketch 75.5
old 62.1
picture frame 56.3
vintage 40.5

Face analysis

Amazon

Google

AWS Rekognition

Age 31-47
Gender Female, 54.6%
Confused 45%
Calm 54.9%
Angry 45%
Sad 45%
Surprised 45%
Fear 45%
Happy 45.1%
Disgusted 45%

AWS Rekognition

Age 8-18
Gender Female, 53.4%
Disgusted 45%
Happy 45.5%
Angry 45%
Fear 45%
Surprised 45%
Calm 54.4%
Confused 45%
Sad 45%

AWS Rekognition

Age 5-15
Gender Female, 54.7%
Happy 45.3%
Sad 45.4%
Angry 45.1%
Fear 45%
Confused 45%
Calm 54%
Disgusted 45%
Surprised 45%

AWS Rekognition

Age 23-35
Gender Male, 53.5%
Angry 45.2%
Disgusted 45%
Sad 45.4%
Surprised 45%
Fear 45%
Calm 54.1%
Happy 45.2%
Confused 45.1%

AWS Rekognition

Age 22-34
Gender Male, 53.6%
Happy 45%
Calm 55%
Fear 45%
Sad 45%
Surprised 45%
Confused 45%
Angry 45%
Disgusted 45%

AWS Rekognition

Age 14-26
Gender Female, 50.9%
Fear 45%
Angry 45%
Happy 45%
Disgusted 45%
Sad 45%
Calm 55%
Surprised 45%
Confused 45%

AWS Rekognition

Age 4-12
Gender Female, 54.9%
Sad 45.8%
Calm 54%
Disgusted 45%
Confused 45%
Fear 45%
Angry 45%
Surprised 45%
Happy 45.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 79.6%

Captions

Microsoft

a vintage photo of a person 69%
a vintage photo of a group of people posing for the camera 48.8%
a vintage photo of a group of people posing for a picture 48.7%

Text analysis

Amazon

HOLBEIN
HOLBEIN 4.3.
DIY
4.3.
DIY MAOUNNA DESS
MAOUNNA
DESS

Google

MADONNA
H0LBEIN
DIE MADONNA DES BUERSERMEISTERS ves HANS H0LBEIN T
DIE
ves
DES
BUERSERMEISTERS
HANS
T