Human Generated Data

Title

Sistine Madonna

Date

18th-19th century

People

Artist: Johann Friedrich Wilhelm Müller, German 1782 - 1816

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G2861

Human Generated Data

Title

Sistine Madonna

People

Artist: Johann Friedrich Wilhelm Müller, German 1782 - 1816

Artist after: Raphael, Italian 1483 - 1520

Date

18th-19th century

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Person 98.4
Human 98.4
Person 97.9
Person 97.1
Person 96.8
Art 95.8
Person 95.4
Painting 87.6
Archangel 62
Angel 62
Photography 59.9
Photo 59.9
Portrait 59.9
Face 59.9

Clarifai
created on 2019-11-06

people 99.9
adult 98.6
art 98.3
man 97.5
group 97.3
print 97.2
leader 97
one 96.9
portrait 96
woman 94.5
two 93.5
illustration 93.5
painting 92.7
writer 89.4
administration 88.8
religion 85.3
engraving 85.2
book 83.6
furniture 83.6
veil 81.1

Imagga
created on 2019-11-06

sculpture 35.5
statue 29.6
art 26.3
book jacket 26.1
sketch 24.4
money 23.8
cash 23.8
currency 22.5
culture 20.5
dollar 20.4
jacket 20.3
ancient 19
product 18.5
history 17.9
drawing 17.6
one 17.2
newspaper 17
representation 16.8
creation 16.7
paper 16.7
close 16.6
carving 16.5
religion 16.2
bank 16.1
finance 16.1
old 16
architecture 15.7
vintage 15.7
wrapping 15.5
bill 15.2
dollars 14.5
wealth 14.4
historical 14.1
banking 13.8
business 13.4
financial 13.4
antique 13.2
monument 13.1
marble 13
historic 12.9
figure 12.6
column 12.5
god 12.5
portrait 12.3
closeup 12.1
savings 12.1
detail 12.1
banknote 11.7
museum 11.6
pay 11.5
exchange 11.5
symbol 11.5
capital 11.4
face 11.4
church 11.1
covering 11
city 10.8
religious 10.3
rich 10.2
economy 10.2
catholic 9.7
stone 9.6
fine 9.5
decoration 9.3
famous 9.3
head 9.2
travel 9.2
painter 9.1
roman 9.1
printed 8.9
renaissance 8.8
banknotes 8.8
bills 8.7
man 8.7
stamp 8.7
states 8.7
us 8.7
finances 8.7
holy 8.7
saint 8.7
loan 8.6
mail 8.6
united 8.6
tourism 8.3
investment 8.3
building 7.9
memorial 7.9
known 7.9
postmark 7.9
franklin 7.9
postage 7.9
president 7.9
paintings 7.8
hundred 7.8
payment 7.7
spiritual 7.7
daily 7.4
letter 7.3
envelope 7.2
icon 7.1

Google
created on 2019-11-06

Microsoft
created on 2019-11-06

text 96.4
painting 93.2
drawing 89.6
person 85.1
art 77.9
museum 76.7
sketch 75.8
clothing 70.6
human face 66.7
gallery 50.5
posing 38.8
picture frame 11

Face analysis

Amazon

Google

AWS Rekognition

Age 17-29
Gender Female, 54.8%
Angry 45.1%
Happy 45.1%
Disgusted 45%
Surprised 45%
Sad 46%
Fear 45%
Calm 53.7%
Confused 45%

AWS Rekognition

Age 13-23
Gender Female, 54.9%
Sad 45.8%
Angry 45%
Happy 45.2%
Disgusted 45%
Calm 53.8%
Confused 45%
Fear 45%
Surprised 45%

AWS Rekognition

Age 3-9
Gender Female, 52.9%
Angry 45.8%
Disgusted 45%
Confused 45.1%
Fear 45.1%
Happy 45%
Calm 53.6%
Sad 45.3%
Surprised 45.1%

AWS Rekognition

Age 4-12
Gender Female, 52.7%
Confused 45.1%
Happy 45.1%
Fear 45.1%
Surprised 45.1%
Angry 45.4%
Sad 45.8%
Calm 53.4%
Disgusted 45%

AWS Rekognition

Age 2-8
Gender Female, 53.1%
Calm 54.3%
Angry 45.3%
Surprised 45%
Fear 45%
Sad 45.3%
Happy 45%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 37-55
Gender Male, 54.2%
Angry 52%
Surprised 45.1%
Disgusted 45.3%
Confused 45.3%
Calm 45.4%
Happy 45.1%
Sad 46.5%
Fear 45.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.4%
Painting 87.6%

Captions

Microsoft

a group of people posing for a photo 68.9%
a group of people posing for a photo in front of a mirror 51.9%
a group of people standing in front of a mirror posing for the camera 45.3%

Text analysis

Amazon

SISTO
MADONNA
DI
L.A
L.A MADONNA DI S. SISTO DI RAFAELLO.
S.
RAFAELLO.
redenar
Lrdiata
Maesti
hua
lupshe:
Lrdiata r hua Maesti redenar lupshe: wdb, Sassrnas
Sassrnas
r
wdb,
Apehr
.c

Google

SISTO
LA MADONNA DI S. SISTO DI RAEAELLO.
LA
MADONNA
DI
RAEAELLO.
S.