Human Generated Data

Title

Sistine Madonna
Date

18th-19th century
People

Artist: Christian Gottfried Schulze, German 1749 - 1819

Artist after: Raphael, Italian 1483 - 1520
Classification

Prints
Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3634

Human Generated Data

Title

Sistine Madonna

People

Artist: Christian Gottfried Schulze, German 1749 - 1819

Artist after: Raphael, Italian 1483 - 1520

Date

18th-19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3634

Machine Generated Data

Tags

Amazon
created on 2019-11-06

Person 99.2
Human 99.2
Person 98.6
Person 98.5
Painting 97.3
Art 97.3
Person 96.7
Person 89.5
Portrait 60.7
Photo 60.7
Face 60.7
Photography 60.7

Clarifai
created on 2019-11-06

people 99.9
group 99.2
print 99.2
adult 99.1
art 98.7
two 98.4
illustration 98.3
man 97.6
one 96.6
furniture 96.2
woman 96.1
leader 96
portrait 95.8
painting 93.2
veil 90.1
lithograph 88.2
religion 88.1
gown (clothing) 87.9
wear 87.7
engraving 87.6

Imagga
created on 2019-11-06

sketch 100
drawing 91.4
representation 79.1
sculpture 28.1
art 28
statue 24.3
culture 21.4
money 21.3
ancient 19.9
religion 19.7
architecture 18.8
cash 18.3
currency 18
dollar 17.7
old 16.7
history 16.1
church 15.7
vintage 15.7
figure 14.8
carving 14.5
antique 13.9
detail 13.7
portrait 13.6
finance 13.5
face 13.5
paper 13.4
close 13.1
religious 13.1
book jacket 12.9
banking 12.9
bank 12.6
god 12.5
bill 12.4
historical 12.2
savings 12.1
one 12
head 11.8
wealth 11.7
dollars 11.6
financial 11.6
closeup 11.5
famous 11.2
historic 11
decoration 10.9
marble 10.7
business 10.3
monument 10.3
stone 10.1
symbol 10.1
jacket 10.1
city 10
catholic 9.7
holy 9.6
museum 9
banknotes 8.8
carved 8.8
bills 8.7
banknote 8.7
temple 8.7
spiritual 8.6
pay 8.6
stamp 8.6
fine 8.6
rich 8.4
decorative 8.4
economy 8.4
building 7.9
known 7.9
postage 7.9
renaissance 7.9
travel 7.8
us 7.7
saint 7.7
loan 7.7
mail 7.7
faith 7.7
exchange 7.6
wrapping 7.6
human 7.5
design 7.4
man 7.4
landmark 7.2

Google
created on 2019-11-06

Painting 91.6
Art 86.7
Stock photography 76.2
Illustration 72.5
Visual arts 68.6
History 62.6
Picture frame 61.4
Miniature 60.9
Prophet 59.5
Mythology 54.9

Microsoft
created on 2019-11-06

text 100
drawing 96.7
book 95.5
sketch 94.6
painting 88.5
person 79.3
clothing 70.4
cartoon 69.4
old 61.5
woman 59.5
posing 56
different 41.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 5-15
Gender Female, 54.6%
Disgusted 45.1%
Confused 45.5%
Angry 45.4%
Calm 50.2%
Sad 46.7%
Fear 45.6%
Happy 45%
Surprised 46.5%

AWS Rekognition

Age 13-23
Gender Female, 54.8%
Happy 45%
Disgusted 45%
Angry 45%
Sad 45%
Fear 45%
Calm 54.9%
Surprised 45%
Confused 45%

AWS Rekognition

Age 13-23
Gender Female, 54.9%
Fear 45%
Happy 45.1%
Calm 54.9%
Disgusted 45%
Sad 45%
Surprised 45%
Angry 45%
Confused 45%

AWS Rekognition

Age 4-12
Gender Female, 52.9%
Angry 45%
Disgusted 45%
Happy 45.1%
Calm 54.3%
Sad 45.4%
Confused 45.1%
Surprised 45.1%
Fear 45%

AWS Rekognition

Age 20-32
Gender Female, 54.3%
Angry 45.7%
Calm 52.8%
Disgusted 45.1%
Fear 45.1%
Surprised 45.1%
Happy 45.1%
Sad 46.1%
Confused 45.1%

AWS Rekognition

Age 22-34
Gender Male, 53.8%
Confused 45%
Fear 48%
Angry 45.4%
Calm 45.4%
Surprised 50.8%
Sad 45%
Happy 45.1%
Disgusted 45.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 97.3%

Categories

Imagga

paintings art 97.5%
people portraits 1.6%

Captions

Microsoft
created on 2019-11-06

a group of people posing for a photo 73.4%
a group of men posing for a photo 61.3%
an old photo of a person 61.2%

Text analysis

Google

blea Gler Raphael
blea
Gler
Raphael