Human Generated Data

Title

Sistine Madonna

Date

18th-19th century

People

Artist: Christian Gottfried Schulze, German 1749 - 1819

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3633

Human Generated Data

Title

Sistine Madonna

People

Artist: Christian Gottfried Schulze, German 1749 - 1819

Artist after: Raphael, Italian 1483 - 1520

Date

18th-19th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G3633

Machine Generated Data

Tags

Amazon
created on 2019-11-03

Person 99.3
Human 99.3
Person 98.5
Person 96.8
Art 96
Person 94.6
Painting 92.2
Person 86.4

Clarifai
created on 2019-11-03

people 99.8
man 98.2
print 98.1
adult 98
art 97.7
portrait 97.5
group 97
illustration 96.5
one 96.5
two 95.9
leader 95.1
woman 94.2
painting 90.6
veil 84.3
wear 82.6
engraving 81.8
religion 81.6
furniture 77.4
writer 74.8
facial hair 74.8

Imagga
created on 2019-11-03

sketch 83.1
drawing 61
representation 52.5
book jacket 28.7
money 26.4
art 25.3
sculpture 24.6
currency 23.3
jacket 22.4
cash 22
dollar 20.4
statue 20.3
ancient 19.9
vintage 19
culture 18.8
religion 17.9
finance 17.8
wrapping 17
banking 16.6
one 16.4
bill 16.2
financial 16
old 16
paper 15.9
bank 15.2
architecture 14.9
wealth 14.4
close 14.3
savings 14
church 13.9
stamp 13.8
history 13.4
figure 13.3
antique 13.2
business 12.8
dollars 12.6
mail 12.5
religious 12.2
symbol 12.1
comic book 12.1
covering 12
postmark 11.8
postage 11.8
head 11.8
exchange 11.5
bookmark 11.4
face 11.4
monument 11.2
rich 11.2
economy 11.1
portrait 11
printed 10.8
postal 10.8
banknote 10.7
detail 10.5
famous 10.2
envelope 10.2
closeup 10.1
letter 10.1
historic 10.1
man 10.1
banknotes 9.8
marble 9.7
us 9.6
holy 9.6
decoration 9.6
god 9.6
fine 9.5
museum 9.5
historical 9.4
carving 9.4
stone 9.3
retro 9
stamps 8.9
shows 8.9
bills 8.7
icon 8.7
finances 8.7
spiritual 8.6
loan 8.6
post 8.6
investment 8.3
artwork 8.2
roman 7.9
known 7.9
twenty 7.9
paintings 7.8
saint 7.7
pay 7.7
design 7.6
unique 7.6
capital 7.6
note 7.4
global 7.3
building 7.1
travel 7

Google
created on 2019-11-03

Microsoft
created on 2019-11-03

text 99.6
drawing 94.5
painting 91.4
sketch 85.3
person 80.2
clothing 73
cartoon 70.3
museum 53.3
different 42.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 11-21
Gender Female, 54.9%
Sad 45.1%
Happy 45%
Disgusted 45%
Fear 45%
Surprised 45%
Angry 45%
Confused 45%
Calm 54.9%

AWS Rekognition

Age 17-29
Gender Female, 54.9%
Confused 45%
Disgusted 45%
Surprised 45%
Fear 45%
Calm 54.7%
Angry 45%
Sad 45.2%
Happy 45.1%

AWS Rekognition

Age 21-33
Gender Female, 52.9%
Disgusted 45.1%
Fear 45.8%
Happy 45%
Angry 45.7%
Calm 49.1%
Confused 45.6%
Surprised 47.3%
Sad 46.3%

AWS Rekognition

Age 4-12
Gender Female, 53.6%
Happy 45.1%
Calm 54.7%
Disgusted 45%
Confused 45%
Fear 45%
Surprised 45.1%
Sad 45.1%
Angry 45%

AWS Rekognition

Age 1-5
Gender Female, 54.5%
Fear 45%
Happy 45.2%
Angry 45.2%
Sad 45.2%
Confused 45.1%
Calm 54.2%
Disgusted 45.1%
Surprised 45.1%

AWS Rekognition

Age 26-42
Gender Male, 54.2%
Fear 46.2%
Sad 45.2%
Disgusted 45.4%
Happy 45.4%
Surprised 46.6%
Calm 50.8%
Confused 45.1%
Angry 45.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 92.2%

Categories

Imagga

paintings art 98.3%
people portraits 1.1%

Captions

Microsoft
created on 2019-11-03

an old photo of a book 56.3%
an old photo of a person 56.2%
old photo of a person 56.1%

Text analysis

Amazon

h
mentary
iaam
mentary h uphantl >llime iaam dhtshd/llelin
astetom
uphantl
dhtshd/llelin
Phnr
>llime
Mink
Li Phnr lmvled mnh astetom 5 Mink
lmvled
mnh
ivue
5
Li

Google

imuda d hyphnel d/U
imuda
d
hyphnel
d/U