Human Generated Data

Title

Sistine Madonna

Date

1810

People

Artist: Johann Friedrich Wilhelm Müller, German 1782 - 1816

Artist after: Raphael, Italian 1483 - 1520

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G2860

Human Generated Data

Title

Sistine Madonna

People

Artist: Johann Friedrich Wilhelm Müller, German 1782 - 1816

Artist after: Raphael, Italian 1483 - 1520

Date

1810

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of William Gray from the collection of Francis Calley Gray, G2860

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 99.3
Human 99.3
Person 98.7
Person 98.5
Person 97.3
Art 96.4
Person 94.4
Painting 86.8

Clarifai
created on 2018-11-01

people 99.9
adult 98.9
art 98.5
group 98.2
one 97.6
print 97.5
man 97.2
portrait 97.1
leader 97
woman 96.7
illustration 95.9
two 95.7
painting 94.9
wear 88.1
veil 86.7
furniture 85.4
religion 85.3
administration 79.1
child 78.6
gown (clothing) 77.9

Imagga
created on 2018-11-01

sketch 55.8
drawing 40.3
representation 36.2
sculpture 29.2
art 26.8
statue 25.8
money 23
book jacket 22.6
currency 21.6
cash 20.1
culture 19.7
ancient 19
religion 17.9
dollar 17.6
jacket 17.6
history 17
one 14.9
vintage 14.9
architecture 14.9
banking 14.7
old 14.6
close 14.3
bill 14.3
historical 14.1
antique 14
portrait 13.6
bank 13.4
wrapping 13.4
religious 13.1
church 13
face 12.8
figure 12.8
finance 12.7
wealth 12.6
god 12.4
business 12.2
savings 12.1
paper 12.1
historic 11.9
head 11.8
banknote 11.7
dollars 11.6
financial 11.6
symbol 11.5
painter 11.4
monument 11.2
marble 10.9
closeup 10.8
decoration 10.7
museum 10.5
detail 10.5
rich 10.2
economy 10.2
covering 9.9
stamp 9.7
holy 9.6
man 9.6
fine 9.5
famous 9.3
roman 9.2
carving 9.1
postage 8.9
renaissance 8.8
us 8.7
loan 8.6
mail 8.6
faith 8.6
exchange 8.6
stone 8.4
city 8.3
human 8.3
icon 7.9
known 7.9
postmark 7.9
printed 7.9
twenty 7.9
postal 7.9
banknotes 7.8
paintings 7.8
male 7.8
catholic 7.8
travel 7.8
prayer 7.7
artist 7.7
finances 7.7
saint 7.7
spiritual 7.7
pay 7.7
envelope 7.7
united 7.6
capital 7.6
letter 7.3
column 7.3
people 7.3
black 7.2

Google
created on 2018-11-01

art 85.9
history 77.4
religion 70.7
artwork 64.7
painting 59.4
drawing 55.9
picture frame 54.8
stock photography 54.7
visual arts 54.1

Microsoft
created on 2018-11-01

text 99.9
old 61.5
vintage 46
different 35.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Female, 99.9%
Sad 5.9%
Happy 0.4%
Angry 1.7%
Disgusted 0.5%
Calm 89%
Surprised 1.3%
Confused 1.2%

AWS Rekognition

Age 4-9
Gender Female, 98%
Calm 43.5%
Disgusted 2.7%
Confused 26.8%
Sad 9.9%
Angry 7.8%
Happy 1.9%
Surprised 7.4%

AWS Rekognition

Age 20-38
Gender Female, 99.1%
Sad 38.9%
Calm 53.6%
Confused 1.3%
Surprised 0.7%
Happy 2.4%
Disgusted 1.7%
Angry 1.3%

AWS Rekognition

Age 4-9
Gender Female, 98.1%
Confused 4.8%
Disgusted 1.5%
Sad 56.2%
Angry 5.6%
Calm 29%
Happy 0.6%
Surprised 2.3%

AWS Rekognition

Age 4-9
Gender Female, 93.4%
Confused 5.5%
Disgusted 1.2%
Sad 4.2%
Angry 2%
Calm 83.6%
Happy 1%
Surprised 2.5%

AWS Rekognition

Age 45-66
Gender Female, 50.4%
Surprised 3.2%
Angry 5%
Confused 8.5%
Disgusted 3.4%
Happy 1.8%
Sad 5.7%
Calm 72.4%

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Microsoft Cognitive Services

Age 6
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 86.8%

Categories

Text analysis

Amazon

d
Rauck
fhite d Rauck
fhite