Human Generated Data

Title

The Annunciation
Date
People
Classification

Drawings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, 1898.594

Human Generated Data

Title

The Annunciation

People
Date

Classification

Drawings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Painting 98.1
Art 98.1
Human 98.1
Person 98.1
Archaeology 79.2
Angel 67.5
Archangel 67.5
Soil 67

Clarifai
created on 2019-05-31

art 99.7
people 98.7
illustration 97.4
painting 97.4
adult 97.1
print 97.1
Renaissance 96.5
one 95.8
sculpture 95.8
religion 95.5
man 95.2
baroque 90.3
engraving 89.8
saint 89.7
ancient 89.6
veil 89
marble 87.5
nude 87.4
antique 86.7
statue 86.5

Imagga
created on 2019-05-31

sketch 75.4
drawing 54.8
representation 46.6
sculpture 40.7
statue 38.9
religion 35
ancient 33.8
art 33.4
religious 24.4
architecture 24.4
temple 23.8
old 23.7
god 23
stone 22.8
history 20.6
column 20
culture 19.7
carving 19.3
relief 18.4
antique 17.6
decoration 16.4
detail 16.1
vintage 15.7
church 14.8
catholic 14.6
cemetery 14.4
holy 13.5
symbol 13.5
figure 13.5
travel 13.4
city 13.3
historical 13.2
monument 13.1
carved 12.7
design 12.6
famous 12.1
historic 11.9
building 11.9
tourism 11.6
spiritual 11.5
spirituality 11.5
roman 11.4
marble 10.8
artistic 10.4
pray 9.7
sand 9.6
face 9.2
museum 8.9
sculptures 8.9
saint 8.7
cross 8.5
east 8.4
head 8.4
decorative 8.4
traditional 8.3
exterior 8.3
worship 7.7
wall 7.7
meditation 7.7
grunge 7.7
outdoor 7.7
texture 7.7
oriental 7.6
pattern 7.5
closeup 7.4
tourist 7.3
holiday 7.2
stucco 7

Google
created on 2019-05-31

Drawing 90.5
Art 89.3
Painting 85.4
Sketch 84
Mythology 72.1
Figure drawing 69.9
Illustration 68.1
Artwork 64.1
Stock photography 62.1
Visual arts 59.3
Fictional character 52.8

Microsoft
created on 2019-05-31

drawing 99.3
sketch 99.2
art 87.6
text 86.5
painting 86
person 60.6
stone 9.8

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 23-38
Gender Female, 54.6%
Angry 45.9%
Calm 46.9%
Sad 49.3%
Surprised 46.2%
Disgusted 45.4%
Happy 45.5%
Confused 45.8%

AWS Rekognition

Age 26-43
Gender Female, 85.4%
Happy 2%
Confused 3%
Angry 5.4%
Disgusted 3.9%
Surprised 1.3%
Sad 64.1%
Calm 20.4%

Microsoft Cognitive Services

Age 27
Gender Female

Feature analysis

Amazon

Painting 98.1%
Person 98.1%

Captions

Microsoft

a drawing of a person 54.1%
an old photo of a person 47.6%
a drawing of a person 47.5%

Text analysis

Amazon

Van
Orf.
Liiis Van Orf.
Liiis