Human Generated Data

Title

Nativity

Date

17th century

People

Artist: Schelte Adamsz. Bolswert, Dutch 1586 - 1659

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2250

Human Generated Data

Title

Nativity

People

Artist: Schelte Adamsz. Bolswert, Dutch 1586 - 1659

Artist after: Peter Paul Rubens, Flemish 1577 - 1640

Date

17th century

Classification

Prints

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Belinda L. Randall from the collection of John Witt Randall, R2250

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Painting 98.3
Art 98.3
Person 98.2
Human 98.2
Person 89.6
Person 86
Person 84.7

Clarifai
created on 2019-11-16

people 99.9
art 99.5
group 98.8
print 98.6
illustration 98.1
adult 97.8
engraving 96
man 95.6
book 93.4
portrait 93.4
baby 92.2
one 92
woman 91.7
painting 91.2
religion 90.6
antique 90.4
child 89.3
visuals 85.5
leader 85.5
book bindings 84.9

Imagga
created on 2019-11-16

sculpture 76.4
statue 59.7
cemetery 56.2
carving 44.6
art 41.6
architecture 33.9
stone 30.7
ancient 30.3
fountain 29.9
history 26
marble 25.6
monument 25.3
culture 24.8
landmark 22.6
religion 22.5
travel 21.9
old 21.6
figure 21.3
city 20.8
building 20.7
tourism 19.8
detail 19.3
god 19.2
structure 19
plastic art 18.4
famous 17.7
column 17.6
roman 16.9
sketch 16.6
historic 15.6
temple 15.2
tourist 14.5
historical 14.1
decoration 13.9
religious 13.1
church 13
symbol 12.8
angel 12.7
antique 12.3
drawing 12
representation 11.8
holy 11.6
carved 10.8
catholic 10.7
facade 10.6
relief 10.5
statues 9.9
heritage 9.7
saint 9.6
capital 9.5
golden 9.5
museum 9.3
exterior 9.2
decorative 9.2
palace 8.7
bronze 8.7
spiritual 8.7
spirituality 8.7
faith 8.6
face 8.5
details 8.5
head 8.4
sky 8.3
cathedral 8.1
holiday 7.9
artistic 7.8
worship 7.8
attraction 7.7
memorial 7.5
vintage 7.5
style 7.4
design 7.4

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

text 100
book 99.7
drawing 98.9
sketch 97.1
person 89.5
art 82.5
cartoon 71.9
human face 71.4
old 65
painting 17.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-34
Gender Female, 93.4%
Happy 36.4%
Disgusted 0.6%
Confused 1.5%
Calm 41.3%
Fear 0.8%
Sad 10.3%
Angry 1%
Surprised 8.1%

AWS Rekognition

Age 13-25
Gender Female, 79.1%
Fear 29%
Sad 4.5%
Surprised 27.8%
Angry 1.3%
Disgusted 0.6%
Confused 1.6%
Happy 0.8%
Calm 34.5%

AWS Rekognition

Age 23-35
Gender Male, 52.4%
Sad 45.1%
Disgusted 45%
Fear 45%
Angry 45%
Happy 45.1%
Surprised 45.1%
Calm 54.6%
Confused 45%

AWS Rekognition

Age 22-34
Gender Male, 55%
Fear 45%
Confused 45%
Happy 45.6%
Calm 54.1%
Surprised 45.1%
Sad 45.1%
Angry 45.1%
Disgusted 45%

AWS Rekognition

Age 38-56
Gender Male, 52.4%
Fear 45.1%
Angry 45.3%
Calm 51.6%
Surprised 45.1%
Happy 45.5%
Confused 45%
Sad 47.3%
Disgusted 45.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 98.3%
Person 98.2%

Captions

Microsoft
created on 2019-11-16

a painting of a book 65.3%
a painting of a person 65.2%
an old photo of a person 65.1%

Text analysis

Amazon

GENVIT
EM GENVIT ADORAVI
EM
ADORAVI

Google

TERR VIRGO, QVEM GENVIT, A DOR AVIT leMll
TERR
VIRGO,
QVEM
GENVIT,
A
DOR
AVIT
leMll