Human Generated Data

Title

Virgin and Child with Saints John The Baptist, James, Anthony Abbot, and an Unidentified Bearded Saint Holding a Book; the Archangel Gabriel and the Annunciate Virgin in Roundels
Date

early 15th century
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Eliot Hubbard, Jr., Class of 1915, 1937.34

Human Generated Data

Title

Virgin and Child with Saints John The Baptist, James, Anthony Abbot, and an Unidentified Bearded Saint Holding a Book; the Archangel Gabriel and the Annunciate Virgin in Roundels

People

Artist: Unidentified Artist,

Date

early 15th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Dr. Eliot Hubbard, Jr., Class of 1915, 1937.34

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 96.1
Person 96.1
Person 94.6
Art 94.2
Person 92.7
Painting 92.5
Person 80.2
Person 79.6
Drawing 76.7
Photo 61.7
Face 61.7
Photography 61.7
Portrait 61.7
People 60.9

Clarifai
created on 2020-04-24

people 100
adult 99.7
print 99.6
illustration 99.5
art 99.1
leader 98.9
monarch 98.5
gown (clothing) 97.9
royalty 97.7
veil 97.5
portrait 97.4
engraving 97.3
group 96.3
man 96.1
painting 96.1
wear 96.1
woman 95.3
cape 94.3
crown 94.2
facial hair 93.8

Imagga
created on 2020-04-24

religion 44.9
temple 42.8
sculpture 39
art 36.9
architecture 33.6
ancient 32.9
statue 29.9
church 28.7
history 26.9
god 25.9
culture 25.7
monument 22.4
spirituality 22.1
travel 21.9
carving 21.6
stone 21.1
old 19.5
building 19
mosaic 18.9
religious 17.8
structure 17.6
holy 17.4
antique 16.7
gold 16.5
historical 16
tourism 15.7
column 15.6
altar 15.2
historic 14.7
throne 14.2
east 14
famous 14
museum 13.9
golden 13.8
decoration 13.5
door 13.3
city 13.3
figure 13.1
relief 12.9
currency 12.6
tourist 11.8
bible 11.8
carved 11.8
cathedral 11.5
detail 11.3
orthodox 10.8
prayer 10.6
spiritual 10.6
chair of state 10.6
vestment 10.4
wall 10.3
money 10.2
dollar 10.2
symbol 10.1
stucco 10
face 10
landmark 9.9
cemetery 9.8
sacred 9.8
facade 9.7
close 9.7
heritage 9.7
meditation 9.6
pattern 9.6
icon 9.5
oriental 9.5
exterior 9.2
gown 9.2
traditional 9.2
palace 8.9
pray 8.7
dollars 8.7
saint 8.7
faith 8.6
monastery 8.1
memorial 8
business 7.9
paper 7.8
century 7.8
metropolitan 7.8
belief 7.8
catholic 7.8
worship 7.7
artist 7.7
finance 7.6
design 7.6
chair 7.6
buildings 7.6
vintage 7.5
banking 7.4
cash 7.3

Google
created on 2020-04-24

Holy places 90
Art 80.8
Stock photography 73.7
Prophet 70.4
History 69.9
Illustration 60.2
Painting 51.9

Microsoft
created on 2020-04-24

text 98.3
drawing 98.1
sketch 97.2
book 90.7
person 86.5
painting 83.8
clothing 79.5
illustration 66
cartoon 56.3

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 23-37
Gender Female, 81.3%
Surprised 0.7%
Happy 0.6%
Calm 35%
Disgusted 0.5%
Angry 13.1%
Fear 0.8%
Confused 2.8%
Sad 46.6%

AWS Rekognition

Age 22-34
Gender Male, 54.7%
Happy 45%
Confused 45%
Disgusted 45%
Sad 45.1%
Fear 45%
Angry 45%
Calm 54.8%
Surprised 45%

AWS Rekognition

Age 22-34
Gender Male, 51.6%
Angry 45.2%
Sad 45.1%
Happy 45.3%
Calm 54.2%
Surprised 45.1%
Fear 45%
Confused 45%
Disgusted 45.1%

AWS Rekognition

Age 41-59
Gender Male, 52.2%
Happy 45.1%
Surprised 45.1%
Sad 46%
Calm 51.7%
Disgusted 45.1%
Fear 45.3%
Confused 45.1%
Angry 46.7%

AWS Rekognition

Age 22-34
Gender Male, 54.9%
Surprised 45.1%
Angry 52.1%
Happy 45%
Confused 45.2%
Calm 46.2%
Sad 45.2%
Disgusted 46%
Fear 45.1%

AWS Rekognition

Age 27-43
Gender Male, 54.5%
Disgusted 45%
Confused 45%
Angry 45%
Sad 45.1%
Happy 45%
Fear 45%
Calm 54.9%
Surprised 45%

Microsoft Cognitive Services

Age 23
Gender Female

Feature analysis

Amazon

Person 96.1%
Painting 92.5%

Categories

Imagga

paintings art 95.6%
streetview architecture 3.5%

Captions

Microsoft
created on 2020-04-24

an old photo of a person 72.9%
a person holding a book 25.5%
a person standing next to a book 25.4%