Human Generated Data

Title

Annunciation

Date

15th century

People

Artist: Juan de Burgos, Spanish born 1450

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Meta and Paul J. Sachs, 1928.168

Human Generated Data

Title

Annunciation

People

Artist: Juan de Burgos, Spanish born 1450

Date

15th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Human 97.2
Person 97.2
Art 93.9
Person 93.6
Drawing 86.7
Painting 79.5
Architecture 71.1
Building 71.1
Face 67.9
Portrait 63.3
Photography 63.3
Photo 63.3

Clarifai
created on 2020-04-24

people 99.9
adult 99.4
one 98.7
two 98.6
woman 98.4
veil 97.5
portrait 97.5
wear 97.4
art 91.3
dress 90.2
man 89.4
doorway 87.2
theater 86.3
actress 84.4
furniture 82
three 81.5
child 81.4
gown (clothing) 81.1
sit 81
outfit 78.5

Imagga
created on 2020-04-24

statue 38.9
sculpture 34.1
architecture 25.2
religion 25.1
ancient 23.4
old 23
fountain 22.6
art 22
stone 21.3
monument 20.6
history 18.8
god 18.2
antique 17.6
column 17.5
ruler 17
marble 16.9
structure 16.8
catholic 16
famous 15.8
church 15.7
tourism 15.7
temple 15.6
travel 14.8
culture 14.5
building 14.5
religious 14.1
spirituality 12.5
historic 11.9
landmark 11.7
city 11.6
holy 11.6
saint 11.5
historical 11.3
person 11
vintage 10.8
people 10.6
cemetery 10.3
tourist 10.2
groom 10.2
figure 10
gown 10
cathedral 9.6
monk 9.1
statues 8.9
man 8.7
faith 8.6
vestment 8.5
grunge 8.5
altar 8.3
roman 8.1
palace 7.9
sepia 7.8
portrait 7.8
cross 7.5
grave 7.5
symbol 7.4
lady 7.3
arch 7.3
detail 7.2
carving 7.2
body 7.2
love 7.1
face 7.1
male 7.1
world 7

Google
created on 2020-04-24

History 66.1
Art 62.5
Cope 62.5
Prophet 60.1
Stock photography 59.4

Microsoft
created on 2020-04-24

clothing 94.5
text 90.8
person 90.2
drawing 87.3
outdoor 85.4
black and white 84.9
vestment 84.3
sketch 75.3
white 73.1
woman 59
painting 51.5
old 42.5

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 13-23
Gender Female, 75.3%
Sad 64.4%
Disgusted 0.1%
Fear 0%
Angry 0.3%
Happy 0.1%
Calm 34.7%
Confused 0.4%
Surprised 0%

AWS Rekognition

Age 19-31
Gender Female, 98.4%
Angry 5.2%
Happy 1.2%
Calm 63.9%
Confused 2.6%
Fear 0.5%
Sad 19.5%
Surprised 0.8%
Disgusted 6.3%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 39
Gender Female

Feature analysis

Amazon

Person 97.2%

Captions

Microsoft

a black and white photo of a person 76.9%
a person standing in front of a mirror 67.2%
an old photo of a person 67.1%

Text analysis

Amazon

dlf
bUl dlf 00000O
00000O
0 0003000X06000004
UF
bUl
ULLIT
m

Google

****
****