Human Generated Data

Title

Altar of St. Anne

Date

1516

People

Artist: Unidentified Artist,

Classification

Sculpture

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Museum Purchase, BR32.65.A-C

Human Generated Data

Title

Altar of St. Anne

People

Artist: Unidentified Artist,

Date

1516

Classification

Sculpture

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Art 97.7
Painting 97.7
Human 97.3
Person 97.3
Person 96.7
Building 96.3
Altar 96.3
Architecture 96.3
Church 96.3
Person 95.2
Figurine 85.5
Person 83.4
Person 70.2
Person 70.1
Sculpture 69.3
Person 62.9
Wood 56.1

Clarifai
created on 2018-02-09

people 99.5
religion 99.3
art 99.3
Mary 99
saint 99
painting 98.7
aura 98.4
adult 98.2
god 97.6
woman 97.6
Renaissance 97
church 96.9
group 96.8
illustration 96.6
book 96.3
man 95.9
gown (clothing) 94.8
veil 94.5
holy 94
Apostle 93.3

Imagga
created on 2018-02-09

religion 42.1
sculpture 41.4
art 37.2
architecture 35.9
screen 35.4
temple 35.1
old 34.8
throne 33.8
ancient 33.7
door 32.3
antique 32.2
carving 30.7
gold 27.9
furniture 27.5
history 26.8
religious 26.2
culture 25.6
traditional 23.3
travel 23.2
decoration 23.2
church 23.1
building 22.2
covering 21.5
detail 20.9
wood 20.8
design 20.8
chair 20.4
entrance 18.4
spirituality 17.3
golden 17.2
texture 16.7
vintage 16.5
historic 16.5
tourism 16.5
statue 16.2
historical 16
pattern 15.7
altar 15.6
style 15.6
prayer 15.5
east 14.9
wall 14.8
case 14.8
holy 14.4
oriental 14.2
ornament 13.8
ornate 13.7
pray 13.6
faith 13.4
seat 13.2
famous 13
frame 12.5
god 12.4
wooden 12.3
metal 12.1
landmark 11.7
belief 11.7
worship 11.6
palace 11.6
decor 11.5
furnishing 11.5
wardrobe 11
bangkok 10.8
sacred 10.7
gate 10.7
grand 10.7
retro 10.6
heritage 10.6
monument 10.3
structure 10.1
house 10.1
decorative 10
interior 9.7
cathedral 9.6
spiritual 9.6
china 9.4
stone 9.3
city 9.1
vestment 8.9
shrine 8.8
brown 8.8
home 8.8
artistic 8.7
security 8.3
painting 8.1
symbol 8.1
doorway 7.9
doors 7.9
carved 7.8
color 7.8
arch 7.8
luxury 7.7
closed 7.7
box 7.5
palanquin 7.4
tradition 7.4
exterior 7.4
aged 7.2
monastery 7

Google
created on 2018-02-09

Microsoft
created on 2018-02-09

altar 18.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 23-38
Gender Female, 87.4%
Sad 82.9%
Happy 1.3%
Angry 1.5%
Calm 9.8%
Surprised 0.8%
Confused 1.9%
Disgusted 1.8%

AWS Rekognition

Age 26-43
Gender Male, 95.8%
Happy 5.6%
Calm 76.4%
Confused 2.4%
Sad 5%
Surprised 2.9%
Angry 3.6%
Disgusted 4.3%

AWS Rekognition

Age 26-43
Gender Female, 94.6%
Disgusted 1.5%
Calm 64.9%
Happy 1.3%
Angry 8.5%
Sad 8.6%
Confused 6.2%
Surprised 9%

AWS Rekognition

Age 4-9
Gender Female, 50.4%
Happy 45.5%
Sad 47.3%
Confused 46.2%
Angry 45.7%
Surprised 46.1%
Calm 48.9%
Disgusted 45.2%

AWS Rekognition

Age 10-15
Gender Female, 88.1%
Confused 5.6%
Disgusted 6.7%
Angry 5.5%
Surprised 4.3%
Happy 10.7%
Sad 20.7%
Calm 46.6%

AWS Rekognition

Age 23-38
Gender Female, 96.9%
Calm 58.4%
Confused 3.8%
Surprised 6.3%
Disgusted 4.1%
Happy 12.6%
Angry 5.2%
Sad 9.7%

AWS Rekognition

Age 12-22
Gender Female, 54.9%
Happy 48.4%
Angry 45.7%
Surprised 45.2%
Sad 47.6%
Disgusted 45.6%
Calm 47.3%
Confused 45.3%

AWS Rekognition

Age 26-43
Gender Female, 52.3%
Happy 45.1%
Disgusted 45.2%
Surprised 45%
Confused 45%
Calm 45.2%
Sad 54.4%
Angry 45.1%

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 20
Gender Female

Microsoft Cognitive Services

Age 8
Gender Female

Microsoft Cognitive Services

Age 18
Gender Female

Microsoft Cognitive Services

Age 37
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Painting 97.7%
Person 97.3%

Captions

Microsoft

a group of people in a room 88.1%
a group of people posing for a photo 77.2%
a group of people posing for a picture 77.1%

Text analysis

Amazon

e