Human Generated Data

Title

The Retinue of the Magi
Date

15th century
People

Artist: Unidentified Artist,

Classification

Paintings
Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of an Anonymous Donor, 1936.59

Human Generated Data

Title

The Retinue of the Magi

People

Artist: Unidentified Artist,

Date

15th century

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of an Anonymous Donor, 1936.59

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Person 98.6
Human 98.6
Painting 96.2
Art 96.2
Horse 92.5
Mammal 92.5
Animal 92.5
Person 88.7
Person 87.4
Person 82
Horse 81.1
Person 66
Person 62.2
Person 53

Clarifai
created on 2020-04-24

people 99.9
group 99.3
adult 99.2
illustration 98.6
many 98.3
print 97.7
art 94.9
man 94.8
woman 94.7
several 94.6
cavalry 94.4
war 93.3
cave 93.1
engraving 91.7
veil 91.5
wear 90.6
painting 90.2
administration 89.5
skirmish 89
group together 88.7

Imagga
created on 2020-04-24

gravestone 55.9
memorial 52.7
stone 41.3
structure 39.7
old 39
grunge 32.4
vintage 29.8
texture 27.8
wall 24
ancient 23.3
antique 22.7
art 21.2
aged 20.8
architecture 18.7
dirty 18.1
textured 17.5
retro 17.2
cemetery 16.4
grungy 16.1
artistic 14.8
brown 14.7
travel 14.1
building 13.5
paper 13.3
frame 13.3
pattern 13
rough 12.8
paint 12.7
black 12.6
history 11.6
sculpture 11.5
surface 11.5
worn 11.5
detail 11.3
city 10.8
material 10.7
design 10.7
decoration 10.5
weathered 10.4
historical 10.3
culture 10.3
historic 10.1
brass 9.7
rust 9.6
stained 9.6
chandelier 9.6
rock 9.6
rusty 9.5
outdoor 9.2
border 9
fountain 9
statue 8.8
aging 8.6
old fashioned 8.6
construction 8.6
canvas 8.5
color 8.3
temple 8
urban 7.9
burnt 7.8
messy 7.7
altar 7.6
landscape 7.4
tourism 7.4
artwork 7.3
landmark 7.2
gray 7.2
religion 7.2
holiday 7.2
snow 7.2

Google
created on 2020-04-24

Painting 76.1
Stock photography 76
Art 69.5
Photography 62.4
Illustration 57.7

Microsoft
created on 2020-04-24

drawing 98.9
sketch 97.7
painting 96.4
text 87.2
horse 86.4
cartoon 79.8
illustration 79.1
standing 77.9
group 67.1
old 53.3
child art 50.8
clothes 17.7

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 31-47
Gender Male, 54.9%
Surprised 45.4%
Angry 45.8%
Disgusted 45.2%
Happy 45.6%
Sad 47.1%
Calm 49.8%
Confused 46.1%
Fear 45.1%

AWS Rekognition

Age 8-18
Gender Female, 50.2%
Happy 45.1%
Surprised 45.1%
Calm 46.9%
Fear 45.1%
Sad 51.9%
Disgusted 45%
Confused 45.5%
Angry 45.4%

AWS Rekognition

Age 33-49
Gender Male, 54.7%
Calm 52.1%
Disgusted 45%
Fear 45%
Happy 45%
Sad 45.1%
Surprised 45%
Confused 47.7%
Angry 45%

AWS Rekognition

Age 36-54
Gender Male, 54.7%
Surprised 45.2%
Angry 45.5%
Happy 45.4%
Confused 45.4%
Calm 52.2%
Sad 45.9%
Disgusted 45.3%
Fear 45.1%

AWS Rekognition

Age 31-47
Gender Male, 54.6%
Calm 54.2%
Angry 45.1%
Confused 45.1%
Fear 45%
Happy 45.3%
Surprised 45.2%
Sad 45.1%
Disgusted 45%

AWS Rekognition

Age 36-54
Gender Male, 51.1%
Fear 45%
Disgusted 45%
Confused 45%
Angry 45%
Happy 45.1%
Calm 54.8%
Surprised 45%
Sad 45%

AWS Rekognition

Age 23-35
Gender Male, 54.8%
Happy 45%
Surprised 47.9%
Sad 45%
Calm 51.5%
Disgusted 45%
Fear 45%
Confused 45.1%
Angry 45.5%

AWS Rekognition

Age 39-57
Gender Female, 50.2%
Calm 49.6%
Sad 49.7%
Fear 49.9%
Happy 49.6%
Disgusted 49.5%
Surprised 49.7%
Confused 49.5%
Angry 49.5%

Microsoft Cognitive Services

Age 30
Gender Male

Feature analysis

Amazon

Person 98.6%
Painting 96.2%
Horse 92.5%

Categories

Imagga

interior objects 59.7%
paintings art 32.8%
streetview architecture 6.7%