Human Generated Data

Title

Deesis - Christ Enthroned with Saints

Date

1460-1470

People

Artist: Unidentified Artist,

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Thomas Whittemore, 1951.31.15

Human Generated Data

Title

Deesis - Christ Enthroned with Saints

People

Artist: Unidentified Artist,

Date

1460-1470

Classification

Paintings

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Thomas Whittemore, 1951.31.15

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 99.6
Person 99.6
Art 99.1
Painting 99.1
Person 98.5
Person 98.1
Person 96.8
Person 96.1
Mosaic 94.3
Tile 94.3
Person 92.9
Person 91.9
Archaeology 77.2
Person 74.4
Soil 56

Clarifai
created on 2019-04-10

painting 99.8
art 99.8
religion 99.6
people 99.6
illustration 99.2
saint 99.1
Mary 99.1
aura 99.1
veil 98
church 97.7
god 97.6
kneeling 97.2
manuscript 96.8
fresco 96.8
gown (clothing) 96.5
adult 96.4
book 95.8
man 95.7
facial hair 95.1
print 94.1

Imagga
created on 2019-01-18

mosaic 99.4
art 54.3
transducer 47.1
prayer rug 44.9
rug 38.7
electrical device 35.4
religion 29.6
floor cover 28.1
church 27.8
furnishing 26.8
old 25.8
vintage 24.8
tile 23
device 22.8
stamp 22.3
covering 21.3
postage 20.6
culture 20.5
mail 20.1
postmark 19.7
letter 19.3
ancient 19
creation 18.4
post 18.1
religious 17.8
postal 17.7
paper 17.3
god 17.2
money 17
icon 16.6
cash 16.5
finance 16.1
bible 15.7
museum 15.5
golden 15.5
holy 15.4
spirituality 15.4
faith 15.3
currency 15.3
masterpiece 14.8
decoration 14.4
symbol 14.2
retro 13.9
one 13.4
travel 13.4
financial 13.4
architecture 13.3
antique 13.2
painter 13.1
detail 12.9
banking 12.9
printed 12.8
envelope 12.7
bank 12.5
history 12.5
temple 12.4
bill 12.4
instrumentality 11.8
collection 11.7
pattern 11.6
painted 11.5
close 11.4
dollar 11.1
historic 11
stamps 10.9
shows 10.8
gold 10.7
artist 10.6
saint 10.6
sculpture 10.1
colorful 10
tourism 9.9
wealth 9.9
philately 9.9
renaissance 9.8
orthodox 9.8
paintings 9.8
sacred 9.7
delivery 9.7
design 9.7
prayer 9.7
office 9.6
us 9.6
black 9.6
spiritual 9.6
exchange 9.5
wall 9.4
savings 9.3
global 9.1
business 9.1
texture 9
post mail 8.9
canceled 8.9
prophet 8.9
zigzag 8.9
fame 8.9
known 8.9
cutting 8.7
dollars 8.7
cathedral 8.6
communications 8.6
fine 8.6
unique 8.5
historical 8.5
note 8.3
investment 8.3
paint 8.2
object 8.1
artistic 7.8
color 7.8
banknote 7.8
pray 7.8
pay 7.7
obsolete 7.7
grunge 7.7
closeup 7.4
figure 7.4
artwork 7.3
landmark 7.2
interior 7.1

Google
created on 2019-01-18

art 86.6
history 84.4
ancient history 73.1
middle ages 68.4
tapestry 66.6
artifact 51.9

Microsoft
created on 2019-01-18

wall 96.4
old 59.1
mosaic 59.1
church 27
mural 24.6
person 9.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 90.2%
Disgusted 35.9%
Sad 25.6%
Confused 4.5%
Angry 6.3%
Happy 6.7%
Calm 12%
Surprised 9%

AWS Rekognition

Age 26-43
Gender Male, 80.8%
Disgusted 1.8%
Sad 82.3%
Confused 4.8%
Calm 2.9%
Angry 5.5%
Surprised 2%
Happy 0.7%

AWS Rekognition

Age 20-38
Gender Male, 93.2%
Angry 2.9%
Disgusted 67.9%
Happy 1.1%
Calm 19.6%
Sad 2.7%
Confused 2.1%
Surprised 3.6%

AWS Rekognition

Age 26-43
Gender Female, 99.6%
Happy 3.2%
Calm 47.7%
Disgusted 3%
Confused 3.8%
Sad 31.4%
Angry 3.7%
Surprised 7.2%

AWS Rekognition

Age 26-43
Gender Male, 80.9%
Angry 4.9%
Disgusted 11%
Sad 24%
Surprised 4.1%
Calm 48%
Happy 4.1%
Confused 3.9%

AWS Rekognition

Age 15-25
Gender Male, 69%
Disgusted 2.5%
Angry 1.9%
Sad 1.2%
Surprised 1.9%
Confused 0.9%
Happy 1.9%
Calm 89.7%

AWS Rekognition

Age 23-38
Gender Female, 53.2%
Confused 45.7%
Angry 46.3%
Surprised 45.5%
Calm 47.6%
Disgusted 45.9%
Happy 45.2%
Sad 48.9%

AWS Rekognition

Age 57-77
Gender Female, 64.7%
Sad 88.2%
Disgusted 1.9%
Angry 2.9%
Happy 0.4%
Confused 1.6%
Surprised 0.9%
Calm 4%

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 66
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Painting 99.1%

Categories

Captions