Human Generated Data

Title

Day of Judgment, folio from a manuscript of the Falnama (Book of Omens).
Date

c. 1555
People

-
Classification

Manuscripts
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Stuart Cary Welch, Jr., 1999.302

Human Generated Data

Title

Day of Judgment, folio from a manuscript of the Falnama (Book of Omens).

Date

c. 1555

Classification

Manuscripts

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Stuart Cary Welch, Jr., 1999.302

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Rug 95.5
Art 86.9
Poster 72.8
Advertisement 72.8
Painting 68.9
Collage 64.9
Person 64.7
Human 64.7
Quilt 61.7
Mural 59.6
Tapestry 57.4
Ornament 57.4

Clarifai
created on 2018-04-19

art 99
painting 98.4
pattern 96.4
illustration 96.3
religion 94.8
decoration 93.3
artistic 93.1
ancient 92.9
wall 92.6
old 92.2
culture 90.9
design 89.8
manuscript 89.7
mural 89.5
desktop 89.4
texture 88.8
traditional 87.6
antique 86.4
symbol 86.4
color 86.2

Imagga
created on 2018-04-19

mosaic 53.9
jigsaw puzzle 37.2
old 32.1
transducer 31.5
vintage 30.6
puzzle 30.3
texture 29.9
pattern 29.4
art 28.9
retro 28.7
paper 28.3
game 23.7
electrical device 23.6
antique 20
cotton 19.7
grunge 19.6
wallpaper 19.2
color 18.9
design 18
prayer rug 17.4
colorful 17.2
fabric 16.5
ancient 16.4
floral 16.2
decoration 16
rug 15.9
tile 15.8
covering 15.6
device 15.1
backdrop 14.8
quilt 14.7
flower 14.6
rough 14.6
border 14.5
symbol 13.5
worn 13.4
brown 13.3
aged 12.7
decorative 12.5
yellow 11.9
postage 11.8
material 11.6
stamp 11.6
mail 11.5
post 11.4
textured 11.4
seamless 11.4
paint 10.9
frame 10.8
furnishing 10.8
torn 10.7
surface 10.6
floor cover 10.5
textile 10.4
ornament 10.3
wall 10.3
graphic 10.2
letter 10.1
dirty 10
postmark 9.9
detail 9.7
style 9.6
stained 9.6
obsolete 9.6
bedclothes 9.6
canvas 9.5
leaf 9.3
traditional 9.2
collection 9
decor 8.8
postal 8.8
rusty 8.6
blank 8.6
close 8.6
weathered 8.6
grungy 8.5
sheet 8.5
modern 8.4
map 8.4
page 8.4
shape 8.2
history 8.1
world 8
instrumentality 7.9
rust 7.7
parchment 7.7
rustic 7.7
unique 7.6
number 7.5
historic 7.3
creation 7.1
clothing 7.1

Google
created on 2018-04-19

art 90.9
painting 84.2
textile 69.4
tapestry 67.6
miniature 65.6
artwork 64.7
modern art 58.2
material 57.9
middle ages 53.9
recreation 52

Microsoft
created on 2018-04-19

decorated 34.1
colorful 26.5
painted 26.1
fabric 24.1

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 17-27
Gender Female, 50.9%
Disgusted 45.1%
Sad 45.6%
Angry 45.2%
Surprised 45.2%
Calm 53.4%
Confused 45.3%
Happy 45.2%

AWS Rekognition

Age 26-43
Gender Female, 62.6%
Happy 6.3%
Sad 3.1%
Surprised 4.5%
Confused 3.7%
Calm 78.3%
Angry 1.9%
Disgusted 2.2%

AWS Rekognition

Age 23-38
Gender Female, 53%
Surprised 45.7%
Happy 47.7%
Sad 45.3%
Calm 49.8%
Angry 45.3%
Disgusted 46.1%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Female, 54.4%
Angry 45.2%
Calm 53.6%
Confused 45%
Surprised 45.1%
Disgusted 45.1%
Happy 45.6%
Sad 45.5%

AWS Rekognition

Age 35-52
Gender Female, 52.2%
Sad 45.3%
Calm 53.3%
Happy 45.4%
Surprised 45.4%
Angry 45.3%
Disgusted 45.2%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Male, 51.6%
Disgusted 47.7%
Calm 45.3%
Happy 46.4%
Confused 45.6%
Sad 46.5%
Surprised 46.3%
Angry 47.2%

AWS Rekognition

Age 26-43
Gender Female, 52.6%
Confused 45.1%
Angry 45.1%
Disgusted 45%
Surprised 45.2%
Calm 54.3%
Sad 45.3%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Male, 54.5%
Confused 45.2%
Disgusted 45.1%
Surprised 45.3%
Sad 45.1%
Happy 53%
Calm 46.1%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Happy 47.6%
Confused 45.9%
Angry 45.7%
Sad 45.6%
Calm 47.5%
Surprised 46.4%
Disgusted 46.2%

AWS Rekognition

Age 20-38
Gender Female, 54.5%
Calm 45.1%
Sad 45.8%
Disgusted 48.4%
Happy 47.1%
Angry 47.3%
Confused 45.7%
Surprised 45.6%

AWS Rekognition

Age 20-38
Gender Female, 52.4%
Disgusted 45.2%
Calm 49.8%
Happy 47.2%
Confused 45.4%
Sad 46.2%
Surprised 45.7%
Angry 45.4%

AWS Rekognition

Age 38-59
Gender Male, 52.4%
Angry 46.2%
Disgusted 46.4%
Happy 45.2%
Calm 50.7%
Surprised 45.5%
Sad 45.6%
Confused 45.4%

AWS Rekognition

Age 15-25
Gender Female, 53.7%
Happy 49.9%
Sad 46.3%
Angry 45.7%
Surprised 45.7%
Disgusted 45.7%
Calm 46.3%
Confused 45.4%

AWS Rekognition

Age 16-27
Gender Male, 85%
Sad 2%
Happy 1.6%
Angry 3.6%
Calm 70.5%
Surprised 13.5%
Confused 5.9%
Disgusted 2.8%

AWS Rekognition

Age 26-43
Gender Female, 53%
Sad 45.5%
Happy 45.6%
Angry 45.4%
Calm 51.3%
Surprised 45.7%
Confused 45.2%
Disgusted 46.3%

AWS Rekognition

Age 16-27
Gender Male, 54.1%
Disgusted 50.3%
Happy 45.3%
Calm 48.8%
Sad 45.1%
Surprised 45.3%
Angry 45.2%
Confused 45.1%

AWS Rekognition

Age 26-43
Gender Male, 52.9%
Calm 50.1%
Angry 45.7%
Happy 46%
Sad 46.5%
Disgusted 45.6%
Surprised 45.7%
Confused 45.4%

AWS Rekognition

Age 14-23
Gender Female, 54.2%
Sad 48.2%
Confused 46.3%
Surprised 45.8%
Angry 45.2%
Calm 48.5%
Happy 45.6%
Disgusted 45.4%

AWS Rekognition

Age 15-25
Gender Female, 54.7%
Confused 46.3%
Disgusted 47%
Sad 45.6%
Angry 45.8%
Calm 45.6%
Happy 48.7%
Surprised 46%

Microsoft Cognitive Services

Age 38
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Rug 95.5%
Person 64.7%

Categories

Imagga

paintings art 99.7%
interior objects 0.1%
text visuals 0.1%

Text analysis

Amazon

ER