Human Generated Data

Title

Page from an album: Finding of a Dalai Lama
Date

19th century
People
Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.863.5

Human Generated Data

Title

Page from an album: Finding of a Dalai Lama

People
Date

19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-09

Rug 92.9
Person 89.6
Human 89.6
Person 89.1
Art 87.8
Person 82.6
Person 81.4
Painting 77.7
Person 72.9
Text 70
Drawing 64.7
Pattern 58.7
Person 58.1
Mail 57.3
Envelope 57.3
Greeting Card 57.3

Clarifai
created on 2018-02-16

illustration 99.1
art 97.3
decoration 95.6
desktop 94.9
picture frame 94.2
card 94.1
design 93.6
vector 91.6
vintage 89.4
pattern 89.3
painting 88.5
tower 88
building 87.8
celebration 87.5
traditional 87.3
birthday 87.3
invitation 87.1
architecture 86.8
house 86.8
old 86.8

Imagga
created on 2018-02-16

tray 100
receptacle 100
container 90.5
old 34.1
vintage 33.1
retro 28.7
paper 26.7
frame 26.6
art 21
envelope 19.6
grunge 19.6
decoration 19.5
design 19.1
ancient 19
texture 18.8
card 17.9
flower 17.7
letter 17.4
stamp 16.4
mail 16.3
antique 15.6
blank 15.4
floral 15.3
page 14.8
postmark 14.8
postage 14.7
scrapbook 14.6
pattern 13.7
border 13.6
greeting 13
album 12.7
puzzle 12.6
postal 11.8
aged 11.8
leaf 11.7
money 11.1
cash 11
philately 10.9
congratulation 10.8
post 10.5
game 10.4
ornament 10.3
framework 9.8
style 9.6
invitation 9.6
currency 9
torn 8.7
drawing 8.6
ornate 8.2
gold 8.2
global 8.2
dirty 8.1
painting 8.1
collection 8.1
home 8
philatelic 7.9
business 7.9
circa 7.9
color 7.8
used 7.7
worn 7.6
finance 7.6
unique 7.6
sheet 7.5
decorative 7.5
anniversary 7.5
backdrop 7.4
handkerchief 7.2
bank 7.2
history 7.2

Google
created on 2018-02-16

picture frame 80
art 74.6
painting 74.4
artwork 65.4
illustration 61.3
miniature 59.9
paint 56.3
creative arts 54.2

Microsoft
created on 2018-02-16

indoor 94.7
decorated 48.9
picture frame 6.3

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Female, 52.2%
Sad 48.5%
Happy 45.2%
Calm 46.2%
Surprised 45.3%
Disgusted 45.4%
Angry 49.2%
Confused 45.2%

AWS Rekognition

Age 11-18
Gender Female, 54.2%
Happy 50.7%
Angry 45.3%
Disgusted 45.1%
Sad 48.3%
Surprised 45.3%
Calm 45.2%
Confused 45.2%

AWS Rekognition

Age 6-13
Gender Female, 53.7%
Disgusted 45.2%
Happy 45.2%
Confused 45.1%
Surprised 45.5%
Sad 50.5%
Calm 47.8%
Angry 45.7%

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Confused 45.2%
Sad 46%
Disgusted 45.2%
Happy 46.7%
Angry 45.4%
Surprised 51.1%
Calm 45.2%

AWS Rekognition

Age 20-38
Gender Female, 53.8%
Disgusted 45.2%
Sad 53.4%
Surprised 45.3%
Angry 45.4%
Happy 45.1%
Calm 45.4%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Female, 52.1%
Surprised 45.1%
Angry 45.5%
Happy 45.1%
Sad 53.5%
Disgusted 45.2%
Confused 45.2%
Calm 45.4%

AWS Rekognition

Age 23-38
Gender Female, 53.8%
Happy 45.2%
Sad 53.3%
Surprised 45.1%
Confused 45.1%
Calm 45.7%
Angry 45.4%
Disgusted 45.2%

AWS Rekognition

Age 20-38
Gender Female, 54.7%
Sad 45.8%
Angry 46.7%
Disgusted 45.9%
Happy 46.7%
Calm 47.6%
Confused 45.2%
Surprised 47.1%

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Surprised 46.2%
Sad 50.1%
Disgusted 45.3%
Calm 47.2%
Happy 45.5%
Angry 45.6%
Confused 45.1%

AWS Rekognition

Age 26-44
Gender Female, 52.1%
Happy 45.5%
Surprised 46.1%
Sad 49%
Angry 46.8%
Disgusted 45.3%
Confused 45.3%
Calm 46.9%

AWS Rekognition

Age 4-9
Gender Female, 53.9%
Angry 45.1%
Disgusted 45.1%
Sad 54.5%
Happy 45%
Calm 45.1%
Surprised 45.1%
Confused 45%

AWS Rekognition

Age 12-22
Gender Male, 52.9%
Happy 49.9%
Disgusted 45.5%
Angry 45.5%
Calm 45.6%
Surprised 47.5%
Sad 45.4%
Confused 45.6%

AWS Rekognition

Age 19-36
Gender Female, 51.2%
Confused 45.2%
Surprised 46.4%
Disgusted 45.2%
Sad 51.8%
Happy 45.1%
Angry 46%
Calm 45.3%

AWS Rekognition

Age 2-5
Gender Female, 53.8%
Happy 51.9%
Disgusted 45.4%
Angry 45.5%
Confused 45.2%
Calm 46%
Surprised 45.4%
Sad 45.7%

AWS Rekognition

Age 20-38
Gender Female, 54.7%
Calm 45.1%
Sad 54.3%
Surprised 45.1%
Happy 45%
Confused 45.1%
Angry 45.3%
Disgusted 45.1%

AWS Rekognition

Age 20-38
Gender Female, 54.6%
Calm 47%
Angry 45.3%
Disgusted 45.2%
Sad 46.3%
Surprised 45.4%
Confused 45.2%
Happy 50.7%

AWS Rekognition

Age 11-18
Gender Female, 50.4%
Happy 49.5%
Surprised 49.7%
Angry 49.6%
Calm 49.9%
Disgusted 49.6%
Sad 49.6%
Confused 49.6%

AWS Rekognition

Age 4-9
Gender Female, 54.6%
Surprised 45.2%
Calm 45.3%
Sad 54%
Confused 45.1%
Angry 45.2%
Happy 45.2%
Disgusted 45.1%

Feature analysis

Amazon

Rug 92.9%
Person 89.6%
Painting 77.7%

Captions

Microsoft

a birthday cake 40%
a decorated cake on a table 26.4%
a kitchen with a birthday cake 22.1%