Human Generated Data

Title

Album Leaf of Figures

Date

17th-19th century

People
Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Bequest of the Hofer Collection of the Arts of Asia, 1985.924.5

Human Generated Data

Title

Album Leaf of Figures

People
Date

17th-19th century

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-05-31

Art 98.1
Painting 98.1
Person 97.3
Human 97.3
Person 95.2
Person 92.8
Person 91.9
Person 91
Person 89.6
Person 89.2
Person 88.5
Floor 72.7
Flooring 67.7
Toy 61.4
Wood 58.6
Person 57
Figurine 56.1
Plywood 55.1
Person 46.6

Clarifai
created on 2019-05-31

painting 99.6
people 99.6
art 98.9
building 98.3
adult 98
house 97.5
indoors 97.3
child 97
man 95.4
religion 95.4
group 95.4
woman 95.2
room 94.6
family 93.8
architecture 90.3
wall 89.8
illustration 89.7
ancient 88.4
inside 87.6
museum 87

Imagga
created on 2019-05-31

parquet 30.1
wall 25.5
sand 18.6
old 16.7
stone 14.3
man 14.2
texture 13.9
fun 13.5
people 13.4
travel 13.4
male 12.1
mosquito net 12
brown 11.8
architecture 11.7
sport 11.3
rock 11.3
pattern 10.9
hall 10.9
athlete 10.7
water 10.7
ancient 10.4
play 10.3
home plate 10.2
beach 10.1
base 10
net 10
pad 10
ball 9.7
player 9.7
drawing chalk 9.7
jump 9.6
covering 9.6
boy 9.6
high 9.5
antique 9.5
men 9.4
grunge 9.4
teen 9.2
competition 9.1
playing 9.1
dirty 9
active 9
outdoors 8.9
natural 8.7
muscle 8.7
person 8.6
gym 8.6
concrete 8.6
support 8.6
chalk 8.6
basket 8.5
energy 8.4
desert 8.4
action 8.3
training 8.3
leisure 8.3
game 8.3
tourism 8.2
happy 8.1
basketball 8.1
detail 8
protective covering 8
look 7.9
design 7.9
face 7.8
winner 7.7
wallpaper 7.7
health 7.6
tall 7.5
wood 7.5
vintage 7.4
floor 7.4
fit 7.4
rough 7.3
lifestyle 7.2
home 7.2
team 7.2
history 7.1
material 7.1
cool 7.1
school 7
sea 7

Google
created on 2019-05-31

Painting 88.9
Art 88.4
Wall 88.2
Visual arts 86.3
Mural 68.5
Illustration 54.5
Modern art 53.1
Still life 51.2

Microsoft
created on 2019-05-31

painting 99.4
drawing 99.2
cartoon 94.7
child art 93.6
animal 83.5
sketch 80.8
clothing 80.5
person 75.7
art 66.5
stuffed 66.1

Face analysis

Amazon

AWS Rekognition

Age 29-45
Gender Male, 50.6%
Confused 45.3%
Surprised 45.4%
Happy 45.3%
Calm 52.3%
Sad 45.7%
Disgusted 45.2%
Angry 45.8%

AWS Rekognition

Age 35-52
Gender Male, 54.6%
Angry 46%
Calm 46.8%
Sad 45.8%
Surprised 45.3%
Disgusted 46.6%
Happy 49.1%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Angry 46.5%
Sad 47.6%
Disgusted 46.2%
Surprised 46.1%
Happy 46.5%
Calm 46.6%
Confused 45.5%

AWS Rekognition

Age 19-36
Gender Female, 51.9%
Surprised 45.2%
Sad 47.6%
Happy 48.3%
Angry 45.5%
Disgusted 45.4%
Confused 45.1%
Calm 47.8%

AWS Rekognition

Age 60-90
Gender Female, 50.1%
Angry 45.4%
Sad 48%
Disgusted 45.3%
Happy 45.4%
Calm 48.4%
Surprised 45.8%
Confused 46.8%

AWS Rekognition

Age 23-38
Gender Male, 54.4%
Angry 46.4%
Happy 47.1%
Calm 49.4%
Surprised 45.5%
Sad 45.7%
Confused 45.4%
Disgusted 45.5%

AWS Rekognition

Age 19-36
Gender Male, 54.4%
Confused 45%
Sad 45%
Calm 45.2%
Happy 45.1%
Surprised 45%
Disgusted 54.6%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Male, 54.8%
Sad 46.1%
Happy 51.2%
Confused 45.2%
Angry 46%
Surprised 45.2%
Disgusted 45.6%
Calm 45.6%

AWS Rekognition

Age 11-18
Gender Male, 54.8%
Happy 52.7%
Disgusted 45.2%
Sad 46.3%
Surprised 45.1%
Angry 45.3%
Calm 45.3%
Confused 45.1%

AWS Rekognition

Age 23-38
Gender Male, 52.7%
Angry 45.2%
Happy 45.7%
Confused 45.1%
Calm 53.3%
Disgusted 45.2%
Sad 45.3%
Surprised 45.3%

AWS Rekognition

Age 1-5
Gender Male, 51.5%
Angry 45.1%
Surprised 45.1%
Disgusted 46.8%
Sad 45%
Calm 52.5%
Happy 45.3%
Confused 45.1%

Feature analysis

Amazon

Painting 98.1%
Person 97.3%

Captions

Microsoft

a teddy bear is holding a bunch of stuffed animals 30.9%
a group of stuffed animals sitting next to a teddy bear 30.8%
a group of teddy bears standing next to a stuffed animal 30.7%