Human Generated Data

Title

The Broken Wall (Episode 5) from the "Tales of Ise" (Ise monogatari)
Date

Late 16th to early 17th century
People

Artist: Tosa School,

Classification

Paintings
Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Langdon Warner (Gift of Yanagi Sōetsu to Langdon Warner, 1946), 1946.50.4

Human Generated Data

Title

The Broken Wall (Episode 5) from the "Tales of Ise" (Ise monogatari)

People

Artist: Tosa School,

Date

Late 16th to early 17th century

Classification

Paintings

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of Langdon Warner (Gift of Yanagi Sōetsu to Langdon Warner, 1946), 1946.50.4

Machine Generated Data

Tags

Amazon
created on 2020-04-24

Interior Design 90.1
Indoors 90.1
Person 86.4
Human 86.4
Art 83.2
Person 78.8
Person 74.7
Drawing 72.1
Apparel 69.8
Clothing 69.8
Text 69.3
Advertisement 63.7
Painting 56.2
Steamer 55.7
Poster 53.9

Clarifai
created on 2020-04-24

people 99.3
group 96.3
vintage 94.7
illustration 94.4
wear 93.6
military 93.2
art 93
adult 92.8
war 91.7
vehicle 90.1
paper 90
retro 88.9
administration 88.7
group together 88.5
print 88
antique 86.3
weapon 85.6
man 85.6
soldier 84.4
painting 84.2

Imagga
created on 2020-04-24

grunge 47.7
old 44.6
wall 38.3
aged 36.2
texture 36.1
vintage 35.6
antique 35.5
stucco 35.3
retro 33.6
grungy 33.2
ancient 29.4
frame 29.1
dirty 26.2
paint 25.3
blank 24
paper 23.9
structure 22.5
space 22.5
gravestone 22
pattern 21.9
worn 21
border 20.8
brown 20.6
stone 19.7
art 19.6
stained 19.2
rough 19.1
weathered 19
screen 18.8
memorial 18.7
window screen 18.4
text 18.3
aging 18.2
canvas 17.1
snow 17
design 16.9
textured 16.7
torn 16.4
parchment 16.3
damaged 16.2
building 15.6
color 15.6
wallpaper 15.3
material 15.2
empty 14.6
dirt 14.3
decorative 14.2
burnt 13.6
surface 13.2
black 13.2
page 13
protective covering 12.6
architecture 11.7
negative 11.4
fence 11.3
graphic 10.9
house 10.9
messy 10.6
decay 10.6
rusty 10.5
detail 10.5
decoration 10.1
yellow 9.9
rust 9.6
weather 9.6
urban 9.6
film 9.2
burned 8.8
album 8.8
light 8.7
covering 8.5
sheet 8.5
exterior 8.3
landscape 8.2
style 8.2
shabby 7.8
noise 7.8
artistic 7.8
scratch 7.8
sepia 7.8
stain 7.7
spot 7.7
obsolete 7.7
great 7.7
concrete 7.7
barrier 7.6
poster 7.6
dark 7.5
backgrounds 7.3
digital 7.3
rural 7
travel 7
country 7

Google
created on 2020-04-24

Illustration 75.4
Art 70.9
Stock photography 59.4
Black-and-white 56.4
History 54.1

Microsoft
created on 2020-04-24

drawing 99.7
text 99.7
sketch 98.9
painting 96.3
child art 95.1
cartoon 81.5
black and white 76.9
old 54.6

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 48-66
Gender Female, 53%
Angry 45%
Calm 52.6%
Happy 47.1%
Confused 45%
Surprised 45%
Fear 45%
Sad 45.2%
Disgusted 45%

AWS Rekognition

Age 18-30
Gender Female, 50.5%
Disgusted 45.1%
Fear 45.2%
Calm 47.4%
Surprised 47.2%
Angry 49.2%
Sad 45.1%
Confused 45.1%
Happy 45.6%

Feature analysis

Amazon

Person 86.4%
Poster 53.9%

Captions

Microsoft
created on 2020-04-24

an old photo of a person 63.6%
a black and white photo of a person 52%
old photo of a person 51.9%