Human Generated Data

Title

Picture of the Current Confrontation of Americans in Japan (Kono tabi amerikajin dai nihon taimen no zu)

Date

c. 1857

People
Classification

Prints

Credit Line

Harvard Art Museums/Arthur M. Sackler Museum, Gift of The Honorable Joseph C. Grew, 1951.135

Human Generated Data

Title

Picture of the Current Confrontation of Americans in Japan (Kono tabi amerikajin dai nihon taimen no zu)

People
Date

c. 1857

Classification

Prints

Machine Generated Data

Tags

Amazon
created on 2022-06-17

Person 98.7
Human 98.7
Person 98.6
Person 98
Person 97.9
Person 97.9
Person 97.6
Text 96.7
Person 94.5
Person 90
Person 87.7
Person 82.4
Transportation 71.7
Vehicle 71.1
Honey Bee 70.1
Invertebrate 70.1
Insect 70.1
Bee 70.1
Animal 70.1
Honey Bee 66.3
Person 66.1
Bicycle 61.5
Bike 61.5
Machine 55.8
Spoke 55.8

Imagga
created on 2022-06-17

menu 78
fare 64.9
brass 54.2
memorial 47.7
grunge 46.9
old 46.7
vintage 44.7
antique 42.4
structure 41.7
retro 37.7
texture 36.8
aged 33.5
food 29.8
ancient 27.7
frame 25.8
grungy 24.7
border 24.4
pattern 24
damaged 23.9
paper 23.5
dirty 22.6
material 22.3
blackboard 21.4
wall 21.4
art 20.8
text 20.1
rough 20.1
design 19.1
backdrop 16.5
paint 16.3
rusty 16.2
blank 15.4
graphic 15.3
textured 14.9
space 14.8
empty 14.6
parchment 14.4
grain 12.9
weathered 12.4
wallpaper 12.3
historic 11.9
stains 11.7
burnt 11.7
sepia 11.7
spot 11.5
page 11.1
color 11.1
decoration 10.8
scratch 10.7
ragged 10.7
crumpled 10.7
movie 10.7
messy 10.6
decay 10.6
edge 10.6
film 10.6
worn 10.5
dirt 10.5
canvas 10.4
sheet 10.3
black 10.2
card 10.2
decorative 10
burned 9.8
noise 9.8
grime 9.8
slide 9.8
fracture 9.7
close 9.7
rust 9.6
collage 9.6
brown 9.6
map 9.4
note 9.2
letter 9.2
book 9.2
digital 8.9
designed 8.9
photographic 8.8
surface 8.8
negative 8.8
tracery 8.8
mottled 8.8
faded 8.8
succulent 8.8
strip 8.7
graffito 8.6
entertainment 8.3
element 8.3
stone 8.2
message 8.2
backgrounds 8.1
noisy 7.9
broad 7.9
scratched 7.8
frames 7.8
stamp 7.7
torn 7.7
your 7.7
layer 7.7
notes 7.7
textures 7.6
word 7.5
screen 7.5
computer 7.5
business 7.3
yellow 7.3
daily 7.2
nobody 7

Google
created on 2022-06-17

Handwriting 91.8
Font 82.9
Art 79.5
Illustration 69.7
Parallel 69
Drawing 68.9
Paper 67.1
Line art 66.3
Monochrome 66.2
Rectangle 65.3
Paper product 64.6
Painting 63.4
Pattern 62.4
Visual arts 61.9
Document 59
Writing 58.1
Ink 57.2
Sketch 55.9

Microsoft
created on 2022-06-17

text 99.9
black and white 96.1
drawing 91.6
cartoon 89.5
handwriting 88.3
sketch 85.2
monochrome 68.5

Face analysis

Amazon

AWS Rekognition

Age 21-29
Gender Male, 99.7%
Confused 64.4%
Calm 22.2%
Surprised 8%
Angry 6.4%
Fear 6.4%
Sad 2.8%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Male, 100%
Surprised 58.9%
Calm 21.9%
Happy 20.7%
Fear 8.4%
Confused 6.8%
Angry 5.2%
Sad 2.8%
Disgusted 2.2%

AWS Rekognition

Age 20-28
Gender Female, 85.2%
Disgusted 29%
Angry 24%
Calm 21%
Surprised 15.4%
Fear 7.7%
Happy 5.9%
Sad 2.9%
Confused 1.9%

AWS Rekognition

Age 18-24
Gender Male, 77.3%
Angry 47.6%
Surprised 32.9%
Confused 20.3%
Fear 6.2%
Calm 5.2%
Sad 2.4%
Happy 1.2%
Disgusted 1%

AWS Rekognition

Age 31-41
Gender Male, 96.3%
Calm 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Angry 0.4%
Confused 0.1%
Disgusted 0.1%
Happy 0%

AWS Rekognition

Age 23-31
Gender Male, 96.8%
Sad 99.8%
Calm 15.1%
Fear 8.6%
Surprised 6.6%
Happy 2.9%
Disgusted 2.2%
Confused 2.1%
Angry 1.3%

AWS Rekognition

Age 22-30
Gender Female, 69%
Fear 38.6%
Surprised 38.2%
Happy 15.5%
Calm 9.9%
Angry 6.2%
Confused 5.4%
Sad 2.5%
Disgusted 1.8%

AWS Rekognition

Age 23-31
Gender Female, 99.6%
Sad 99.6%
Confused 20.9%
Surprised 9.2%
Fear 6.1%
Calm 3.6%
Angry 2.9%
Disgusted 1.2%
Happy 0.3%

AWS Rekognition

Age 23-31
Gender Female, 56.7%
Calm 46.6%
Angry 21.1%
Surprised 13.5%
Happy 10.8%
Fear 6.1%
Sad 5.2%
Confused 3.3%
Disgusted 1.4%

Feature analysis

Amazon

Person 98.7%
Honey Bee 70.1%

Captions

Microsoft

text 18.1%

Text analysis

Amazon

NOTHING
AMERICAN
OF
L NOTHING
PROCESSION
L
135
DELEGATION
1
+
To
1951
To VIGIT
VIGIT
ABOUT
62m
&
to
x
*******
SAID
SHOHUN
phn
TOTAL
FOR
I
IN+
ytp
SV
4
ИДК
TaBt
AS

Google

けんぶちかち
夜分
十八
三百
而今
川东
兄弟
やがえび
十六
人均
老三
そう
悦悦
,
设施
九月
廿三
海奇
中医
味方
いごそ
f-
握り
三千
ゆり
のみ
亦未
一个
男 任中医等保 发蒲福 源 唐裔兄弟异 一心—震專廣 天康发買热拿 宮宴 。活 ゆり味方のみと脅いごそ みととけんぶちかち 亦未 死 f-茶 夜分示人奪捍生 努夜市の決之案 握りやがえび味 ㄗㄨ力, 一文格 它吏府罩多 一一孩为千宏 十六人 一个小人均 老三式人 一大 十六そう 一 五十八 百绎紧 一万三千, 己百 三百幹 热般人殺三百十人 热泽双石小大悦悦小大市 洗地失筒筒织数社的人, 文 设施 一 人 而今, 定9己九月廿三日 足川东海奇緣花 亞思利 WHICH
一心
みとと
夜市
一一
9
亞思利
WHICH