2,682 research outputs found
Dual Long Short-Term Memory Networks for Sub-Character Representation Learning
Characters have commonly been regarded as the minimal processing unit in
Natural Language Processing (NLP). But many non-latin languages have
hieroglyphic writing systems, involving a big alphabet with thousands or
millions of characters. Each character is composed of even smaller parts, which
are often ignored by the previous work. In this paper, we propose a novel
architecture employing two stacked Long Short-Term Memory Networks (LSTMs) to
learn sub-character level representation and capture deeper level of semantic
meanings. To build a concrete study and substantiate the efficiency of our
neural architecture, we take Chinese Word Segmentation as a research case
example. Among those languages, Chinese is a typical case, for which every
character contains several components called radicals. Our networks employ a
shared radical level embedding to solve both Simplified and Traditional Chinese
Word Segmentation, without extra Traditional to Simplified Chinese conversion,
in such a highly end-to-end way the word segmentation can be significantly
simplified compared to the previous work. Radical level embeddings can also
capture deeper semantic meaning below character level and improve the system
performance of learning. By tying radical and character embeddings together,
the parameter count is reduced whereas semantic knowledge is shared and
transferred between two levels, boosting the performance largely. On 3 out of 4
Bakeoff 2005 datasets, our method surpassed state-of-the-art results by up to
0.4%. Our results are reproducible, source codes and corpora are available on
GitHub.Comment: Accepted & forthcoming at ITNG-201
Exceptional Collections and del Pezzo Gauge Theories
Stacks of D3-branes placed at the tip of a cone over a del Pezzo surface
provide a way of geometrically engineering a small but rich class of
gauge/gravity dualities. We develop tools for understanding the resulting
quiver gauge theories using exceptional collections. We prove two important
results for a general quiver gauge theory: 1) we show the ordering of the nodes
can be determined up to cyclic permutation and 2) we derive a simple formula
for the ranks of the gauge groups (at the conformal point) in terms of the
numbers of bifundamentals. We also provide a detailed analysis of four node
quivers, examining when precisely mutations of the exceptional collection are
related to Seiberg duality.Comment: 26 pages, 1 figure; v2 footnote 2 amended; v3 ref adde
- …