Joint Dropout: Improving Generalizability in Low-Resource Neural Machine Translation through Phrase Pair Variables

Despite the tremendous success of Neural Machine Translation (NMT), its performance on low- resource language pairs still remains subpar, partly due to the limited ability to handle previously unseen inputs, i.e., generalization. In this paper, we propose a method called Joint Dropout, that addresses the challenge of low-resource neural machine translation by substituting phrases with variables, resulting in significant enhancement of compositionality, which is a key aspect of generalization. We observe a substantial improvement in translation quality for language pairs with minimal resources, as seen in BLEU and Direct Assessment scores. Furthermore, we conduct an error analysis, and find Joint Dropout to also enhance generalizability of low-resource NMT in terms of robustness and adaptability across different domains

Joint Dropout: Improving Generalizability in Low-Resource Neural Machine Translation through Phrase Pair Variables

Despite the tremendous success of Neural Machine Translation (NMT), its performance on low- resource language pairs still remains subpar, partly due to the limited ability to handle previously unseen inputs, i.e., generalization. In this paper, we propose a method called Joint Dropout, that addresses the challenge of low-resource neural machine translation by substituting phrases with variables, resulting in significant enhancement of compositionality, which is a key aspect of generalization. We observe a substantial improvement in translation quality for language pairs with minimal resources, as seen in BLEU and Direct Assessment scores. Furthermore, we conduct an error analysis, and find Joint Dropout to also enhance generalizability of low-resource NMT in terms of robustness and adaptability across different domains

Helical vs. fundamental solitons in optical fibers

We consider solitons in a nonlinear optical fiber with a single polarization in a region of parameters where it carries exactly two distinct modes, the fundamental one and the first-order helical mode. From the viewpoint of applications to dense-WDM communication systems, this opens way to double the number of channels carried by the fiber. Aside from that, experimental observation of helical (spinning) solitons and collisions between them and with fundamental solitons are issues of fundamental interest. We introduce a system of coupled nonlinear Schroedinger equations for fundamental and helical modes, which have nonstandard values of the cross-phase-modulation coupling constants, and investigate, analytically and numerically, results of "complete" and "incomplete" collisions between solitons carried by the two modes. We conclude that the collision-induced crosstalk is partly attenuated in comparison with the usual WDM system, which sometimes may be crucially important, preventing merger of the colliding solitons into a breather. The interaction between the two modes is found to be additionally strongly suppressed in comparison with that in the WDM system in the case when a dispersion-shifted or dispersion-compensated fiber is used.Comment: a plain latex file with the text and two ps files with figures. Physica Scripta, in pres