Towards the Creation of a Poetry Translation Mapping System

The translation of poetry is a complex, multifaceted challenge: the translated text should communicate the same meaning, similar metaphoric expressions, and also match the style and prosody of the original poem. Research on machine poetry translation is existing since 2010, but for four reasons it is still rather insufficient: 1. The few approaches existing completely lack any knowledge about current developments in both lyric theory and translation theory. 2. They are based on very small datasets. 3. They mostly ignored the neural learning approach that superseded the long-standing dominance of phrase-based approaches within machine translation. 4. They have no concept concerning the pragmatic function of their research and the resulting tools. Our paper describes how to improve the existing research and technology for poetry translations in exactly these four points. With regards to 1) we will describe the “Poetics of Translation”. With regards to 2) we will introduce the Worlds largest corpus for poetry translations from lyrikline. With regards to 3) we will describe first steps towards a neural machine translation of poetry. With regards to 4) we will describe first steps towards the development of a poetry translation mapping system

The InproTK 2012 release

Baumann T, Schlangen D. The InproTK 2012 release. In: Eskenazi M, Black A, Traum D, eds. SDCTD '12 NAACL-HLT Workshop on Future Directions and Needs in the Spoken Dialog Community: Tools and Data. Stroudsburg, PA: ACL; 2012: 29-32

Situationally Aware In-Car Information Presentation Using Incremental Speech Generation: Safer, and More Effective

Kousidis S, Kennington C, Baumann T, Buschmeier H, Kopp S, Schlangen D. Situationally Aware In-Car Information Presentation Using Incremental Speech Generation: Safer, and More Effective. In: Proceedings of the EACL 2014 Workshop on Dialogue in Motion. Gothenburg, Sweden; 2014: 68-72.Holding non-co-located conversations while driving is dangerous (Horrey and Wickens, 2006; Strayer et al., 2006), much more so than conversations with physically present, “situated” interlocutors (Drews et al., 2004). In-car dialogue systems typically resemble non-co-located conversations more, and share their negative impact (Strayer et al., 2013). We implemented and tested a simple strategy for making in-car dialogue systems aware of the driving situation, by giving them the capability to interrupt themselves when a dangerous situation is detected, and resume when over. We show that this improves both driving performance and recall of system-presented information, compared to a non-adaptive strategy

Evaluation and Optimisation of Incremental Processors

Incremental spoken dialogue systems, which process user input as it unfolds, pose additional engineering challenges compared to more standard non-incremental systems: Their processing components must be able to accept partial, and possibly subsequently revised input, and must produce output that is at the same time as accurate as possible and delivered with as little delay as possible. In this article, we define metrics that measure how well a given processor meets these challenges, and we identify types of gold standards for evaluation. We exemplify these metrics in the evaluation of several incremental processors that we have developed. We also present generic means to optimise some of the measures, if certain trade-offs are accepted. We believe that this work will help enable principled comparison of components for incremental dialogue systems and portability of results

A Multimodal In-Car Dialogue System That Tracks The Driver's Attention

Kousidis S, Kennington C, Baumann T, Buschmeier H, Kopp S, Schlangen D. A Multimodal In-Car Dialogue System That Tracks The Driver's Attention. In: Proceedings of the 16th International Conference on Multimodal Interfaces. Istanbul, Turkey; 2014: 26-33.When a passenger speaks to a driver, he or she is co-located with the driver, is generally aware of the situation, and can stop speaking to allow the driver to focus on the driving task. In-car dialogue systems ignore these important aspects, making them more distracting than even cell-phone conversations. We developed and tested a ``situationally-aware'' dialogue system that can interrupt its speech when a situation which requires more attention from the driver is detected, and can resume when driving conditions return to normal. Furthermore, our system allows driver-controlled resumption of interrupted speech via verbal or visual cues (head nods). Over two experiments, we found that the situationally-aware spoken dialogue system improves driving performance and attention to the speech content, while driver-controlled speech resumption does not hinder performance in either of these two tasks

Better Driving and Recall When In-car Information Presentation Uses Situationally-Aware Incremental Speech Output Generation

Kennington C, Kousidis S, Baumann T, Buschmeier H, Kopp S, Schlangen D. Better Driving and Recall When In-car Information Presentation Uses Situationally-Aware Incremental Speech Output Generation. In: AutomotiveUI 2014: Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. Seattle, Washington, USA; 2014: 7:1-7:7.It is established that driver distraction is the result of sharing cognitive resources between the primary task (driving) and any other secondary task. In the case of holding conversations, a human passenger who is aware of the driving conditions can choose to interrupt his speech in situations potentially requiring more attention from the driver, but in-car information systems typically do not exhibit such sensitivity. We have designed and tested such a system in a driving simulation environment. Unlike other systems, our system delivers infor- mation via speech (calendar entries with scheduled meetings) but is able to react to signals from the environment to interrupt when the driver needs to be fully attentive to the driving task and subsequently resume its delivery. Distraction is measured by a secondary short-term memory task. In both tasks, drivers perform significantly worse when the system does not adapt its speech, while they perform equally well to control conditions (no concurrent task) when the system intelligently interrupts and resumes

Fluxed M5-instantons in F-theory

We analyse the non-perturbative superpotential due to M5-brane instantons in F-theory compactifications on Calabi-Yau fourfolds. The M5 partition function is obtained via holomorphic factorisation by explicitly performing the sum over chiral 3-form fluxes. Comparison with the partition function of fluxed Euclidean D3-brane instantons in Type IIB orientifolds allows us to fix the spin structure on the intermediate Jacobian of the M5-instanton. We furthermore analyse the contribution of the M5-instanton to the superpotential in the presence of G4 gauge flux, where the superpotential is dressed with matter fields. We explicitly evaluate the pullback of G4 onto the M5-brane as a measure for the presence of charged instanton zero modes. This accounts for the M5 charge both under massless U(1)s, if present, and under what corresponds in Type II language to geometrically massive U(1)s.Comment: 47 pages. v3: refs. added, matches version published in Nuclear Physics

Spacetime Instanton Corrections in 4D String Vacua - The Seesaw Mechanism for D-Brane Models

We systematically investigate instanton corrections from wrapped Euclidean D-branes to the matter field superpotential of various classes of N=1 supersymmetric D-brane models in four dimensions. Both gauge invariance and the counting of fermionic zero modes provide strong constraints on the allowed non-perturbative superpotential couplings. We outline how the complete instanton computation boils down to the computation of open string disc diagrams for boundary changing operators multiplied by a one-loop vacuum diagram. For concreteness we focus on E2-instanton effects in Type IIA vacua with intersecting D6-branes, however the same structure emerges for Type IIB and heterotic vacua. The instantons wrapping rigid cycles can potentially destabilise the vacuum or generate perturbatively absent matter couplings such as proton decay operators, mu-parameter or right-handed neutrino Majorana mass terms. The latter allow the realization of the seesaw mechanism for MSSM-like intersecting D-brane models.Comment: 40 pages, 3 tables, 7 figures; v2: typos corrected, references added; v3: minor sign adjustments, some comments added; v4: published versio