Analyzing and Interpreting Neural Networks for NLP: A Report on the First BlackboxNLP Workshop

The EMNLP 2018 workshop BlackboxNLP was dedicated to resources and techniques specifically developed for analyzing and understanding the inner-workings and representations acquired by neural models of language. Approaches included: systematic manipulation of input to neural networks and investigating the impact on their performance, testing whether interpretable knowledge can be decoded from intermediate representations acquired by neural networks, proposing modifications to neural network architectures to make their knowledge state or generated output more explainable, and examining the performance of networks on simplified or formal languages. Here we review a number of representative studies in each category

Definiteness and determinacy

This paper distinguishes between definiteness and determinacy. Definiteness is seen as a morphological category which, in English, marks a (weak) uniqueness presupposition, while determinacy consists in denoting an individual. Definite descriptions are argued to be fundamentally predicative, presupposing uniqueness but not existence, and to acquire existential import through general type-shifting operations that apply not only to definites, but also indefinites and possessives. Through these shifts, argumental definite descriptions may become either determinate (and thus denote an individual) or indeterminate (functioning as an existential quantifier). The latter option is observed in examples like ‘Anna didn’t give the only invited talk at the conference’, which, on its indeterminate reading, implies that there is nothing in the extension of ‘only invited talk at the conference’. The paper also offers a resolution of the issue of whether possessives are inherently indefinite or definite, suggesting that, like indefinites, they do not mark definiteness lexically, but like definites, they typically yield determinate readings due to a general preference for the shifting operation that produces them.We thank Dag Haug, Reinhard Muskens, Luca Crnic, Cleo Condoravdi, Lucas Champollion, Stanley Peters, Roger Levy, Craige Roberts, Bert LeBruyn, Robin Cooper, Hans Kamp, Sebastian Lobner, Francois Recanati, Dan Giberman, Benjamin Schnieder, Rajka Smiljanic, Ede Zimmerman, as well as audiences at SALT 22 in Chicago, IATL 29 in Jerusalem, Going Heim in Connecticut, the Workshop on Bare Nominals and Non-Standard Definites in Utrecht, the University of Cambridge, the University of Gothenburg, the University of Konstanz, New York University, the University of Oxford, Rutgers University, the University of Southern California, Stanford University, and the University of Texas at Austin. Beaver was supported by NSF grants BCS-0952862 and BCS-1452663. Coppock was supported by Swedish Research Council project 2009-1569 and Riksbankens Jubileumsfond's Pro Futura Scientia program, administered through the Swedish Collegium for Advanced Study. (BCS-0952862 - NSF; BCS-1452663 - NSF; 2009-1569 - Swedish Research Council; Riksbankens Jubileumsfond's Pro Futura Scientia program

Variation and Adaptation in Lexical Processing and Acquisition

Recent emphasis on language knowledge as an emergent dynamic system has drawn considerable attention to the role of time in the way speakers acquire and use their own language. There are at least three levels on which time matters. At the processing level, the interaction between processing and memory constraints, and in particular between short-term and long-term memory issues, is understood to shape the way we recode and organise time-bound sequences of linguistic signals. On an ontogenetic scale, the age of acquisition of language input data, and the duration of exposure (in the case of multilingual contexts) are known to interact with issues of cognitive maturation and brain plasticity, yielding different outcomes as a function of different time intervals. In this connection, also the distribution of input data in a particular linguistic environment (both in terms of word type and token frequency) is bound to have an impact on rate and speed of acquisition and on overall knowledge organisation. Finally, all previously mentioned time-effects conspire to make the language system change through usage and acquisition in passing from one generation to the ensuing one

A Szintaktikai Lokalitás Minimalista Megközelítése: A szintaktikai lokalitási feltételekért felelős nyelvi alrendszerek munkamegosztásának vizsgálata = A Minimalist Approach to Syntactic Locality: A study of the division of labour of linguistic subsystems underlying syntactic locality effects

A projekt a szintaxis és az azzal érintkező grammatikai komponensek munkamegosztását vizsgálta a mozgatási és polaritás engedélyezési függőségekben jelentkező szintaktikai lokalitási hatások területén. A projektnek a generatív grammatika mai, Minimalista kutatási programjába illeszkedő radikális tézise szerint a természetes nyelvi szintaxis egyáltalán nem is tartalmaz külön lokalitási megszorítás(oka)t. Kimutattuk, hogy az általunk vizsgált, a szintaxisban jelentkező lokalitási hatások (i) a szintaktikai komputációs rendszer általános tulajdonságaiból, különösen a komputációs komplexitása minimalizálásának igényéből, valamint (ii) a szintaxis és a vele érintkező grammatikai alrendszerek munkamegosztásából fakadnak. A projekt olyan területeken vizsgálta a lokalitási hatások természetét, mint a főnévi kifejezések által képviselt szigetek, a szintaktikai fejmozgatás, a kvantorhatókör-értelmezés, a fókuszálás, a határozói módosítás, a mondatbeágyazás, a preszuppozíciós, a tagadó és a kérdő típusú gyenge szigetek, és egyes, a polaritásengedélyezésben szerepet játszó intervenciós hatások. A több nemzetközi együttműködést is kezdeményező kutatócsoport munkájának sikerességét a számos jelentős publikáció, köztük egy sor nemzetközi folyóiratcikk és nagy presztízsű nemzetközi kiadónál megjelenő könyvfejezet is jelzi. A kutatás keretében egy megvédett DSc értekezés és egy leadott PhD disszertáció is született, és egy további doktori disszertáció készül el még ebben az évben. | This project studied the division of labour between syntax and its interface subsystems in giving rise to some of the central syntactic locality properties of dependencies like movement and polarity licensing. Implementing the current Minimalist research program of transformational generative grammar, it explored the radical proposal that natural language syntax itself includes no special syntactic locality conditions per se. Instead, the locality effects under scrutiny are reduced to (i) the elementary properties of the syntactic computational system, including its quest to keep computational complexity to a minimum, which in turn subsumes its cyclic mapping to the interpretive systems of sound and meaning; and (ii) the division of labour between syntax and the interface subsystems, in particular, semantics and information structure. The topics investigated include the locality effects involved in noun phrase islands, syntactic head movement, quantifier scope interpretation, focusing, adverbial modification, clausal embedding, weak islands like presuppositional, negative, and wh-islands, and some apparent intervention effects in polarity licensing. The project established fruitful international co-operations, and its results have appeared in the form of a number of international journal and book chapter publications. The project has also yielded a completed PhD dissertation, a PhD thesis to be submitted later this year, and a DSc dissertation

WARTEG’ FOOD SELLERS’ LANGUAGE ATTITUDES TOWARD TEGAL DIALECT OF JAVANESE LANGUAGE IN SEMARANG

This paper presents a sociolinguistics research on multilingual society which aims to describe the language attitudes and language choice of the food sellers of Tegal food stalls (warteg) in Semarang toward Tegal dialect of Javanese Language (TL). The language choice research was also done to support the respondents’ answer in language attitude questions. The data was collected during June and July 2016 to warteg food sellers in Semarang as the respondents. The questionnaires were assessed about their agreement or disagreement for 10 statements on a five-point Likert type scale. The respondents were also being asked about the language used to talk to others in their daily activities. Using mean score, Likert type formula and Independent t test, the results indicated that the total 111 respondents still have positive attitudes toward TL even though they live outside of Tegal area. They prefer to use TL than other languages to talk to other Tegalese

An End-to-End Conversational Style Matching Agent

We present an end-to-end voice-based conversational agent that is able to engage in naturalistic multi-turn dialogue and align with the interlocutor's conversational style. The system uses a series of deep neural network components for speech recognition, dialogue generation, prosodic analysis and speech synthesis to generate language and prosodic expression with qualities that match those of the user. We conducted a user study (N=30) in which participants talked with the agent for 15 to 20 minutes, resulting in over 8 hours of natural interaction data. Users with high consideration conversational styles reported the agent to be more trustworthy when it matched their conversational style. Whereas, users with high involvement conversational styles were indifferent. Finally, we provide design guidelines for multi-turn dialogue interactions using conversational style adaptation

On becoming a physicist of mind

In 1976, the German Max Planck Society established a new research enterprise in psycholinguistics, which became the Max Planck Institute for Psycholinguistics in Nijmegen, the Netherlands. I was fortunate enough to be invited to direct this institute. It enabled me, with my background in visual and auditory psychophysics and the theory of formal grammars and automata, to develop a long-term chronometric endeavor to dissect the process of speaking. It led, among other work, to my book Speaking (1989) and to my research team's article in Brain and Behavioral Sciences “A Theory of Lexical Access in Speech Production” (1999). When I later became president of the Royal Netherlands Academy of Arts and Sciences, I helped initiate the Women for Science research project of the Inter Academy Council, a project chaired by my physicist sister at the National Institute of Standards and Technology. As an emeritus I published a comprehensive History of Psycholinguistics (2013). As will become clear, many people inspired and joined me in these undertakings