Design and enhanced evaluation of a robust anaphor resolution algorithm

Syntactic coindexing restrictions are by now known to be of central importance to practical anaphor resolution approaches. Since, in particular due to structural ambiguity, the assumption of the availability of a unique syntactic reading proves to be unrealistic, robust anaphor resolution relies on techniques to overcome this deficiency. This paper describes the ROSANA approach, which generalizes the verification of coindexing restrictions in order to make it applicable to the deficient syntactic descriptions that are provided by a robust state-of-the-art parser. By a formal evaluation on two corpora that differ with respect to text genre and domain, it is shown that ROSANA achieves high-quality robust coreference resolution. Moreover, by an in-depth analysis, it is proven that the robust implementation of syntactic disjoint reference is nearly optimal. The study reveals that, compared with approaches that rely on shallow preprocessing, the largely nonheuristic disjoint reference algorithmization opens up the possibility/or a slight improvement. Furthermore, it is shown that more significant gains are to be expected elsewhere, particularly from a text-genre-specific choice of preference strategies. The performance study of the ROSANA system crucially rests on an enhanced evaluation methodology for coreference resolution systems, the development of which constitutes the second major contribution o/the paper. As a supplement to the model-theoretic scoring scheme that was developed for the Message Understanding Conference (MUC) evaluations, additional evaluation measures are defined that, on one hand, support the developer of anaphor resolution systems, and, on the other hand, shed light on application aspects of pronoun interpretation

Reviving the parameter revolution in semantics

Montague and Kaplan began a revolution in semantics, which promised to explain how a univocal expression could make distinct truth-conditional contributions in its various occurrences. The idea was to treat context as a parameter at which a sentence is semantically evaluated. But the revolution has stalled. One salient problem comes from recurring demonstratives: "He is tall and he is not tall". For the sentence to be true at a context, each occurrence of the demonstrative must make a different truth-conditional contribution. But this difference cannot be accounted for by standard parameter sensitivity. Semanticists, consoled by the thought that this ambiguity would ultimately be needed anyhow to explain anaphora, have been too content to posit massive ambiguities in demonstrative pronouns. This article aims to revived the parameter revolution by showing how to treat demonstrative pronouns as univocal while providing an account of anaphora that doesn't end up re-introducing the ambiguity

Knowledge-based disambiguation for machine translation

The resolution of ambiguities is one of the central problems for Machine Translation. In this paper we propose a knowledge-based approach to disambiguation which uses Description Logics (DL) as representation formalism. We present the process of anaphora resolution implemented in the Machine Translation system FAST and show how the DL system BACK is used to support disambiguation. The disambiguation strategy uses factors representing syntactic, semantic, and conceptual constraints with different weights to choose the most adequate antecedent candidate. We show how these factors can be declaratively represented as defaults in BACK. Disambiguation is then achieved by determining the interpretation that yields a qualitatively minimal number of exceptions to the defaults, and can thus be formalized as exception minimization

Electrophysiological differences in older and younger adults’ anaphoric but not cataphoric pronoun processing in the absence of age-related behavioural slowdown

This study reports on an event-related potentials experiment to uncover whether per-millisecond electrophysiological brain activity and analogous behavioural responses are age-sensitive when comprehending anaphoric (referent-first) and cataphoric (pronoun-first) pronouns. Two groups of French speakers were recruited (young n = 18; aged 19–35 and older adults n = 15; aged 57–88) to read sentences where the anaphoric/cataphoric pronouns and their potential referents either matched or mismatched in gender. Our findings indicate that (1) the older adults were not less accurate or slower in their behavioural responses to the mismatches than the younger adults, (2) both anaphoric and cataphoric conditions evoked a central/parietally distributed P600 component with similar timing and amplitude in both the groups. Importantly, mean amplitudes of the P600 effect were modulated by verbal short-term memory span in the older adults but not in the younger adults, (3) nevertheless, the older but not the younger adults displayed an additional anterior negativity emerging on the frontal regions in response to the anaphoric mismatches. These results suggest that pronoun processing is resilient in healthy ageing individuals, but that functional recruitment of additional brain regions, evidenced with the anterior negativity, compensates for increased processing demands in the older adults’ anaphora processing

Beyond gender stereotypes in language comprehension: self sex-role descriptions affect the brain’s potentials associated with agreement processing

We recorded Event-Related Potentials to investigate differences in the use of gender information during the processing of reflexive pronouns. Pronouns either matched the gender provided by role nouns (such as “king” or “engineer”) or did not. We compared two types of gender information, definitional information, which is semantic in nature (a mother is female), or stereotypical (a nurse is likely to be female). When they followed definitional role-nouns, gender-mismatching pronouns elicited a P600 effect reflecting a failure in the agreement process. When instead the gender violation occurred after stereotypical role-nouns the Event Related Potential response was biphasic, being positive in parietal electrodes and negative in anterior left electrodes. The use of a correlational approach showed that those participants with more “feminine” or “expressive” self sex-role descriptions showed a P600 response for stereotype violations, suggesting that they experienced the mismatch as an agreement violation; whereas less “expressive” participants showed an Nref effect, indicating more effort spent in linking the pronouns with the possible, although less likely, counter-stereotypical referent

Structured Access in Sentence Comprehension

This thesis is concerned with the nature of memory access during the construction of long-distance dependencies in online sentence comprehension. In recent years, an intense focus on the computational challenges posed by long-distance dependencies has proven to be illuminating with respect to the characteristics of the architecture of the human sentence processor, suggesting a tight link between general memory access procedures and sentence processing routines (Lewis & Vasishth 2005; Lewis, Vasishth, & Van Dyke 2006; Wagers, Lau & Phillips 2009). The present thesis builds upon this line of research, and its primary aim is to motivate and defend the hypothesis that the parser accesses linguistic memory in an essentially structured fashion for certain long-distance dependencies. In order to make this case, I focus on the processing of reflexive and agreement dependencies, and ask whether or not non-structural information such as morphological features are used to gate memory access during syntactic comprehension. Evidence from eight experiments in a range of methodologies in English and Chinese is brought to bear on this question, providing arguments from interference effects and time-course effects that primarily syntactic information is used to access linguistic memory in the construction of certain long-distance dependencies. The experimental evidence for structured access is compatible with a variety of architectural assumptions about the parser, and I present one implementation of this idea in a parser based on the ACT-R memory architecture. In the context of such a content-addressable model of memory, the claim of structured access is equivalent to the claim that only syntactic cues are used to query memory. I argue that structured access reflects an optimal parsing strategy in the context of a noisy, interference-prone cognitive architecture: abstract structural cues are favored over lexical feature cues for certain structural dependencies in order to minimize memory interference in online processing

Interpretation of Turkish reflexive anaphors: subjecthood vs semantic role

The current study investigates what factors control the interpretation of Turkish third person reflexive anaphors kendi and kendisi. Our results indicate that, in certain contexts, kendi and kendisi behave alike, which is a novel finding. We show that both kendi and kendisi have a slight subject-orientation, and they are sensitive to semantic roles, being perceiver-oriented. Lastly, our results show that word order affects the interpretation of kendi and kendisi, and that they prefer salient preceding DPs. Based on our findings as a whole, we suggest that both kendi and kendisi show some pronominal properties, and we suggest that Kornfilt’s (2001) proposal that kendisi can function as a pronoun might be extended to kendi as well

Incremental Centering and Center Ambiguity

In this paper, we present a model of anaphor resolution within the framework of the centering model. The consideration of an incremental processing mode introduces the need to manage structural ambiguity at the center level. Hence, the centering framework is further refined to account for local and global parsing ambiguities which propagate up to the level of center representations, yielding moderately adapted data structures for the centering algorithm.Comment: 6 pages, uuencoded gzipped PS file (see also Technical Report at: http://www.coling.uni-freiburg.de/public/papers/cogsci96-center.ps.gz