Temporal Inferences in Conversation

Within this article, I explore how coproductions (expansions made by a second speaker upon a previous utterance) and questions regarding prior utterances work to verbalize inferences regarding the temporal information in spoken German conversation. While questions regarding prior utterances and coproductions are traditionally understood to have different communicative functions (signaling understanding/ misunderstanding; turn taking) to coproductions, empirical data shows how these expression types enable the speaker to gradually verbalize different strengths of assumption about details of the previous turn. These two expression types are not a dichotomy, but a continuum

A Personalized System for Conversational Recommendations

Searching for and making decisions about information is becoming increasingly difficult as the amount of information and number of choices increases. Recommendation systems help users find items of interest of a particular type, such as movies or restaurants, but are still somewhat awkward to use. Our solution is to take advantage of the complementary strengths of personalized recommendation systems and dialogue systems, creating personalized aides. We present a system -- the Adaptive Place Advisor -- that treats item selection as an interactive, conversational process, with the program inquiring about item attributes and the user responding. Individual, long-term user preferences are unobtrusively obtained in the course of normal recommendation dialogues and used to direct future conversations with the same user. We present a novel user model that influences both item search and the questions asked during a conversation. We demonstrate the effectiveness of our system in significantly reducing the time and number of interactions required to find a satisfactory item, as compared to a control group of users interacting with a non-adaptive version of the system

Efficacy of Attentive Reading with Constrained Summarization-Written treatment in people with mild aphasia

Purpose: The purpose of this study was to evaluate the efficacy of a newly adapted treatment, Attentive Reading with Constrained Summarization-Written, to improve microlinguistic and macrolinguistic aspects of written and spoken discourse of people with mild aphasia. Background: Attentive Reading with Constrained Summarization-Written takes a top-down approach to language rehabilitation that focuses on the cognitive-linguistic processes required for spoken and written discourse production. Methods: Five people with mild aphasia received Attentive Reading with Constrained Summarization-Written across two single subject experimentally controlled pre-post treatment design studies. Results: All participants demonstrated improvement in both written and spoken discourse generalization measures. Improvement in functional communication, and confrontation naming was also observed for some participants. Conclusions: The results reported in these two studies provide preliminary evidence that Attentive Reading with Constrained Summarization-Written is a viable treatment option to improve both written and spoken discourse in people with mild aphasia. Participants demonstrated different pre-treatment profiles and mechanisms of improvement, which are discussed

How Do Gestures Influence Thinking and Speaking? The Gesture-for-Conceptualization Hypothesis.

Peer reviewedPostprin

Identification and correction of speech repairs in the context of an automatic speech recognition system

Recent advances in automatic speech recognition systems for read (dictated) speech have led researchers to confront the problem of recognising more spontaneous speech. A number of problems, such as disfluencies, appear when read speech is replaced with spontaneous speech. In this work we deal specifically with what we class as speech-repairs. Most disfluency processes deal with speech-repairs at the sentence level. This is too late in the process of speech understanding. Speech recognition systems have problems recognising speech containing speech-repairs. The approach taken in this work is to deal with speech-repairs during the recognition process. Through an analysis of spontaneous speech the grammatical structure of speech- repairs was identified as a possible source of information. It is this grammatical structure, along with some pattern matching to eliminate false positives, that is used in the approach taken in this work. These repair structures are identified within a word lattice and when found result in a SKIP being added to the lattice to allow the reparandum of the repair to be ignored during the hypothesis generation process. Word fragment information is included using a sub-word pattern matching process and cue phrases are also identified within the lattice and used in the repair detection process. These simple, yet effective, techniques have proved very successful in identifying and correcting speech-repairs in a number of evaluations performed on a speech recognition system incorporating the repair procedure. On an un-seen spontaneous lecture taken from the Durham corpus, using a dictionary of 2,275 words and phoneme corruption of 15%, the system achieved a correction recall rate of 72% and a correction precision rate of 75%.The achievements of the project include the automatic detection and correction of speech-repairs, including word fragments and cue phrases, in the sub-section of an automatic speech recognition system processing spontaneous speech

An integrated theory of language production and comprehension

Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation (such as semantics, syntax, and phonology). We show (a) how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, (b) how they interweave production and comprehension processes, and (c) how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal