An integrated theory of language production and comprehension

Currently, production and comprehension are regarded as quite distinct in accounts of language processing. In rejecting this dichotomy, we instead assert that producing and understanding are interwoven, and that this interweaving is what enables people to predict themselves and each other. We start by noting that production and comprehension are forms of action and action perception. We then consider the evidence for interweaving in action, action perception, and joint action, and explain such evidence in terms of prediction. Specifically, we assume that actors construct forward models of their actions before they execute those actions, and that perceivers of others' actions covertly imitate those actions, then construct forward models of those actions. We use these accounts of action, action perception, and joint action to develop accounts of production, comprehension, and interactive language. Importantly, they incorporate well-defined levels of linguistic representation (such as semantics, syntax, and phonology). We show (a) how speakers and comprehenders use covert imitation and forward modeling to make predictions at these levels of representation, (b) how they interweave production and comprehension processes, and (c) how they use these predictions to monitor the upcoming utterances. We show how these accounts explain a range of behavioral and neuroscientific data on language processing and discuss some of the implications of our proposal

The Processing of Emotional Sentences by Young and Older Adults: A Visual World Eye-movement Study

Carminati MN, Knoeferle P. The Processing of Emotional Sentences by Young and Older Adults: A Visual World Eye-movement Study. Presented at the Architectures and Mechanisms of Language and Processing (AMLaP), Riva del Garda, Italy

The effect of using same language subtitling (SLS) in content comprehension and vocabulary acquisition in Arabic as a foreign language (AFL)

This study investigates the effects of SLS (Same-Language subtitling) on content comprehension and vocabulary acquisition of MSA (Modern Standard Arabic) as L2 at the intermediate level and addresses three research questions: (1) Does SLS enhance or hinder L2 content comprehension when the writing script of L2 is different than that of L1? (2) Does SLS enhance or hinder L2 vocabulary acquisition when the writing script of L2 is different than that of L1? (3) What is students\u27 attitude towards the use of SLS? Twenty seven students of AUC\u27s ALI program with English as L1 were chosen for the study and divided between a control group (without SLS) and a treatment group (with SLS). Instructions concerning the procedure were given in L1 to rule out any false results due to task misinterpretation. Both groups watched an authentic 3:11 minute documentary twice after completing an individual background questionnaire and taking a multiple choice vocabulary pre-viewing test. Post-viewing, participants took the same vocabulary test, then wrote a summary in L1 based on their notes taken during/and in-between the viewings and completed a questionnaire/questions related to their experience with and -/out captions. L1 summaries were analyzed in terms of 23 semantic units related to content comprehension. The degree of vocabulary acquisition was calculated by comparing the responses between the pre- and post-viewing vocabulary multiply choice tests. Results using t-test and one way ANOVA indicate that SLS neither facilitates nor hinders comprehension and vocabulary acquisition. The majority of students enjoyed captions and wanted to continue using them in class. Pedagogical suggestions and future research recommended training with captions and focus on other text- aids, e.g. reverse subtitling at other proficiency levels. Contains 84 references, 17 figures, 5 pictures and 5 tables

Semantic radical consistency and character transparency effects in Chinese: an ERP study

BACKGROUND: This event-related potential (ERP) study aims to investigate the representation and temporal dynamics of Chinese orthography-to-semantics mappings by simultaneously manipulating character transparency and semantic radical consistency. Character components, referred to as radicals, make up the building blocks used dur...postprin

Gesture as a Communication Strategy in Second Language Discourse : A Study of Learners of French and Swedish

Gesture is always mentioned in descriptions of compensatory behaviour in second language discourse, yet it has never been adequately integrated into any theory of Communication Strategies (CSs). This study suggests a method for achieving such an integration. By combining a cognitive theory of speech-associated gestures with a process-oriented framework for CSs, gesture and speech can be seen as reflections of similar underlying processes with different output modes. This approach allows oral and gestural CSs to be classified and analysed within a unified framework. The respective fields are presented in introductory surveys, and a review is provided of studies dealing specifically with compensatory gesture–in aphasia as well as in first and second language acquisition. The experimental part of this work consists of two studies. The production study examines the gestures exploited strategically by Swedish learners of French and French learners of Swedish. The subjects retold a cartoon story in their foreign language to native speakers in conversational narratives. To enable comparisons between learners and proficiency conditions both at individual and group level, subjects performed the task in both their first and their second language. The results show that, contrary to expectations in both fields, strategic gestures do not replace speech, but complement it. Moreover, although strategic gestures are used to solve lexical problems by depicting referential features, most learner gestures instead serve either to maintain visual co-reference at discourse level, or to provide metalinguistic comments on the communicative act itself. These latter functions have hitherto been ignored in CS research. Both similarities and differences can be found between oral and gestural CSs regarding the effect of proficiency, culture, task, and success. The influence of individual communicative style and strategic communicative competence is also discussed. Finally, native listeners’ gestural behaviour is shown to be related to the co-operative effort invested by them to ensure continued interaction, which in turn depends on the proficiency levels of the non-native narrators. The evaluation study investigates native speakers’ assessments of subjects’ gestures, and the effect of gestures on evaluations of proficiency. Native speakers rank all subjects as showing normal or reduced gesture rates and ranges–irrespective of proficiency condition. The influence of gestures on proficiency assessments is modest, but tends to be positive. The results concerning the effectiveness of gestural strategies are inconclusive, however. When exposed to auditory learner data only, listeners believe gestures would improve comprehension, but when learner gestures can be seen, they are not regarded as helpful. This study stresses the need to further examine the effect of strategic behaviour on assessments, and the perception of gestures in interaction. An integrated theory of Communication Strategies has to consider that gestures operate in two ways: as local measures of communicative ‘first-aid’, and as global communication enhancement for speakers and listeners alike. A probabilistic framework is outlined, where variability in performance as well as psycholinguistic and interactional aspects of gesture use are taken into account

The development of conversational and communication skills

This thesis investigates the development of children's conversational and communication skills. This is done by investigating both communicative process and outcome in two communication media: face-to-face interaction and audio-only interaction. Communicative outcome is objectively measured by assessing accuracy of performance of communication tasks. A multi-level approach to the assessment of communicative process is taken. Non-verbal aspects of process which are investigated are gaze and gesture. Verbal aspects of process range from global linguistic assessments such as length of conversational turn, to a detailed coding of utterance function according to Conversational Games analysis. The results show that children of 6 years and less do not adapt to the loss of visual signals in audio-only communication, and their performance suffers. Both the structure of children's dialogues and their use of visual signals were found to differ from that of adults. It is concluded that both verbal and non-verbal communication strategies develop into adulthood. Successful integration of these different aspects of communication is central to being an effective communicator