VALICO-UD: Treebanking an Italian Learner Corpus in Universal Dependencies

This article describes an ongoing project for the development of a novel Italian treebank in Universal Dependencies format: VALICO-UD. It consists of texts written by Italian L2 learners of different mother tongues (German, French, Spanish and English) drawn from VALICO, an Italian learner corpus elicited by comic strips. Aiming at building a parallel treebank currently missing for Italian L2, comparable with those exploited in Natural Language Processing tasks, we associated each learner sentence with a target hypothesis (i.e. a corrected version of the learner sentence written by an Italian native speaker), which is in turn annotated in Universal Dependencies. The treebank VALICO-UD is composed of 237 texts written by non-native speakers of Italian (2,234 sentences) and the related target hypotheses, all automatically annotated using UDPipe. A portion of this resource (36 texts corresponding to 398 learner sentences and related target hypotheses)—firstly released on May 2021 in the Universal Dependencies repository—is associated with error annotation and the automatic output is fully manually checked. In this article, we focus especially on the challenges addressed in treebanking a resource composed of learner texts. In addition, we report on a preliminary data exploration that makes use of three quantitative measures for assessing the quality of the data and for better understanding the role that this resource can play in tasks lying at the intersection of Computational Linguistics and learner corpus studies

Stories at work : restorying narratives of new teachers\u27 identity learning in writing studies.

Rhetoric and composition has a long, robust history of studying how we train new writing teachers in our graduate/writing programs; yet we lack in-depth inquiries that foreground how new writing teachers learn. This dissertation traces five graduate students learning how to be and become writing teachers, using narrative as an object and means of analysis to study the tacitly internalized process of newcomer professional identity learning. In this project, I enact narrative as a feminist, interdisciplinary methodology to restory new writing teacher research narratives away from implicit deficit or explicit resistance and toward a more generative focus on newcomers’ motivated learning and complex experiences mediated by understandings of teaching, learning, and education that precede, exceed, and infuse the program training and academic literacy histories that our research has historically privileged. Drawing on research in writing studies, education, sociology, and psychology, this dissertation conducts a narrative inquiry into new writing teachers’ identity learning by analyzing stories of teaching and learning elicited from five new writing teachers during a year-long semi-structured, text-based interview study. Using the interplay of thematic and structural analysis of participants’ 248 stories and artifact analysis of participants’ teaching texts, I practice narrative inquiry as an explicitly feminist methodology to destabilize and interrogate what we think we know about new writing teachers’ identities and understandings of learning (as in Chapter Three), experiences and teaching troubles (as in Chapter Four), and motivated desires for the future (as in Chapter Five). I also rely on interdisciplinary theories of learning and identity to understand new teachers as complex people mediated and motivated over time in ways that academic writing/composition theories alone have not adequately illuminated. Ultimately, I argue that new teacher research in writing studies should employ more complex methodologies for studying new writing teachers’ identities as learned and storied over time; and that listening rhetorically to newcomers’ stories and for learning and meaning-making is one way to interrupt unproductive assumptions about newcomer deficit or resistance and to restory our research, administrative, and teaching practices to authorize and encourage more agentive positions from which newcomers (and we all) can learn to act

Digital books in literary education: a semiotic approach to analysis

http://www.ester.ee/record=b4715970*es

Exploring Storybook Illustrations in Learning Word Meanings

This study explores storybook illustrations in learning word meanings among English learners in a university intensive language program. The impact of children’s literature on the comprehension and vocabulary development of second language children is well-documented. However, the use of the literature with adults still needs to be researched. Therefore, a mixed-method study was designed (1) to investigate whether readers who read an authentic illustrated story differed from those who read the same story without illustrations; and (2) to learn more about the readers’ process of learning words from storybook illustrations. Results suggest that illustrations play an important role in both comprehending the text and learning individual words, however issues related to the accessibility of the text and readers’ ability to use context should also be taken into consideration. The findings support prior research that the benefits of learning from context take time to become robust. The study suggests that illustrated storybooks provide a rich context for adults to infer word meanings and recommends children’s literature as an alternative source of reading in programs serving adult English learners

Exploring Storybook Illustrations in Learning Word Meanings

This study explores storybook illustrations in learning word meanings among English learners in a university intensive language program. The impact of children’s literature on the comprehension and vocabulary development of second language children is well-documented. However, the use of the literature with adults still needs to be researched. Therefore, a mixed-method study was designed (1) to investigate whether readers who read an authentic illustrated story differed from those who read the same story without illustrations; and (2) to learn more about the readers’ process of learning words from storybook illustrations. Results suggest that illustrations play an important role in both comprehending the text and learning individual words, however issues related to the accessibility of the text and readers’ ability to use context should also be taken into consideration. The findings support prior research that the benefits of learning from context take time to become robust. The study suggests that illustrated storybooks provide a rich context for adults to infer word meanings and recommends children’s literature as an alternative source of reading in programs serving adult English learners

Story Time: The Expression of Temporal Events in Narration by L2 Learners of German

The Aspect Hypothesis (AH) and the Discourse Hypothesis (DH) have each been used to explain how learners acquire tense and aspect (TA) in a second language. The AH predicts that learners will be more strongly influenced by a verb’s lexical aspect in their choice of TA markers, while the DH predicts that learners will be more greatly influenced by a verb’s role in a narrative. Recent research has regarded these two theories as complementary rather than competing, finding support for both hypotheses. However, these newer studies have so far primarily considered the theories’ claims for second language learners of English and Romance Languages. The current study expands on these findings, investigating the effects of lexical aspect and narrative function for L1 English students learning L2 German. This L1-L2 pairing is of particular interest due to the dissimilarities between the aspectual systems of the two languages. The study’s participants were enrolled in a fourth semester university German class. Over the course of one semester, they produced 6 written and 6 oral blogs, in which they told stories about themselves in German related to course themes. In addition, each student produced one written and one oral blog in English. The participants also took part in a mid-semester pedagogical intervention. At the end of the semester, approximately half of the students participated in retrospective interviews, in which they were asked about their opinions of the blogging process and the pedagogical intervention. Using a combination of quantitative and qualitative methods of analysis, the study investigated the effects of the intervention, mode of production, lexical aspect, narrative function, and L1 influence on learners’ TA use in their narratives. The results of the quantitative analysis showed that the DH was a more accurate predictor of tense/aspect use for the study’s participants than was the AH. It was also found that learners differentiated between foreground and background more consistently in written narratives than in spoken blogs. In addition, a visual inspection of the data plots indicated that the learners’ use of TA was similar for the English and German data, in terms of both grounding and lexical aspect. Finally, the results showed that the intervention was successful in helping learners associate past tense with foreground events, as well as in helping them to avoid the use of progressive aspect in their German narratives

Specialised Languages and Multimedia. Linguistic and Cross-cultural Issues

none2noThis book collects academic works focusing on scientific and technical discourse and on the ways in which this type of discourse appears in or is shaped by multimedia products. The originality of this book is to be seen in the variety of approaches used and of the specialised languages investigated in relation to multimodal and multimedia genres. Contributions will particularly focus on new multimodal or multimedia forms of specialised discourse (in institutional, academic, technical, scientific, social or popular settings), linguistic features of specialised discourse in multimodal or multimedia genres, the popularisation of specialised knowledge in multimodal or multimedia genres, the impact of multimodality and multimediality on the construction of scientific and technical discourse, the impact of multimodality/multimediality in the practice and teaching of language, the impact of multimodality/multimediality in the practice and teaching of translation, new multimedia modes of knowledge dissemination, the translation/adaptation of scientific discourse in multimedia products. This volume contributes to the theory and practice of multimodal studies and translation, with a specific focus on specialized discourse.Rivista di Classe A - Volume specialeopenManca E., Bianchi F.Manca, E.; Bianchi, F

Gesture and Speech in Interaction - 4th edition (GESPIN 4)

International audienceThe fourth edition of Gesture and Speech in Interaction (GESPIN) was held in Nantes, France. With more than 40 papers, these proceedings show just what a flourishing field of enquiry gesture studies continues to be. The keynote speeches of the conference addressed three different aspects of multimodal interaction:gesture and grammar, gesture acquisition, and gesture and social interaction. In a talk entitled Qualitiesof event construal in speech and gesture: Aspect and tense, Alan Cienki presented an ongoing researchproject on narratives in French, German and Russian, a project that focuses especially on the verbal andgestural expression of grammatical tense and aspect in narratives in the three languages. Jean-MarcColletta's talk, entitled Gesture and Language Development: towards a unified theoretical framework,described the joint acquisition and development of speech and early conventional and representationalgestures. In Grammar, deixis, and multimodality between code-manifestation and code-integration or whyKendon's Continuum should be transformed into a gestural circle, Ellen Fricke proposed a revisitedgrammar of noun phrases that integrates gestures as part of the semiotic and typological codes of individuallanguages. From a pragmatic and cognitive perspective, Judith Holler explored the use ofgaze and hand gestures as means of organizing turns at talk as well as establishing common ground in apresentation entitled On the pragmatics of multi-modal face-to-face communication: Gesture, speech andgaze in the coordination of mental states and social interaction.Among the talks and posters presented at the conference, the vast majority of topics related, quitenaturally, to gesture and speech in interaction - understood both in terms of mapping of units in differentsemiotic modes and of the use of gesture and speech in social interaction. Several presentations explored the effects of impairments(such as diseases or the natural ageing process) on gesture and speech. The communicative relevance ofgesture and speech and audience-design in natural interactions, as well as in more controlled settings liketelevision debates and reports, was another topic addressed during the conference. Some participantsalso presented research on first and second language learning, while others discussed the relationshipbetween gesture and intonation. While most participants presented research on gesture and speech froman observer's perspective, be it in semiotics or pragmatics, some nevertheless focused on another importantaspect: the cognitive processes involved in language production and perception. Last but not least,participants also presented talks and posters on the computational analysis of gestures, whether involvingexternal devices (e.g. mocap, kinect) or concerning the use of specially-designed computer software forthe post-treatment of gestural data. Importantly, new links were made between semiotics and mocap data

The phonetics of speech breathing : pauses, physiology, acoustics, and perception

Speech is made up of a continuous stream of speech sounds that is interrupted by pauses and breathing. As phoneticians are primarily interested in describing the segments of the speech stream, pauses and breathing are often neglected in phonetic studies, even though they are vital for speech. The present work adds to a more detailed view of both pausing and speech breathing with a special focus on the latter and the resulting breath noises, investigating their acoustic, physiological, and perceptual aspects. We present an overview of how a selection of corpora annotate pauses and pause-internal particles, as well as a recording setup that can be used for further studies on speech breathing. For pauses, this work emphasized their optionality and variability under different tempos, as well as the temporal composition of silence and breath noise in breath pauses. For breath noises, we first focused on acoustic and physiological characteristics: We explored alignment between the onsets and offsets of audible breath noises with the start and end of expansion of both rib cage and abdomen. Further, we found similarities between speech breath noises and aspiration phases of /k/, as well as that breath noises may be produced with a more open and slightly more front place of articulation than realizations of schwa. We found positive correlations between acoustic and physiological parameters, suggesting that when speakers inhale faster, the resulting breath noises were more intense and produced more anterior in the mouth. Inspecting the entire spectrum of speech breath noises, we showed relatively flat spectra and several weak peaks. These peaks largely overlapped with resonances reported for inhalations produced with a central vocal tract configuration. We used 3D-printed vocal tract models representing four vowels and four fricatives to simulate in- and exhalations by reversing airflow direction. We found the direction to not have a general effect for all models, but only for those with high-tongue configurations, as opposed to those that were more open. Then, we compared inhalations produced with the schwa-model to human inhalations in an attempt to approach the vocal tract configuration in speech breathing. There were some similarities, however, several complexities of human speech breathing not captured in the models complicated comparisons. In two perception studies, we investigated how much information listeners could auditorily extract from breath noises. First, we tested categorizing different breath noises into six different types, based on airflow direction and airway usage, e.g. oral inhalation. Around two thirds of all answers were correct. Second, we investigated how well breath noises could be used to discriminate between speakers and to extract coarse information on speaker characteristics, such as age (old/young) and sex (female/male). We found that listeners were able to distinguish between two breath noises coming from the same or different speakers in around two thirds of all cases. Hearing one breath noise, classification of sex was successful in around 64%, while for age it was 50%, suggesting that sex was more perceivable than age in breath noises.Deutsche Forschungsgemeinschaft (DFG) – Projektnummer 418659027: "Pause-internal phonetic particles in speech communication