Semi-automatic annotation of eye-tracking recordings in terms of human torso, face and hands

status: publishe

Gazing at the partner in musical trios: a mobile eye-tracking study

Few investigations into the nonverbal communication in ensemble playing have focused on gaze behaviour up to now. In this study, the gaze behaviour of musicians playing in trios was recorded using the recently developed technique of mobile eye-tracking. Four trios (clarinet, violin, piano) were recorded while rehearsing and while playing several runs through the same musical fragment. The current article reports on an initial exploration of the data in which we describe how often gazing at the partner occurred. On the one hand, we aim to identify possible contrasting cases. On the other, we look for tendencies across the run-throughs. We discuss the quantified gaze behaviour in relation to the existing literature and the current research design

« Ce n’est pas très beau ce que vous avez dit ! » The activation of resonance in French parliamentary debates

Speakers who engage in the joint activity of a conversation tend to align their utterances with those of their interlocutors by reusing, reinterpreting, hence playing with co-present linguistic material. One dimension of alignment is the activation of resonance, as recently developed within the model of ‘dialogic syntax’ (Du Bois, 2001). When speakers establish cross-turn parallelisms in the form of structural mapping relations, they engage with the form of other speakers’ utterances and activate resonance. The present paper focuses on resonance activation in one particular discourse genre: dialogic sequences evolving around interruptive comments in French parliamentary debates. In line with recent observations within the cognitive-functional context of dialogic syntax (Du Bois, 2001; Sakita, 2006; Zima et al, submitted) and psycholinguistic research on interactive alignment (Pickering & Garrod, 2004, 2006), we demonstrate that resonance can be activated both through explicit repetition of linguistic form and implicit echoing of semantic-pragmatic meaning. With regard to the specific discourse genre of parliamentary debates, we argue that parallelisms at all levels of linguistic organization are witti(ng)ly exploited to serve dissociative pragmatic purposes whereby socio-political positions and power relations are negotiated.      Les locuteurs engagés dans la coordination de l’interaction ont tendance à aligner leurs énoncés en (ré)utilisant ou en réinterprétant ludiquement les matériaux linguistiques introduits par leurs interlocuteurs. Une dimension de l’alignement concerne l’activation de la résonance, concept développé récemment en ‘syntaxe dialogique’ (Du Bois, 2001). Le concept en question réfère à l’effet évoqué entre tours alternatifs par l’établissement de parallélismes sous forme de relations de projection structurelles dans un setting dialogique. La présente contribution se concentre sur la résonance dans un genre discursif particulier: les séquences dialogiques comprenant des les commentaires interruptifs dans les débats parlementaires français. Conformément aux observations récentes dans le contexte cognitivo-fonctionnel de la syntaxe dialogique (Du Bois, 2001; Sakita, 2006; Zima et al., sous presse) et à la recherche psycholinguistique sur l’alignement interactif (Pickering & Garrod, 2004, 2006), nous démontrons que les relations structurelles entre éléments comparables peuvent s’établir et interagir au niveau de la syntaxe, du lexique, de la morphologie, comme sur le plan de la prosodie. Nous montrons en outre que les effets de résonance ne sont pas limités aux parallélismes formels mais sont potentiellement activés par la répétition implicite de segments aux niveaux sémantique ou pragmatique. En ce qui concerne le genre spécifique du débat parlementaire, nous avancerons l’idée que les parallélismes à tous les niveaux d’organisation sont finement exploités en vue d’une série d’objectifs pragmatiques par lesquels sont négociées positions politiques et relations de pouvoir

Multimodal stance-taking in interaction—A systematic literature review

Stance-taking, the public act of positioning oneself toward objects, people or states of affairs, has been studied in many fields of research. Recently, its multimodal realization in interaction has received increasing attention. The current contribution aims to take stock of research on multimodal stance-taking so far, and to present possible avenues for future research. We systematically gathered and appraised 76 articles that investigate the involvement of bodily-visual resources in stance-taking in interaction. The critical appraisal focused on two dimensions of the stance act: form-function relations constituting it, and its dynamic organization in interaction. Regarding form-function relations, we found systematic involvement of specific bodily-visual resources in different stance acts, as well as patterns of multimodal intensification and mitigation of stances. As for its dynamic organization, the review discusses how stance-taking is organized temporally throughout an interaction, with all participants involved carefully negotiating and adapting their stances to one another. Finally, attention is paid to the broader context of stance-taking, including its role in different social and societal contexts. Based on this review, we were able to identify several gaps in the literature, and avenues for future research. We argue that much potential for broadening the scope of research lies in increasing the methodological diversity in approaching multimodal stance-taking, as well as in cross-linguistic studies and varying settings and participant constellations. In conclusion, research into multimodal stance-taking is vibrant, with ample opportunities for future work. This review can be considered as a call to action to move beyond the premise that stance-taking is multimodal, and further investigate this intriguing and fundamental human capacity