A contextual analysis of referring gestures

Colloque avec actes et comité de lecture.International audienceMultimodal interfaces offer to users different ways to express their intentions using the most appropriate means. For instance, to refer to the object involved in the mentioned action, the difficulty of naming decides of the modality (speech or/and gesture) used to access the referents as shown by De Angeli. However analysis of referring gestures remains based on simple principles which constraint users' gestural expression to unnatural production rules. Our experimental study has shown that the variability of natural gestures is governed by the visual context. In this article, we present a contextual modelling of the analysis of spontaneous referring gestures used in multimodal interfaces. So it becomes possible to cope with the designations' diversity and offer a wider freedom of expression for the user

Detecting Emotional Involvement in Professional News Reporters: An Analysis of Speech and Gestures

This study is aimed to investigate the extent to which reporters\u2019 voice and body behaviour may betray different degrees of emotional involvement when reporting on emergency situations. The hypothesis is that emotional involvement is associated with an increase in body movements and pitch and intensity variation. The object of investigation is a corpus of 21 10-second videos of Italian news reports on flooding taken from Italian nation-wide TV channels. The gestures and body movements of the reporters were first inspected visually. Then, measures of the reporters\u2019 pitch and intensity variations were calculated and related with the reporters' gestures. The effects of the variability in the reporters' voice and gestures were tested with an evaluation test. The results show that the reporters vary greatly in the extent to which they move their hands and body in their reportings. Two gestures seem to characterise reporters\u2019 communication of emergencies: beats and deictics. The reporters\u2019 use of gestures partially parallels the reporters\u2019 variations in pitch and intensity. The evaluation study shows that increased gesturing is associated with greater emotional involvement and less professionalism. The data was used to create an ontology of gestures for the communication of emergenc

Generation of multi-modal dialogue for a net environment

In this paper an architecture and special purpose markup language for simulated affective face-to-face communication is presented. In systems based on this architecture, users will be able to watch embodied conversational agents interact with each other in virtual locations on the internet. The markup language, or Rich Representation Language (RRL), has been designed to provide an integrated representation of speech, gesture, posture and facial animation

On the Development of Early Algebraic Thinking

This article deals with the question of the development of algebraic thinking in young students. In contrast to mental approaches to cognition, we argue that thinking is made up of material and ideational components such as (inner and outer) speech, forms of sensuous imagination, gestures, tactility, and actual actions with signs and cultural artifacts. Drawing on data from a longitudinal classroom-based research program where 8-year old students were followed as they moved from Grade 2 to Grade 3 to Grade 4, our developmental research question is investigated in terms of the manner in which new relationships between embodiment, perception, and symbol-use emerge and evolve as students engage in patterning activities

A Pragmatic Study of Female and Male Discourse Use on Facebook

La comunicación virtual es un campo de estudio muy interesante e innovador que analiza las distintas estrategias comunicativas empleadas en este tipo de discurso que difieren de las empleadas en la comunicación verbal. Este trabajo empieza revisando investigaciones precedentes en este tema para posteriormente analizar, desde un punto de vista pragmático, las diferencias del uso del discurso femenino y masculino en Facebook, sin caer en una perspectiva sexista. El problema principal en este estudio ha sido intentar establecer dicha comparación. Para poder acometer este estudio, recurrimos primero al análisis descriptivo de un corpus creado con discursos reales sacados de la propia red social, para elaborar un cuestionario Likert de 5 puntos, y poder realizar así un estudio experimental que nos permitiera probar si los marcadores textuales utilizados por hombres y mujeres difieren en sus respectivos discursos. Los resultados revelaron una diferencia estadísticamente significativa entre ambos tipos de discursos al comunicarse en Facebook. Sin embargo, también obtuvimos algunos resultados inesperados en relación al uso de los marcadores discursivos utilizados por el grupo de mujeres jóvenes que eran muy parecidos a los utilizados por los hombres en ambas condiciones, tanto en los jóvenes como en los adultos. Por esta razón, la conclusión es que existen rasgos distintivos en los usos discursivos femeninos y masculinos, aunque en el caso de las mujeres jóvenes su discurso parece estar cambiando, puesto que se asemeja cada vez más al discurso masculino. No obstante, sería necesario llevar a cabo una investigación sobre el cambio discursivo de las mujeres jóvenes para tratar de establecer sus causas.Virtual communication is an interesting and innovative field study which analyses the communicative strategies used in this type of discourse, different from the ones used in face-to-face communication. This work first reviews some previous research on the topic to then analyse from a pragmatic perspective the differences between female and male discoursre uses on Facebook, without succumbing to a sexist perspective. To carry out this analysis, we resorted to a corpus made with real conversations from Facebook to elaborate a 5-pint Likert scale, and so conduct an experimental survey to test whether women and men actually use different discourse markers in their respective discourses. The results revealed that there was a statistically significant distinction in the female and male discourse use when communicating on Facebook. However, some unexpected results were also obtained regarding the discourse markers used by women in the female young adult group condition, which were very similar to those used by men in both the young adult and adult condition. Hence, the conclusion is that there are distinctive features of both female and male discourse use that allow us to identify the two different gender identities, though young women’s discourse use seems to be changing and increasingly resembling to the male discourse. Further research is needed to shed some more light on the change of discourse use found in young women to try to determine its causes.31 páginas y anex

Making the music dance : dance connotations in Norwegian fiddling

Publisher PD

Key Components of Musical Discourse Analysis

Musical discourse analysis is an interdisciplinary study which is incomplete without consideration of relevant social, linguistic, psychological, visual, gestural, ritual, technical, historical and musicological aspects. In the framework of Critical Discourse Analysis, musical discourse can be interpreted as social practice: it refers to specific means of representing specific aspects of the social (musical) sphere. The article introduces a general view of contemporary musical discourse, and analyses genres from the point of ‘semiosis’, ‘social agents’, ‘social relations’, ‘social context’, and ‘text’. These components of musical discourse analysis, in their various aspects and combinations, should help thoroughly examine the context of contemporary musical art, and determine linguistic features specific to different genres of musical discourse

Layers of generality and types of generalization in pattern activities

Pattern generalization is considered one of the prominent routes for in-troducing students to algebra. However, not all generalizations are al-gebraic. In the use of pattern generalization as a route to algebra, we —teachers and educators— thus have to remain vigilant in order not to confound algebraic generalizations with other forms of dealing with the general. But how to distinguish between algebraic and non-algebraic generalizations? On epistemological and semiotic grounds, in this arti-cle I suggest a characterization of algebraic generalizations. This char-acterization helps to bring about a typology of algebraic and arithmetic generalizations. The typology is illustrated with classroom examples