Acoustic Features of Different Types of Laughter in North Sami Conversational Speech

Peer reviewe

Multimodal Human-Human-Robot Interactions (MHHRI) Dataset for Studying Personality and Engagement

In this paper we introduce a novel dataset, the Multimodal Human-Human-Robot-Interactions (MHHRI) dataset, with the aim of studying personality simultaneously in human-human interactions (HHI) and human-robot interactions (HRI) and its relationship with engagement. Multimodal data was collected during a controlled interaction study where dyadic interactions between two human participants and triadic interactions between two human participants and a robot took place with interactants asking a set of personal questions to each other. Interactions were recorded using two static and two dynamic cameras as well as two biosensors, and meta-data was collected by having participants fill in two types of questionnaires, for assessing their own personality traits and their perceived engagement with their partners (self labels) and for assessing personality traits of the other participants partaking in the study (acquaintance labels). As a proof of concept, we present baseline results for personality and engagement classification. Our results show that (i) trends in personality classification performance remain the same with respect to the self and the acquaintance labels across the HHI and HRI settings; (ii) for extroversion, the acquaintance labels yield better results as compared to the self labels; (iii) in general, multi-modality yields better performance for the classification of personality traits.This work was funded by the EPSRC under its IDEAS Factory Sandpits call on Digital Personhood (Grant Ref: EP/L00416X/1)

Undressing and redressing the harlequin: An Australian designer\u27s perspective

In undressing and redressing the Harlequin from an Australian designer’s perspective, the question is why has the Harlequin costume endured for over 500 years and in locations far away from its country of origin? Why do we associate its lozenge pattern with energetic joyous mischief? What are the Harlequin costume codes and how have they been manifested in Australia? The thesis components are divided as follows: The Designer’s Notebook is a pictorial and historical review of the iconic costume, which is made up of a complex patchwork of triangles where colour placements form a diamond pattern called a lozenge. The Harlequin, a stock character from commedia dell’arte, who emerged in Italy and France during the 1500s, wears the lozenge costume. The notebook traces possible connections and reasons for the emergence of both the costume and the Harlequin figure prior to his catalyzation as a character in commedia dell’arte. Having arrived at the manifestation of Harlequin and his lozenge costume, the focus moves to the forms of expression in which he has participated and the mutations which have occurred in the costume. Harlequin High Jinks Down Under is concerned with the manifestation of both the harlequinesque figure and its associated costume codes in circus and the harlequinades in Australia from the 1850s, when a kind of Australian larrikinism began to develop as the national identity. From this unique environment a century later sprang the satirist, Dame Edna Everage and the social and political comic, Joel Salom, associated with Circus OZ. On the international front, these Australian performers have joined comic book characters in keeping the harlequinesque costume codes alive, but something deeper is happening with the Harlequin and his lozenge attire. For instance, some philosophers have come to accept Harlequin as a visual code for the union of multi-nationalities. The Research additionally explores the enduring contribution of the lozenge code not only through the historical tracing of harlequinesque imagery but also through the designing of a 2 square meter art–piece created at an international residency in Vietnam to reflect the energetic universality of the lozenge form. Here Harlequin’s liminality is explored. Finally two new costume designs have been created for the Australian performers, Everage and Salom, to further the design of the harlequinesque into an imagined future

Evaluation of Speaker Anonymization on Emotional Speech

International audienceSpeech data carries a range of personal information, such as the speaker's identity and emotional state. These attributes can be used for malicious purposes. With the development of virtual assistants, a new generation of privacy threats has emerged. Current studies have addressed the topic of preserving speech privacy. One of them, the VoicePrivacy initiative aims to promote the development of privacy preservation tools for speech technology. The task selected for the VoicePrivacy 2020 Challenge (VPC) is about speaker anonymization. The goal is to hide the source speaker's identity while preserving the linguistic information. The baseline of the VPC makes use of a voice conversion. This paper studies the impact of the speaker anonymization baseline system of the VPC on emotional information present in speech utterances. Evaluation is performed following the VPC rules regarding the attackers' knowledge about the anonymization system. Our results show that the VPC baseline system does not suppress speakers' emotions against informed attackers. When comparing anonymized speech to original speech, the emotion recognition performance is degraded by 15% relative to IEMOCAP data, similar to the degradation observed for automatic speech recognition used to evaluate the preservation of the linguistic information

The challenge of fairy tales : eliciting a critical gendered response in young children

The purpose of this qualitative study was to determine how fairy tale discussions and activities affect children’s responses to literary gendered stereotypes. The children in this investigation were aged between four and six years. Notably, much of the earlier research in this area was carried out over thirty years ago with articulate 7- to 11-year-olds; this study aimed to identify the potential for imaginative transformations in the younger formative group and contribute towards their theoretical and practical knowledge base in the Early Years. A participatory Mosaic approach was adopted to enable the children in small, single-sex and mixed gender groupings, to express their interpretations, experiences and understanding about the story messages as fully and naturally as possible. Information on their family and school cultures was gathered through questionnaires and interviews with parents and teachers in three town state schools and a private Waldorf Steiner kindergarten. The study determined that cultural influences were even stronger and more exaggerated than in the past, with boys using dominant and powerful language, whilst girls used mostly diminishing and understating words. Similar to earlier studies, the children were initially resistant to alternative and subversive gender models; in spite of the stereotypical responses identified, I noted that some children, and boys in particular, were beginning to be receptive to different gendered perspectives following the discussions and activities. This research has shown the urgent need to provide a greater diversity of role models in books at school, and in training and support for adults, particularly fathers, in respect of critical storytelling strategies. But most significantly, this study’s findings have broken new ground in this area and shown that despite cultural pressure to conform to gendered patterns of behaviour, young children can be encouraged to think critically and positively about their own gendered identity and cultural messages

Journal of Communication Pedagogy, Complete Volume 4, 2021

This is the complete volume 4 of the Journal of Communication Pedagogy

Gender and humour; Complexities of women's image politics in Shona humourous narratives

Humour represents an ideal site for understanding how everyday social dynamics influence ideology and the social structure (Sue & Golash-Boza, 2013:4). This research is an examination of how gender is expressed in Shona humour. Particular emphasis is paid to how women are presented in Shona humorous narratives. Though 'what a person does in a jest is usually not accorded the same weight of responsibility as what he does seriously, humour provides a means to test the openness, accessibility, and riskiness of sensitive issues' (Lang & Lee, 2010:47). This study examines how women in particular, are reflected in Shona humour. Humour provides a 'safe' climate for expressing 'system-justifying' beliefs, (Ford et al. 2013), and this study is an exploration of the Shona beliefs about women and the reinforcement of gender norms as expressed in Shona humour. The study derives impetus from the fact that while images of women have been studied in literary and lexicographic works in Shona in particular, aspects of humour and how it presents women remain largely under-studied, as humour studies as a discipline, despite its long history the world over, is still at its infancy in Zimbabwe. From a corpus of jokes that were circulated on the social media, particularly Facebook and WhatsApp, the study examines how women are presented in Shona humour. The research made use of the Superiority Theory of humour, Incongruity and Feminism to argue that Shona humour expresses oppressive and unjust gender relations. While the humorous Shona narratives demonstrate a complex portrayal of women, generally, Shona humour expresses, ratifies and reinforces repressive norms and restrictive stereotypes about women. Women are presented as immoral, malicious and intellectually, socially and emotionally inferior to men. The study therefore argues that humour facilitates the process of promoting gender stereotypes as well as fostering gender discrimination in Shona

Détection de marqueurs affectifs et attentionnels de personnes âgées en interaction avec un robot

This thesis work focuses on audio-visual detection of emotional (laugh and smile) and attentional markers for elderly people in social interaction with a robot. To effectively understand and model the pattern of behavior of very old people in the presence of a robot, relevant data are needed. I participated in the collection of a corpus of elderly people in particular for recording visual data. The system used to control the robot is a Wizard of Oz, several daily conversation scenarios were used to encourage people to interact with the robot. These scenarios were developed as part of the ROMEO2 project with the Approche association. We described at first the corpus collected which contains 27 subjects of 85 years' old on average for a total of 9 hours, annotations and we discussed the results obtained from the analysis of annotations and two questionnaires.My research then focuses on the attention detection and the laughter and smile detection. The motivations for the attention detection are to detect when the subject is not addressing to the robot and adjust the robot's behavior to the situation. After considering the difficulties related to the elderly people and the analytical results obtained by the study of the corpus annotations, we focus on the rotation of the head at the visual index and energy and quality vote for the detection of the speech recipient. The laughter and smile detection can be used to study on the profile of the speaker and her emotions. My interests focus on laughter and smile detection in the visual modality and the fusion of audio-visual information to improve the performance of the automatic system. Spontaneous expressions are different from posed or acted expression in both appearance and timing. Designing a system that works on realistic data of the elderly is even more difficult because of several difficulties to consider such as the lack data for training the statistical model, the influence of the facial texture and the smiling pattern for visual detection, the influence of voice quality for auditory detection, the variety of reaction time, the level of listening comprehension, loss of sight for elderly people, etc. The systems of head-turning detection, attention detection and laughter and smile detection are evaluated on ROMEO2 corpus and partially evaluated (visual detections) on standard corpus Pointing04 and GENKI-4K to compare with the scores of the methods on the state of the art. We also found a negative correlation between laughter and smile detection performance and the number of laughter and smile events for the visual detection system and the audio-visual system. This phenomenon can be explained by the fact that elderly people who are more interested in experimentation laugh more often and therefore perform more various poses. The variety of poses and the lack of corresponding data bring difficulties for the laughter and smile recognition for our statistical systems. The experiments show that the head-turning can be effectively used to detect the loss of the subject's attention in the interaction with the robot. For the attention detection, the potential of a cascade method using both methods in a complementary manner is shown. This method gives better results than the audio system. For the laughter and smile detection, under the same leave-one-out protocol, the fusion of the two monomodal systems significantly improves the performance of the system at the segmental evaluation.Ces travaux de thèse portent sur la détection audio-visuelle de marqueurs affectifs (rire et sourire) et attentionnels de personnes âgées en interaction sociale avec un robot. Pour comprendre efficacement et modéliser le comportement des personnes très âgées en présence d'un robot, des données pertinentes sont nécessaires. J'ai participé à la collection d'un corpus de personnes âgées notamment pour l'enregistrement des données visuelles. Le système utilisé pour contrôler le robot est un magicien d'Oz, plusieurs scénarios de conversation au quotidien ont été utilisés pour encourager les gens à coopérer avec le robot. Ces scénarios ont été élaborés dans le cadre du projet ROMEO2 avec l'association Approche.Nous avons décrit tout d'abord le corpus recueilli qui contient 27 sujets de 85 ans en moyenne pour une durée totale de 9 heures, les annotations et nous avons discuté des résultats obtenus à partir de l'analyse des annotations et de deux questionnaires. Ma recherche se focalise ensuite sur la détection de l'attention et la détection de rire et de sourire. Les motivations pour la détection de l'attention consistent à détecter quand le sujet ne s'adresse pas au robot et à adapter le comportement du robot à la situation. Après avoir considéré les difficultés liées aux personnes âgées et les résultats d'analyse obtenus par l'étude des annotations du corpus, nous nous intéressons à la rotation de la tête au niveau de l'indice visuel et à l'énergie et la qualité de voix pour la détection du destinataire de la parole. La détection de rire et sourire peut être utilisée pour l'étude sur le profil du locuteur et de ses émotions. Mes intérêts se concentrent sur la détection de rire et sourire dans la modalité visuelle et la fusion des informations audio-visuelles afin d'améliorer la performance du système automatique. Les expressions sont différentes des expressions actées ou posés à la fois en apparence et en temps de réaction. La conception d'un système qui marche sur les données réalistes des personnes âgées est encore plus difficile à cause de plusieurs difficultés à envisager telles que le manque de données pour l'entrainement du modèle statistique, l'influence de la texture faciale et de la façon de sourire pour la détection visuelle, l'influence de la qualité vocale pour la détection auditive, la variété du temps de réaction, le niveau de compréhension auditive, la perte de la vue des personnes âgées, etc. Les systèmes de détection de la rotation de la tête, de la détection de l'attention et de la détection de rire et sourire sont évalués sur le corpus ROMEO2 et partiellement évalués (détections visuelles) sur les corpus standard Pointing04 et GENKI-4K pour comparer avec les scores des méthodes de l'état de l'art. Nous avons également trouvé une corrélation négative entre la performance de détection de rire et sourire et le nombre d'évènement de rire et sourire pour le système visuel et le système audio-visuel. Ce phénomène peut être expliqué par le fait que les personnes âgées qui sont plus intéressées par l'expérimentation rient plus souvent et sont plus à l'aise donc avec des poses variées. La variété des poses et le manque de données correspondantes amènent des difficultés pour la reconnaissance de rire et de sourire pour les systèmes statistiques.Les expérimentations montrent que la rotation de la tête peut être efficacement utilisée pour détecter la perte de l'attention du sujet dans l'interaction avec le robot. Au niveau de la détection de l'attention, le potentiel d'une méthode en cascade qui utilise les modalités d'une manière complémentaire est montré. Cette méthode donne de meilleurs résultats que le système auditif seul. Pour la détection de rire et sourire, en suivant le même protocole « Leave-one-out », la fusion des deux systèmes monomodaux améliore aussi significativement la performance par rapport à un système monomodal au niveau de l'évaluation segmentale