Audio subtitling : dubbing and voice-over effects and their impact on user experience

This article reports the outcome of an experiment in which 42 Spanish blind and partially sighted participants were exposed to two diverging audio subtitling strategies: audio subtitles with a voice-over effect and audio subtitles with a dubbing effect. Data on the users' emotional responses were collected through a tactile and simplified version of the SAM questionnaire and psychophysiological recordings of electrodermal activity and heart rate. The results obtained from both methods do not show statistically significant differences between the two effects. However, results from the questionnaire proved that emotions were induced in the participants calling for more research on the topic and with the application of such methods

Audio subtitling and subtitling : a comparison of their emotional effect on blind / partially sighted and sighted users

Audio subtitling (AST) is a media accessibility service that allows for people who are blind, partially sighted or with any reading disability to access written subtitles in their aural form. Despite the existing literature on other media accessibility services such as audio description, the way written subtitles compare to orally delivered subtitles has not been researched. In this study, a group of 42 blind and partially sighted participants and a group of 42 sighted participants watched the same three video clips. Two of them pictured two emotions (sadness and fear) and the third was emotionally neutral. The clips were prepared with subtitles or audio subtitles, according to the target participants. The emotional effect of the clips was measured in two ways: with self-reports, by completing after each clip the SAM questionnaire (Bradley & Lang, 1994); and with psychophysiological measures: electrodermal activity (EDA) and heart rate (HR), that were recorded while participants watched each clip. The analyses of the data obtained in both experiments indicate that self-report measures revealed similar experiences for both blind and sighted participants, differentiating between valence (negative for fear and sadness, but not for neutral) and arousal (deemed higher for fear than for sadness and neutral). Data from EDA and HR measures are less conclusive

Psychophysiology-based QoE assessment : a survey

We present a survey of psychophysiology-based assessment for quality of experience (QoE) in advanced multimedia technologies. We provide a classification of methods relevant to QoE and describe related psychological processes, experimental design considerations, and signal analysis techniques. We summarize multimodal techniques and discuss several important aspects of psychophysiology-based QoE assessment, including the synergies with psychophysical assessment and the need for standardized experimental design. This survey is not considered to be exhaustive but serves as a guideline for those interested to further explore this emerging field of research

What does not happen: quantifying embodied engagement using NIMI and self-adaptors

Previous research into the quantification of embodied intellectual and emotional engagement using non-verbal movement parameters has not yielded consistent results across different studies. Our research introduces NIMI (Non-Instrumental Movement Inhibition) as an alternative parameter. We propose that the absence of certain types of possible movements can be a more holistic proxy for cognitive engagement with media (in seated persons) than searching for the presence of other movements. Rather than analyzing total movement as an indicator of engagement, our research team distinguishes between instrumental movements (i.e. physical movement serving a direct purpose in the given situation) and non-instrumental movements, and investigates them in the context of the narrative rhythm of the stimulus. We demonstrate that NIMI occurs by showing viewers’ movement levels entrained (i.e. synchronised) to the repeating narrative rhythm of a timed computer-presented quiz. Finally, we discuss the role of objective metrics of engagement in future context-aware analysis of human behaviour in audience research, interactive media and responsive system and interface design

Alcuni abstract di articoli che trattano argomenti relativi all'eHealth

Non utile per esam

Mesure de la perception de la qualité audiovisuelle par analyse conjointe de signaux physiologiques

National audienceL'influence de la qualité audiovisuelle (AV) sur l'utilisateur a été étudiée à partir de l'analyse de mesures physiologiques complétant les mesures subjectives habituellement utilisées. Le présent papier propose une méthode d'analyse de ces signaux basée sur l'extraction d'indicateurs et la définition d'un modèle empirique de détection automatique (par fusion de données hétérogènes) des modifications éventuelles de l'activité physiologique en réaction à la présence de dégradations de qualité et plus globalement, à la présentation de stimuli AV. Abstract - The influence of the video quality (AV) assessment was studied upon the basis of physiological measurements in addition to subjectives measurements usually used. In this paper, we propose new indicators extracted from these signals and an empirical method (with heterogenous data fusion) for automatic detection of physiological reaction due to quality degradation or more generally in response of stimuli

The Notion of Presence in a Telematic Cross-Disciplinary Program for Music, Communication and Technology

open access bookThis chapter examines how students in a two-campus, cross-disciplinary program in Music, Communication and Technology (MCT) experience the sense of presence of peer students and teachers, some physically co-localized while others are present via an audiovisual communications system. The chapter starts by briefly delineating the MCT program, the audiovisual communications system and the learning space built around it, named the Portal, and the research project SALTO which frames the current study. We then review research literature on presence relevant to this particular context and use this as a basis for the design of an online survey using a combination of Likert items and free text response. Our main findings, based on responses from the 16 students who participated in the survey, are that the mediating technologies of the Portal affect the experience of presence negatively, but that formal learning scenarios are less affected than informal scenarios that require social interaction