Coping with the Challenges of Delivering Multiple Sensorial Media

© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Federal Institute of Es-pirito Santo and CAPES; European Unions Horizon 2020 Research and Innovation programme

Do I smell coffee? The tale of a 360º Mulsemedia experience

One of the main challenges in current multimedia networking environments is to find solutions to help accommodate the next generation of mobile application classes with stringent Quality of Service (QoS) requirements whilst enabling Quality of Experience (QoE) provisioning for users. One such application class, featured in this paper, is 360º mulsemedia—multiple sensorial media—which enriches 360º video by adding sensory effects that stimulate human senses beyond those of sight and hearing, such as the tactile and olfactory ones. In this paper, we present a conceptual framework for 360º mulsemedia delivery and a 360º mulsemedia-based prototype that enables users to experience 360º mulsemedia content. User evaluations revealed that higher video resolutions do not necessarily lead to the highest QoE levels in our experimental setup. Therefore, bandwidth savings can be leveraged with no detrimental impact on QoE

South American Expert Roundtable : increasing adaptive governance capacity for coping with unintended side effects of digital transformation

This paper presents the main messages of a South American expert roundtable (ERT) on the unintended side effects (unseens) of digital transformation. The input of the ERT comprised 39 propositions from 20 experts representing 11 different perspectives. The two-day ERT discussed the main drivers and challenges as well as vulnerabilities or unseens and provided suggestions for: (i) the mechanisms underlying major unseens; (ii) understanding possible ways in which rebound effects of digital transformation may become the subject of overarching research in three main categories of impact: development factors, society, and individuals; and (iii) a set of potential action domains for transdisciplinary follow-up processes, including a case study in Brazil. A content analysis of the propositions and related mechanisms provided insights in the genesis of unseens by identifying 15 interrelated causal mechanisms related to critical issues/concerns. Additionally, a cluster analysis (CLA) was applied to structure the challenges and critical developments in South America. The discussion elaborated the genesis, dynamics, and impacts of (groups of) unseens such as the digital divide (that affects most countries that are not included in the development of digital business, management, production, etc. tools) or the challenge of restructuring small- and medium-sized enterprises (whose service is digitally substituted by digital devices). We identify specific issues and effects (for most South American countries) such as lack of governmental structure, challenging geographical structures (e.g., inclusion in high-performance transmission power), or the digital readiness of (wide parts) of society. One scientific contribution of the paper is related to the presented methodology that provides insights into the phenomena, the causal chains underlying “wanted/positive” and “unwanted/negative” effects, and the processes and mechanisms of societal changes caused by digitalization

Integration of multi-sensorial effects in synchronised immersive hybrid TV scenarios

[EN] Traditionally, TV media content has exclusively involved 2D or 3D audiovisual streams consumed by using a simple TV device. However, in order to generate more immersive media consumption experiences, other new types of content (e.g., omnidirectional video), consumption devices (e.g., Head Mounted Displays or HMD) and solutions to stimulate other senses beyond the traditional ones of sight and hearing, can be used. Multi-sensorial media content (a.k.a. mulsemedia) facilitates additional sensory effects that stimulate other senses during the media consumption, with the aim of providing the consumers with a more immersive and realistic experience. They provide the users with a greater degree of realism and immersion, but can also provide greater social integration (e.g., people with AV deficiencies or attention span problems) and even contribute to creating better educational programs (e.g., for learning through the senses in educational content or scientific divulgation). Examples of sensory effects that can be used are olfactory effects (scents), tactile effects (e.g., vibration, wind or pressure effects), and ambient effects (e.g., temperature or lighting). In this paper, a solution for providing multi-sensorial and immersive hybrid (broadcast/broadband) TV content consumption experiences, including omnidirectional video and sensory effects, is presented. It has been designed, implemented, and subjectively evaluated (by 32 participants) in an end-to-end platform for hybrid content generation, delivery and synchronised consumption. The satisfactory results which were obtained regarding the perception of fine synchronisation between sensory effects and multimedia content, and regarding the users' perceived QoE, are summarised and discussed.This work was supported in part by the "Vicerrectorado de Investigacion de la Universitat Politecnica de Valencia'' under Project PAID-11-21 and Project PAID-12-21.Marfil, D.; Boronat, F.; González-Salinas, J.; Sapena Piera, A. (2022). Integration of multi-sensorial effects in synchronised immersive hybrid TV scenarios. IEEE Access. 10:79071-79089. https://doi.org/10.1109/ACCESS.2022.319417079071790891

The existence of Roma in youth justice discourses

Critical scholars have repeatedly emphasised the importance of how various categories become constructed. This paper discusses the ‘existence’ of ‘the other’ in youth justice discourses. Drawing on qualitative analysis of police, prosecution, youth court and social services discourses, this paper discusses the positioning of migrant youths, referred to youth court on suspicion of having committed an offence. The talk particularly focuses on Czech and Slovak Roma in two legal departments in Belgium. I discuss in what types of cases and discourses the case of Roma (i.e. references to ethnicity and popular images of the ‘Roma culture’) exists and in what instances it seizes to exist. Particular attention is directed to the constitutions, circularity and contexts of ethnicising discourses throughout youth justice trajectories, as well as their performative nature

Technology Enhanced Mulsemedia Learning (TEML) for Learners with Dyslexia

Mulsemedia-multiple sensorial media- includes both traditional multimedia and human sensorial effects, which gives immersive real-world experience. The booming of new technology and wearable devices creates a new avenue for Mulsemedia research in education and has brought new opportunities for Technology Enhanced Mulsemedia Learning (TEML). Traditional methods focus on unisensory experiences, even though the surrounding environment is multisensory. Moreover, this type of learning helps to stimulate various sensory channels to reinforce the learning process, which can also more benefit individuals with a variety of learning disabilities particularly dyslexia which affects a person's ability to read. Moreover, TEML helps to obtain 21st-century learning skills such as cognitive, productivity, social-cultural, metacognitive, and technological dimensions. This paper proposes TEML for learners with dyslexia, for that, this study focuses on an approach for identifying methods for dyslexia, a method for designing Mulsemedia devices using IoT technology, and an evaluation method for performing quality of experience (QoS) using questionnaire, and physiological signals such as GSR (Galvanic Skin Responses), and EEG (Electroencephalography). Those methods help to analyze the learner's emotional responses while experiencing Mulsemedia content.This work is supported by the Centre for Machine Learning and Intelligence (CMLI) funded by the Department of Science and Technology (DST-CURIE)

360° Mulsemedia: A Way to Improve Subjective QoE in 360° Videos

Previous research has shown that adding multisensory media-mulsemedia-to traditional audiovisual content has a positive effect on user Quality of Experience (QoE). However, the QoE impact of employing mulsemedia in 360° videos has remained unexplored. Accordingly, in this paper, a QoE study for watching a 360° video-with and without multisensory effects-in a full free-viewpoint VR setting is presented. The parametric space we considered to influence the QoE consists of the encoding quality and the motion level of the transmitted media. To achieve our research aim, we propose a wearable VR system that provides multisensory enhancement of 360° videos. Then, we utilise its capabilities to systematically evaluate the effects of multisensory stimulation on perceived quality degradation for videos with different motion levels and encoding qualities. Our results make a strong case for the inclusion of multisensory effects in 360° videos, as they reveal that both user-perceived quality, as well as enjoyment, are significantly higher when mulsemedia (as opposed to traditional multimedia) is employed in this context. Moreover, these observations hold true independent of the underlying 360° video encoding quality-thus QoE can be significantly enhanced with a minimal impact on networking resources

Retracing my steps:Taking an autoethnographic journey down the online interprofessional learning pathway

This work builds on a sustained and coherent research corpus which has been developed over the last twenty years, commencing in 2002. During this period, the focus of my research has been interprofessional learning (IPL) characterised by the interactions that occur between students of different professional groups (Barr, et al. 2005). This has been explored both in university and practice settings, and has included substantial team awards of £1,000,000 (2002-2005) and £5,000,000 (2005-2010). In the first decade (2002 onwards), I undertook extensive primary research thoroughly immersed in the field (Bluteau & Jackson, 2005; Jackson & Bluteau, 2007; Bluteau & Krumins, 2008; Bluteau & Jackson, 2009a; Jackson & Bluteau, 2009a; 2009b). The second decade (2012-present) has enriched, deepened and consolidated my role as a leader within this arena, and has produced a second wave of publications which form the basis of this critical overview and portfolio. My portfolio of research is highly original, with models and theory drawn from outside the studied domain (Bronfenbrenner (1979; 1986; 1995); Garrison & Archer (2000); Garrison, Anderson & Archer (2000); Mausse, 1954; Rogers (1951; 1957; 1974; 1980; 1983; Winnicott, 1971). These innovative articles have brought fresh insights into the studied context, redefining the concerns and challenges regarding the creation and implementation of sustainable online IPL. The portfolio has been explored by employing an autoethnographic approach, characterised by self–reflecting upon my personal journey and critically analysing how this experience has led me to understand the culture and influence of online IPL. This has illustrated the coherence of my work by retracing my steps through my journey as a leader in the field, and as a research apprentice, to re-examine the ‘golden thread’ of online IPL