Integration of Multisensorial Stimuli and Multimodal Interaction in a Hybrid 3DTV System

This article proposes the integration of multisensorial stimuli and multimodal interaction components into a sports multimedia asset under two dimensions: immersion and interaction. The first dimension comprises a binaural audio system and a set of sensory effects synchronized with the audiovisual content, whereas the second explores interaction through the insertion of interactive 3D objects into the main screen and on-demand presentation of additional information in a second touchscreen. We present an end-to-end solution integrating these components into a hybrid (internet-broadcast) television system using current 3DTV standards. Results from an experimental study analyzing the perceived quality of these stimuli and their influence on the Quality of Experience are presented

Design and Comparison of Immersive Interactive Learning and Instructional Techniques for 3D Virtual Laboratories

This work presents the design, development, and testing of 3D virtual laboratories for practice, specifically in undergraduate mechanical engineering laboratories. The 3D virtual laboratories, implemented under two virtual environments3DTV and Computer Automated Virtual Environment (CAVE)serve as pre-lab sessions performed before the actual physical laboratory experiment. The current study compares the influence of two instructional methods (conventional lecture-based and inquiry-based) under two virtual environments, and the results are compared with the pre-lab sessions using a traditional paper-based lab manual. Subsequently, the evaluation is done by conducting performance and quantitative assessments from students pre-and post-laboratory performances. The research results demonstrate that students in the virtual modules (3DTV and CAVE) performed significantly better in the actual physical experiment than the students in the control group in terms of the overall experiment familiarity and procedure and the conceptual knowledge associated with the experiment. 2015 by the Massachusetts Institute of Technology

Familiars: representing Facebook users’ social behaviour through a reflective playful experience

In this paper, we describe the design and development of a social game called Familiars. Inspired by the daemons in Pullman’s “Dark Material” trilogy, Familiars are animal companions that sit on your Facebook profile and change into different animal forms based on your social activity within the social network of Facebook. . Familiars takes advantage of the powerful capabilities of the developers platform of Facebook to build a multi-dimensional picture of a player’s state based on social activity, facial expression analysis on photographs and suggestions from friends. This rich information is then distilled and presented to the player in the form of animal that the familiar chooses to take. We show how the types of animals and personalities were associated in a cross-cultural user study, and present quantitative results from the social behaviours of the players within the game in addition to qualitative data gathered from questionnaire responses

Life-Sized Audiovisual Spatial Social Scenes with Multiple Characters: MARC & SMART-I²

International audienceWith the increasing use of virtual characters in virtual and mixed reality settings, the coordination of realism in audiovisual rendering and expressive virtual characters becomes a key issue. In this paper we introduce a new system combining two systems for tackling the issue of realism and high quality in audiovisual rendering and life-sized expressive characters. The goal of the resulting SMART-MARC platform is to investigate the impact of realism on multiple levels: spatial audiovisual rendering of a scene, appearance and expressive behaviors of virtual characters. Potential interactive applications include mediated communication in virtual worlds, therapy, game, arts and elearning. Future experimental studies will focus on 3D audio/visual coherence, social perception and ecologically valid interaction scenes

The Influence of Mixed Reality on Satisfaction and Brand Loyalty in Cultural Heritage Attractions: A Brand Equity Perspective

Mixed reality technology is being increasingly used in cultural heritage attractions to enhance visitors’ experience. However, how the characteristics of mixed reality affect satisfaction and brand loyalty has not been explored in previous research. The purpose of this study is to identify factors affecting satisfaction with mixed reality experiences at cultural and artistic visitor attractions and their influence on brand loyalty, which is connected with management performance. We propose a theoretical model based on brand equity theory in the context of mixed reality experience. Survey data were gathered from 251 respondents visiting a cultural and artistic visitor attraction in Seoul, Korea using a stratified sampling method. PLS-SEM was employed for the data analysis. The results suggest that the characteristics of mixed reality (interactivity, vividness) not only influence the affective aspects (perceived immersion, perceived enjoyment) of visitors’ experience, but also positively affect brand awareness, brand association, and brand loyalty

Realism and Experiments: Investigating Virtual Reality Experiments

Experimental research is a fundamental component of scientific inquiry, but the realism of experimental settings may be limited due to a trade-off between internal and external validity. Virtual Reality technology offers a potential solution to this problem by creating highly controlled, yet realistic experimental settings. In this study, we investigate the potential of VR to increase perceived realism in experimental research by identifying and examining the effects of VR experiments on participants\u27 perceived realism. In our experiment, we compare the level of perceived realism between artificial scenarios presented as text vignettes and in VR. Our findings indicate that VR experiments elicite a significantly higher level of perceived realism compared to text-based experiments. Additionally, we use partial least squares structural equation modeling to investigate the identified concepts. We recommend that researchers consider using VR technology to enhance the realism of experimental settings and improve the validity of their findings

The crowd as a cameraman : on-stage display of crowdsourced mobile video at large-scale events

Recording videos with smartphones at large-scale events such as concerts and festivals is very common nowadays. These videos register the atmosphere of the event as it is experienced by the crowd and offer a perspective that is hard to capture by the professional cameras installed throughout the venue. In this article, we present a framework to collect videos from smartphones in the public and blend these into a mosaic that can be readily mixed with professional camera footage and shown on displays during the event. The video upload is prioritized by matching requests of the event director with video metadata, while taking into account the available wireless network capacity. The proposed framework's main novelty is its scalability, supporting the real-time transmission, processing and display of videos recorded by hundreds of simultaneous users in ultra-dense Wi-Fi environments, as well as its proven integration in commercial production environments. The framework has been extensively validated in a controlled lab setting with up to 1 000 clients as well as in a field trial where 1 183 videos were collected from 135 participants recruited from an audience of 8 050 people. 90 % of those videos were uploaded within 6.8 minutes