Virtual Reality Games for Motor Rehabilitation

This paper presents a fuzzy logic based method to track user satisfaction without the need for devices to monitor users physiological conditions. User satisfaction is the key to any product’s acceptance; computer applications and video games provide a unique opportunity to provide a tailored environment for each user to better suit their needs. We have implemented a non-adaptive fuzzy logic model of emotion, based on the emotional component of the Fuzzy Logic Adaptive Model of Emotion (FLAME) proposed by El-Nasr, to estimate player emotion in UnrealTournament 2004. In this paper we describe the implementation of this system and present the results of one of several play tests. Our research contradicts the current literature that suggests physiological measurements are needed. We show that it is possible to use a software only method to estimate user emotion

Exploring virtual reality to improve engineering students' spatial abilities pilot study

A Virtual Reality pilot study is conducted to improve the spatial ability of engineering students based on solid geometry scenarios. The investigation focused on the Graphic Expression and Computer-Aided Design (GECAD) course, specifically on the study of the spatial abilities developed and the assessment of the academic results in the solid geometry module. A total of 20 participants completed three activities (6 h) in an immersive virtual learning environment (IVLE), using head-mounted display (HMD) glasses. Modeling exercises of three-dimensional geometric shapes are proposed, based on concepts of solid geometry. The scenarios are built step by step and the students can regulate the progress between stages while observing the geometric components at the scale and in the point of view they wish. Beyond academic results, the assessment of student improvement is based on spatial abilities tests: the Differential Aptitude Test: Spatial Relations Subset DAT-SR, Purdue Spatial Visualisation Test: Rotations PSVT:R and Mental Cutting Test MCT. Those tests are applied for evaluating different skills: mental folding, mental rotation and section by a plane. In summary, a methodology is proposed developing activities in an (IVLE) with 3D modelling software applied in solid geometry, in order to promote the development of spatial ability (SA). Spatial abilities are measured before and after the classroom activities and looking for correlations between the spatial perception tests (DAT:SR, PSVT:R and MCT) and academic results in solid geometry. In addition, we also wish to determine the students' opinion with regard to the proposed activities. The results obtained confirm the interest in using IVLE to develop spatial abilities in engineering students. Substantial increases of 10,9% in DAT:SR, 8,8 % in PSVT:R and 9,5% in MCT between pre- and post-tests were found. Moreover, the students' opinion of IVLE/HMD activities is positive. The methodology can be summarized in the following steps: 1. Students take the DAT:SR , PSVT:R and MCT prior to the activities. They also answer the survey on other variables that can affect SA (1 h). 2. The students individually complete the exercises with the 3D modelling software SolidWorks (10 h). 3. The IVLE activities consist of the guided reading by the professor of the completed exercise. The professor addresses the concepts of solid geometry used in each step. The students have a few minutes to view with HMD the animation showing the construction of the geometric shape, and once the representation is finished, they can move freely throughout the scenario, using the keyboard options (6 h). 4. Students solve the (DAT:SR, PSVT:R and MCT after the IVLE activities. At the end, the groups answer the satisfaction survey (1 h). 5. All the students are evaluated on their knowledge of the solid geometry contents by means of a test and 3D modelling exercises similar to those done in class and those described in the IVRL (1h). 6. Finally, the analysis of the spatial abilities test data, the controlled variables survey, satisfaction surveys and the academic results obtained in the solid geometry module enable us to examine the correlations and the strongest determining factors in order to obtain good academic results and propose IVLE activities to improve the levels of spatial ability obtained on the tests. This paper describes the exploratory methodology used and its results.Postprint (published version

An Immersive Telepresence System using RGB-D Sensors and Head Mounted Display

We present a tele-immersive system that enables people to interact with each other in a virtual world using body gestures in addition to verbal communication. Beyond the obvious applications, including general online conversations and gaming, we hypothesize that our proposed system would be particularly beneficial to education by offering rich visual contents and interactivity. One distinct feature is the integration of egocentric pose recognition that allows participants to use their gestures to demonstrate and manipulate virtual objects simultaneously. This functionality enables the instructor to ef- fectively and efficiently explain and illustrate complex concepts or sophisticated problems in an intuitive manner. The highly interactive and flexible environment can capture and sustain more student attention than the traditional classroom setting and, thus, delivers a compelling experience to the students. Our main focus here is to investigate possible solutions for the system design and implementation and devise strategies for fast, efficient computation suitable for visual data processing and network transmission. We describe the technique and experiments in details and provide quantitative performance results, demonstrating our system can be run comfortably and reliably for different application scenarios. Our preliminary results are promising and demonstrate the potential for more compelling directions in cyberlearning.Comment: IEEE International Symposium on Multimedia 201

Effects of virtual acoustics on dynamic auditory distance perception

Sound propagation encompasses various acoustic phenomena including reverberation. Current virtual acoustic methods, ranging from parametric filters to physically-accurate solvers, can simulate reverberation with varying degrees of fidelity. We investigate the effects of reverberant sounds generated using different propagation algorithms on acoustic distance perception, i.e., how faraway humans perceive a sound source. In particular, we evaluate two classes of methods for real-time sound propagation in dynamic scenes based on parametric filters and ray tracing. Our study shows that the more accurate method shows less distance compression as compared to the approximate, filter-based method. This suggests that accurate reverberation in VR results in a better reproduction of acoustic distances. We also quantify the levels of distance compression introduced by different propagation methods in a virtual environment.Comment: 8 Pages, 7 figure

Development of practical vocational training class making use of virtual reality-based simulation system and augmented reality technologies

Virtual reality (VR) refers to the technologies creating a virtual environment to provide users a sensory simulation of the environment being presented. In Hong Kong Institute of Vocational Education (IVE), we are in the process of developing a VR-based simulation system having four screens surrounding users to simulate an immersive environment. This application is commonly known as the cave automatic virtual environment (CAVE). The objective of our VR-based simulation system project is to apply the virtual reality and the augmented reality (AR) technologies for practical training in vocational education and training (VET). Our system is used for various training programs in the engineering areas. These include simulation of any workspaces for operations and maintenance training in electrical and mechanical services. Workspace training is important and beneficial to VET students in addition to practical training in school settings. Meanwhile, some workspaces are full of danger and severe casualty can be resulted if inappropriate operations are performed. Our VRbased simulation system manages to provide a solution to complement the shortfalls of workplace training and ensure that students can acquire a range of skills including safety operations under various environments. In this paper, we introduce our design of a class making use of the CAVE system and augmented reality technology. The class aims at providing training for VET students to perform inspection and maintenance procedures in a virtual engine plant room. The class was found to be educational and managed to promote the skill development among students

Design and validation of an augmented book for spatial abilities development in engineering students

[EN] This paper presents an application of augmented reality for improving spatial abilities of engineering students. An augmented book called AR-Dehaes has been designed to provide 3D virtual models that help students to perform visualization tasks to promote the development of their spatial ability during a short remedial course. A validation study with 24 Mechanical Engineering freshmen at La Laguna University (Spain) has concluded that the training had a measurable and positive impact on students' spatial ability. On the other hand, results obtained using a satisfaction questionnaire illustrate that AR-Dehaes is considered an easy to use, attractive, and very useful technique for students. AR-Dehaes has proved to be a very cost-effective tool insofar as it only required an ordinary PC with a webcam to be used.Martín-Gutiérrez, J.; Saorín, J.; Contero, M.; Alcañiz Raya, ML.; Pérez Lopez, DC.; Ortega Pérez, M. (2010). Design and validation of an augmented book for spatial abilities development in engineering students. Computers & Graphics. 34(1):77-91. doi:10.1016/j.cag.2009.11.003S779134