Exploring the effectiveness of an augmented reality dressing room

In this paper, we describe our experience with the design of an augmented reality dressing room in which 3D models of a dress are overlaid with a color image from a camera to provide the function of a sort of virtual mirror. In such a way, the customer can move around to understand if a dress suits and fits them well. The project is implemented in Unity 4 Pro in combination with the Microsoft Kinect 2 for the tracking process. Design issues and technical implementation as well as the prospects for further development of the techniques are discussed. To assess the validity of our proposal, we have conducted a user study using 47 participants with different levels of experience with video games and devices used to play them. The empirical method used is qualitative. To this end, we used questionnaire-based surveys. The obtained results suggest that our solution represents a viable means to simulate dressing rooms, and participants in the study found the interaction with our 3D models to be natural for understanding if a dress suits and fits them well. Overall, the participants found our application very useful from a practical point of view

Proceedings of the 10th international conference on disability, virtual reality and associated technologies (ICDVRAT 2014)

The proceedings of the conferenc

A Utility Framework for Selecting Immersive Interactive Capability and Technology for Virtual Laboratories

There has been an increase in the use of virtual reality (VR) technology in the education community since VR is emerging as a potent educational tool that offers students with a rich source of educational material and makes learning exciting and interactive. With a rise of popularity and market expansion in VR technology in the past few years, a variety of consumer VR electronics have boosted educators and researchers’ interest in using these devices for practicing engineering and science laboratory experiments. However, little is known about how such devices may be well-suited for active learning in a laboratory environment. This research aims to address this gap by formulating a utility framework to help educators and decision-makers efficiently select a type of VR device that matches with their design and capability requirements for their virtual laboratory blueprint. Furthermore, a framework use case is demonstrated by not only surveying five types of VR devices ranging from low-immersive to full-immersive along with their capabilities (i.e., hardware specifications, cost, and availability) but also considering the interaction techniques in each VR device based on the desired laboratory task. To validate the framework, a research study is carried out to compare these five VR devices and investigate which device can provide an overall best-fit for a 3D virtual laboratory content that we implemented based on the interaction level, usability and performance effectiveness

Interfaces for human-centered production and use of computer graphics assets

L'abstract è presente nell'allegato / the abstract is in the attachmen

Freeform 3D interactions in everyday environments

PhD ThesisPersonal computing is continuously moving away from traditional input using mouse and keyboard, as new input technologies emerge. Recently, natural user interfaces (NUI) have led to interactive systems that are inspired by our physical interactions in the real-world, and focus on enabling dexterous freehand input in 2D or 3D. Another recent trend is Augmented Reality (AR), which follows a similar goal to further reduce the gap between the real and the virtual, but predominately focuses on output, by overlaying virtual information onto a tracked real-world 3D scene. Whilst AR and NUI technologies have been developed for both immersive 3D output as well as seamless 3D input, these have mostly been looked at separately. NUI focuses on sensing the user and enabling new forms of input; AR traditionally focuses on capturing the environment around us and enabling new forms of output that are registered to the real world. The output of NUI systems is mainly presented on a 2D display, while the input technologies for AR experiences, such as data gloves and body-worn motion trackers are often uncomfortable and restricting when interacting in the real world. NUI and AR can be seen as very complimentary, and bringing these two fields together can lead to new user experiences that radically change the way we interact with our everyday environments. The aim of this thesis is to enable real-time, low latency, dexterous input and immersive output without heavily instrumenting the user. The main challenge is to retain and to meaningfully combine the positive qualities that are attributed to both NUI and AR systems. I review work in the intersecting research fields of AR and NUI, and explore freehand 3D interactions with varying degrees of expressiveness, directness and mobility in various physical settings. There a number of technical challenges that arise when designing a mixed NUI/AR system, which I will address is this work: What can we capture, and how? How do we represent the real in the virtual? And how do we physically couple input and output? This is achieved by designing new systems, algorithms, and user experiences that explore the combination of AR and NUI

Design of VR app applied to cognitive training

L’objectiu principal d’aquest projecte és el disseny d’una aplicació de realitat virtual per millorar el tractament dels pacients amb deteriorament cognitiu lleu, així com estudiar els possibles avantatges que aquesta tecnologia pot proporcionar en aquest camp. Es va escollir la realitat virtual perquè permet augmentar la sensació d’immersió pel que fa a les tecnologies actuals. Actualment la realitat virtual s’està utilitzant amb aquest tipus de tractament i està aconseguint gran resultats amb els pacients. A més, mitjançant l’ús d’aquesta tècnica d’immersió visual, s’espera que ajudi a millorar la capacitat dels pacients davant nous problemes, com pot ser la iniciació a la realitat virtual, una qüestió fonamental que ajuda a la millora dels pacients que es troben en les primeres etapes de la malaltia. L’aplicació consisteix en un entorn de supermercat virtual on el pacient pot realitzar diverses proves. En aquesta hi haurà diferents nivells amb diverses complexitats, sempre després d’haver realitzat un tutorial previ. L’aplicació s’ha realitzat en dues fases diferents: primer es va crear el guió, amb col·laboració amb la unitat d’Alzheimer de l’Hospital Clínic. Els nivells de l’aplicació es van definir aquí. El següent va ser la realització de l’aplicació amb col·laboració amb la companyia Vysion 360. Per a la seva utilització per la unitat d’Alzheimer de l’Hospital Clínic, l’aplicació tenia que complir diferents criteris. En primer lloc, els nivells de dificultat tenen que ser suficients per realitzar un tractament a llarg termini. En segon lloc, per crear una bona experiència de immersió, l’entorn creat té que ser el més realista possible. Finalment, s’ha creat una base de dades local per guardar la informació de totes les sessions, utilitzat posteriorment en l’anàlisi de evolució dels pacients. Amb aquesta aplicació, s’espera que els resultats en els pacients amb deteriorament cognitiu lleu milloren respecte a les tècniques anteriors. Especialment gràcies a la gran experiència d’immersió aconseguida amb la realitat virtual, la qual ajuda a la concentració dels pacients durant el tractament

Efficacy of Multisensory Technology in Post-Stroke Cognitive Rehabilitation: A Systematic Review

Post-stroke, in addition to sensorimotor signs and symptoms, could lead to cognitive deficits. Theories of embodiment stress the role of sensorimotor system and multisensory integration in sustaining high-order cognitive domains. Despite conventional post-stroke cognitive rehabilitation being effective, innovative technologies could overcome some limitations of standard interventions and exploit bodily information during cognitive rehabilitation. This systematic review aims to investigate whether ‘multisensory technologies’ compared to usual care treatment can be a viable alternative for cognitive rehabilitation. By applying PRISMA guidelines, we extracted data and assessed the bias of 10 studies that met the required criteria. We found that multisensory technologies were at least comparable to standard treatment but particularly effective for attention, spatial cognition, global cognition, and memory. Multisensory technologies consisted principally of virtual reality alone or combined with a motion tracking system. Multisensory technologies without motion tracking were more effective than standard procedures, whereas those with motion tracking showed balanced results for the two treatments. Limitations of the included studies regarded the population (e.g., no study on acute stroke), assessment (e.g., lack of multimodal/multisensory pre-post evaluation), and methodology (e.g., sample size, blinding bias). Recent advancements in technological development and metaverse open new opportunities to design embodied rehabilitative programs