User interface design considerations for emerging input technologies in iTV

Streaming media and interactive television viewing experiences are becoming more commonplace with the introduction of services such as Netflix Streaming, the Apple TV, and Google TV aided by the increase adoption of broadband internet. As these services make their way into the living room, and developers struggle to accommodate more complex interaction requirements, new input methods and interfaces need to be developed. Current interfaces for controlling interactive TV and media management have typically been designed for the desktop and laptop experience, using conventional input devices like a trackpad, mouse and keyboard. These techniques are difficult to reconcile with the typical TV viewing experience. We designed an experiment to test a representative interactive TV interface with a number of emerging input technologies like the Nintendo Wiimote, Microsoft Kinect and tablet applications. We measured user performance with these devices while encumbered by a beverage and plate of food in order to simulate a living room experience. We found that while most of these technologies are suitable for navigating an Interactive TV experience, their use challenges us to rethink the user experience, and places limitations on things like button size and placement, as well as the types of UI widgets we can use. We hope these guidelines and heuristics will help in the design of future interactive TV experiences, as well as the development of novel interaction techniques for the TV viewing experience

Ubiquitous Computing in a Home Environment, Controlling Consumer Electronics

Building interaction prototypes for ubiquitous computing is inherently difficult, since it involves a number of different devices and systems. Prototyping is an important step in developing and evaluating interaction concepts. The ideal prototyping methodology should offer high fidelity at a relatively low cost. This thesis describes the development of interaction concepts for controlling consumer electronics in a ubiquitous computing home environment, as well as the setup, based on immersive virtual reality, used to develop and evaluate the interaction concepts. Off-the-shelf input/output devices and a game engine are used for developing two concepts for device discovery and two concepts for device interaction. The interaction concepts are compared in a controlled experiment in order to evaluate the concepts as well as the virtual reality setup. Statistically significant differences and subjective preferences could be observed in the quantitative and qualitative data respectively. Overall, the results suggest that the interaction concepts could be acceptable to some users for some use cases and that the virtual reality setup offers the possibility to quickly build interaction concepts which can be evaluated and compared in a controlled experiment

Measuring user experience for virtual reality

In recent years, Virtual Reality (VR) and 3D User Interfaces (3DUI) have seen a drastic increase in popularity, especially in terms of consumer-ready hardware and software. These technologies have the potential to create new experiences that combine the advantages of reality and virtuality. While the technology for input as well as output devices is market ready, only a few solutions for everyday VR - online shopping, games, or movies - exist, and empirical knowledge about performance and user preferences is lacking. All this makes the development and design of human-centered user interfaces for VR a great challenge. This thesis investigates the evaluation and design of interactive VR experiences. We introduce the Virtual Reality User Experience (VRUX) model based on VR-specific external factors and evaluation metrics such as task performance and user preference. Based on our novel UX evaluation approach, we contribute by exploring the following directions: shopping in virtual environments, as well as text entry and menu control in the context of everyday VR. Along with this, we summarize our findings by design spaces and guidelines for choosing optimal interfaces and controls in VR.In den letzten Jahren haben Virtual Reality (VR) und 3D User Interfaces (3DUI) stark an Popularität gewonnen, insbesondere bei Hard- und Software im Konsumerbereich. Diese Technologien haben das Potenzial, neue Erfahrungen zu schaffen, die die Vorteile von Realität und Virtualität kombinieren. Während die Technologie sowohl für Eingabe- als auch für Ausgabegeräte marktreif ist, existieren nur wenige Lösungen für den Alltag in VR - wie Online-Shopping, Spiele oder Filme - und es fehlt an empirischem Wissen über Leistung und Benutzerpräferenzen. Dies macht die Entwicklung und Gestaltung von benutzerzentrierten Benutzeroberflächen für VR zu einer großen Herausforderung. Diese Arbeit beschäftigt sich mit der Evaluation und Gestaltung von interaktiven VR-Erfahrungen. Es wird das Virtual Reality User Experience (VRUX)- Modell eingeführt, das auf VR-spezifischen externen Faktoren und Bewertungskennzahlen wie Leistung und Benutzerpräferenz basiert. Basierend auf unserem neuartigen UX-Evaluierungsansatz leisten wir einen Beitrag, indem wir folgende interaktive Anwendungsbereiche untersuchen: Einkaufen in virtuellen Umgebungen sowie Texteingabe und Menüsteuerung im Kontext des täglichen VR. Die Ergebnisse werden außerdem mittels Richtlinien zur Auswahl optimaler Schnittstellen in VR zusammengefasst

A Utility Framework for Selecting Immersive Interactive Capability and Technology for Virtual Laboratories

There has been an increase in the use of virtual reality (VR) technology in the education community since VR is emerging as a potent educational tool that offers students with a rich source of educational material and makes learning exciting and interactive. With a rise of popularity and market expansion in VR technology in the past few years, a variety of consumer VR electronics have boosted educators and researchers’ interest in using these devices for practicing engineering and science laboratory experiments. However, little is known about how such devices may be well-suited for active learning in a laboratory environment. This research aims to address this gap by formulating a utility framework to help educators and decision-makers efficiently select a type of VR device that matches with their design and capability requirements for their virtual laboratory blueprint. Furthermore, a framework use case is demonstrated by not only surveying five types of VR devices ranging from low-immersive to full-immersive along with their capabilities (i.e., hardware specifications, cost, and availability) but also considering the interaction techniques in each VR device based on the desired laboratory task. To validate the framework, a research study is carried out to compare these five VR devices and investigate which device can provide an overall best-fit for a 3D virtual laboratory content that we implemented based on the interaction level, usability and performance effectiveness

A systematic review of game technologies for pediatric patients

[EN] Children in hospital are subjected to multiple negative stimuli that may hinder their development and social interactions. Although game technologies are thought to improve children's experience in hospital, there is a lack of information on how they can be used effectively. This paper presents a systematic review of the literature on the existing approaches in this context to identify gaps for future research. A total of 1305 studies were identified, of which 75 were thoroughly analyzed according to our review protocol. The results show that the most common approach is to design mono-user games with traditional computers or monitor-based video consoles, which serve as a distractor or a motivator for physical rehabilitation for primary school children undergoing fearful procedures such as venipuncture, or those suffering chronic, neurological, or traumatic diseases/injures. We conclude that, on the one hand, game technologies seem to present physical and psychological benefits to pediatric patients, but more research is needed on this. On the other hand, future designers of games for pediatric hospitalization should consider: 1. The development for kindergarten patients and adolescents, 2. Address the psychological impact caused by long-term hospitalization, 3. Use collaboration as an effective game strategy to reduce patient isolation, 4. Have purposes other than distraction, such as socialization, coping with emotions, or fostering physical mobility, 5. Include parents/caregivers and hospital staff in the game activities; and 6. Exploit new technological artifacts such as robots and tangible interactive elements to encourage intrinsic motivation.This work is supported by the Spanish Ministry of Economy and Competitiveness and the European Development Regional Fund (EDRF-FEDER) with Project TIN2014-60077-R.El Jurdi, S.; Montaner-Marco, J.; García Sanjuan, F.; Jaén Martínez, FJ.; Nácher-Soler, VE. (2018). A systematic review of game technologies for pediatric patients. Computers in Biology and Medicine. 97:89-112. https://doi.org/10.1016/j.compbiomed.2018.04.019S891129

Inspiring End-user Programming Through Exposure to Multi-platform Computing and Improved Integrated Development Environments

The art of software engineering inherently requires high-level problem solving and perseverance, as programmers and designers wrestle with complex design and implementation challenges in the process of turning loose concepts and ideas into working code. In the current developer ecosystem, engineers are commonly incentivized extrinsically by monetary rewards, approval or status. Ironically, extrinsically motivating a person has been proven to decrease complex problem solving performance. On the other hand, motivating a person intrinsically through the Self Deterministic Theory constructs of autonomy, competence and relatedness has been shown to encourage problem solving, creativity and innovation. To determine what motivates different types of developers, and how well their tools support them in their work, we developed and deployed a survey. The validated survey tool measured the intrinsic motivation level of 103 developers of varying personas. Based on the data gathered, we highlight areas for improving the current development environment to foster increased problem solving and creativity

Combining physical and virtual worlds for motor-cognitive training interventions: Position paper with guidelines on technology classification in movement-related research

Efficient movements require intact motor and cognitive function. There is a growing literature on motor-cognitive interventions to improve the overall quality of life of healthy or diseased older people. For such interventions, novel technological advances are crucial not only in terms of motivation but also to improve the user experience in a multi-stimuli world, usually offered as a mixture of real and virtual environments. This article provides a classification system for movement-related research dealing with motor-cognitive interventions performed in different extents of a virtual environment. The classification is divided into three categories: (a) type of digital device with the associated degree of immersiveness provided; (b) presence or absence of a human-computer interaction; and (c) activity engagement during training, defined by activity >1.5 Metabolic Equivalent of task. Since virtual reality (VR) often categorizes different technologies under the same term, we propose a taxonomy of digital devices ranging from computer monitors and projectors to head-mounted VR technology. All immersive technologies that have developed rapidly in recent years are grouped under the umbrella term Extended Reality (XR). These include augmented reality (AR), mixed reality (MR), and VR, as well as all technologies that have yet to be developed. This technology has potential not only for gaming and entertainment, but also for research, motor-cognitive training programs, rehabilitation, telemedicine, etc. This position paper provides definitions, recommendations, and guidelines for future movement-related interventions based on digital devices, human-computer interactions, and physical engagement to use terms more consistently and contribute to a clearer understanding of their implications

Effects of Local Latency on Games

Video games are a major type of entertainment for millions of people, and feature a wide variety genres. Many genres of video games require quick reactions, and in these games it is critical for player performance and player experience that the game is responsive. One of the major contributing factors that can make games less responsive is local latency — the total delay between input and a resulting change to the screen. Local latency is produced by a combination of delays from input devices, software processing, and displays. Due to latency, game companies spend considerable time and money play-testing their games to ensure the game is both responsive and that the in-game difficulty is reasonable. Past studies have made it clear that local latency negatively affects both player performance and experience, but there is still little knowledge about local latency’s exact effects on games. In this thesis, we address this problem by providing game designers with more knowledge about local latency’s effects. First, we performed a study to examine latency’s effects on performance and experience for popular pointing input devices used with games. Our results show significant differences between devices based on the task and the amount of latency. We then provide design guidelines based on our findings. Second, we performed a study to understand latency’s effects on ‘atoms’ of interaction in games. The study varied both latency and game speed, and found game speed to affect a task’s sensitivity to latency. Third, we used our findings to build a model to help designers quickly identify latency-sensitive game atoms, thus saving time during play-testing. We built and validated a model that predicts errors rates in a game atom based on latency and game speed. Our work helps game designers by providing new insight into latency’s varied effects and by modelling and predicting those effect