Emergeables: Deformable Displays for Continuous Eyes-Free Mobile Interaction

International audienceWe present the concept of Emergeables - mobile surfaces that can deform or 'morph' to provide fully-actuated, tangible controls. Our goal in this work is to provide the flexibility of graphical touchscreens, coupled with the affordance and tactile benefits offered by physical widgets. In contrast to previous research in the area of deformable displays, our work focuses on continuous controls (e.g., dials or sliders), and strives for fully-dynamic positioning, providing versatile widgets that can change shape and location depending on the user's needs. We describe the design and implementation of two prototype emergeables built to demonstrate the concept, and present an in-depth evaluation that compares both with a touchscreen alternative. The results show the strong potential of emergeables for on-demand, eyes-free control of continuous parameters, particularly when comparing the accuracy and usability of a high-resolution emergeable to a standard GUI approach. We conclude with a discussion of the level of resolution that is necessary for future emergeables, and suggest how high-resolution versions might be achieved

Emergeables: Deformable Displays for Continuous Eyes-Free Mobile Interaction

ABSTRACT In this paper we present the concept of Emergeables -mobile surfaces that can deform or 'morph' to provide fully-actuated, tangible controls. Our goal in this work is to provide the flexibility of graphical touchscreens, coupled with the affordance and tactile benefits offered by physical widgets. In contrast to previous research in the area of deformable displays, our work focuses on continuous controls (e.g., dials or sliders), and strives for fully-dynamic positioning, providing versatile widgets that can change shape and location depending on the user's needs. We describe the design and implementation of two prototype emergeables built to demonstrate the concept, and present an in-depth evaluation that compares both with a touchscreen alternative. The results show the strong potential of emergeables for on-demand, eyes-free control of continuous parameters, particularly when comparing the accuracy and usability of a high-resolution emergeable to a standard GUI approach. We conclude with a discussion of the level of resolution that is necessary for future emergeables, and suggest how high-resolution versions might be achieved

Tacsel: Shape-Changing Tactile Screen applied for Eyes-Free Interaction in Cockpit

International audienceTouch screens have become widely used in recent years. Nowadays they have been integrated on numerous electronic devices for common use since they allow the user to interact with what is displayed on the screen. However, these technologies cannot be used in complex systems in which the visual attention is very limited (cockpit manipulation, driving tasks, etc.). This paper introduces the concept of Tacsel, the smaller dynamic element of a tactile screen. Tacsels allow shape-changing and flexible properties to touch screen devices providing eyes-free interaction. We developed a high-resolution prototype of Tacsel to demonstrate its technical feasibility and its potential within a cockpit context. Three interaction scenarios are described and a workshop with brainstorming and video-prototyping is conducted to evaluate the use of the proposed Tacsel in several cockpit tasks. Results showed that interactive Tacsels have a real potential for future cockpits. Several other possible applications are also described, and several advantages and limitations are discussed

Curseurs Tangibles sur Dispositifs Mobiles : Impact de la Conception sur les Performances

International audienceTouch interaction is almost omnipresent on mobile devices and technological advances have made screens bigger. The users can then interact with more content displayed on screen but it is more difficult for the users to reach all the parts of the screen with one thumb. At the same time, researchers are exploring mobile interaction with deformable tangible interfaces. Bringing tangible objects to the flat screen brings a new perspective on the reachability problem of the thumb. In this work, we explore the impact on performance for thumb interaction within and outside the functional area of the thumb, while operating a tangible slider. Experimental results demonstrate that the size of the motor space has a significant impact on performance. Operations within and outside the easily reachable area of the thumb show marginal difference of performance.L’interaction tactile est omniprésente sur les dispositifs mobiles et les avancées technologiques ont permis des écrans plus grands. Les utilisateurs peuvent alors interagir avec plus de contenu affiché à l’écran, mais il est plus difficile pour les utilisateurs d’atteindre toutes les parties de l’écran avec le pouce de la main qui tient le dispositif mobile. Dans le même temps, les interfaces tangibles déformables sur mobile sont étudiées : l’ajout de contrôles ou widgets tangibles sur l’écran plat du mobile définit une nouvelle perspective sur le problème de l’accessibilité pour l’interaction au pouce. Dans cet article, nous étudions les performances de l’interaction mobile au pouce à l’intérieur et à l’extérieur de la zone d’action facilement atteignable avec le pouce pour manipuler un curseur tangible. Les résultats expérimentaux démontrent que la taille de l’espace moteur a un impact significatif sur les performances. Au contraire la différence de performances entre les actions à l’intérieur et à l’extérieur de la zone d’action facilement atteignable avec le pouce est marginale

The Stochastic-Quantum Correspondence

This paper introduces a precise correspondence between the theory of stochastic processes and quantum theory. This correspondence provides a new framework for using Hilbert-space methods to formulate highly generic types of stochastic dynamics, with potential applications throughout the sciences. This paper also uses the correspondence in the other direction to reconstruct quantum theory in general from physical models that consist of classical kinematics combined with stochastic dynamics. This reconstruction approach opens up new ways of understanding quantum-theoretic phenomena like interference, decoherence, entanglement, noncommutative observables, and wave-function collapse

GazeForm: Dynamic Gaze-adaptive Touch Surface for Eyes-free Interaction in Airliner Cockpits

An increasing number of domains, including aeronautics, are adopting touchscreens. However, several drawbacks limit their operational use, in particular, eyes-free interaction is almost impossible making it difficult to perform other tasks simultaneously. We introduce GazeForm, an adaptive touch interface with shape-changing capacity that offers an adapted interaction modality according to gaze direction. When the user’s eyes are focused on interaction, the surface is flat and the system acts as a touchscreen. When eyes are directed towards another area, physical knobs emerge from the surface. Compared to a touch only mode, experimental results showed that GazeForm generated a lower subjective mental workload and a higher efficiency of execution (20% faster). Furthermore, GazeForm required less visual attention and participants were able to concentrate more on a secondary monitoring task. Complementary interviews with pilots led us to explore timings and levels of control for using gaze to adapt modality

The Stochastic-Quantum Correspondence

This paper introduces a precise correspondence between the theory of stochastic processes and quantum theory. This correspondence provides a new framework for using Hilbert-space methods to formulate highly generic types of stochastic dynamics, with potential applications throughout the sciences. This paper also uses the correspondence in the other direction to reconstruct quantum theory in general from physical models that consist of classical kinematics combined with stochastic dynamics. This reconstruction approach opens up new ways of understanding quantum-theoretic phenomena like interference, decoherence, entanglement, noncommutative observables, and wave-function collapse

KnobSlider:design of a shape-changing UI for parameter control

International audiencePhysical controls are widely used by professionals such as sound engineers or aircraft pilots. In particular knobs and sliders are the most prevalent in such interfaces. They have advantages over touchscreen GUIs, especially when users require quick and eyes-free control. However, their interfaces (e.g., mixing consoles) are often bulky and crowded. To improve this, we present the results of a formative study with professionals who use physical controllers. Based on their feedback, we propose design requirements for future interfaces for parameters control. We then introduce the design of our KnobSlider that combines the advantages of a knob and a slider in one unique shape-changing device. A qualitative study with professionals shows how KnobSlider supports the design requirements, and inspired new interactions and applications

Cross-device media: a review of second screening and multi-device television

Television viewers interacting with second screens has become a common sight in the modern living room. Such activities are a mixture of related, semi-related, and non-related browsing of content. This growing trend is revolutionising the way that broadcasters think about their content. Through the envisioned connected home, driven by end-to-end IP connected networks, television content creators and app developers are now considering the design space for multi-device, interactive experiences. In this review paper, we consider the pre-digital beginnings of such scenarios, and progress to discuss how the introduction of mobile devices has affected the TV viewing experience. We discuss dual-screen usage over a variety of contexts in the connected home, with a focus on ‘designed’ dual-screen experiences such as companion applications. We conclude with reflections on the future of this area so that app developers, broadcasters, and academics may push further the space and improve future dual- and multi-screen experiences