Sélection et Contrôle à Distance d'Objets Physiques Augmentés

International audienceNotre recherche doctorale concerne l'interaction dans les environnements intelligents. Plus particulièrement, nous considérons la sélection et le contrôle à distance d'objets physiques augmentés. Nos objectifs sont à la fois conceptuels, par la mise en place d'un espace de conception mais aussi pratiques par la conception, le développement et l'évaluation de techniques d'interaction. Nos résultats ont permis de souligner où l'attention de l'utilisateur doit être pour la sélection efficace et plaisante des objets augmentés à travers la comparaison expérimentale de deux nouvelles techniques de sélection d'objets physiques : P2Roll et P2Slide. Les perspectives en vue de la complétude des travaux concernent principalement le contrôle d'objets et incluent (1) l'évaluation des techniques de guidage pour le contrôle gestuel des objets augmentés par un utilisateur novice, et (2) l'évaluation in situ des techniques conçues

Low cost solutions to pairing issues in IEEE 802.15.4 networks

The last years have seen an important increase in the development and proliferation of wireless technologies. This success, mostly related to mobility and the relative ease with which wireless devices can be linked (no wires needed between parties), has affected consumer as well as industrial applications. There are however many areas that are still closed to the introduction of wireless systems. Among the factors that affect wireless acceptance, one can name security and the complexity often involved in setting up networks. Unlike wired systems, the extra confidence afforded by “seen wires” is not available in wireless systems, making it difficult for the users to know if communication occurs between legitimate parties. This places wireless technology before the need to introduce simple methods to improve the set up and authentication processes. These aspects are addressed by binding methods. It is our purpose in this document to present such solutions, and especially how they can be used in 802.15.4 based networks. We will mainly focus on solutions involving optical or RFID techniques. We will also suggest some improvements where needed

Designing Disambiguation Techniques for Pointing in the Physical World

International audienceSeveral ways for selecting physical objects exist, including touching and pointing at them. Allowing the user to interact at a distance by pointing at physical objects can be challenging when the environment contains a large number of interactive physical objects, possibly occluded by other everyday items. Previous pointing techniques highlighted the need for disambiguation techniques. Addressing this challenge, this paper contributes a design space that organizes along groups and axes a set of options for designers to relevantly (1) describe, (2) classify, and (3) design disambiguation techniques. First, we have not found techniques in the literature yet that our design space could not describe. Second, all the techniques show a different path along the axes of our design space. Third, it allows defining of several new paths/solutions that have not yet been explored. We illustrate this generative power with the example of such a designed technique, Physical Pointing Roll (P2Roll)

Mobile Pointing Task in the Physical World: Balancing Focus and Performance while Disambiguating

International audienceWe address the problem of mobile distal selection of physical objects when pointing at them in augmented environments. We focus on the disambiguation step needed when several objects are selected with a rough pointing gesture. A usual disambiguation technique forces the users to switch their focus from the physical world to a list displayed on a handheld device's screen. In this paper, we explore the balance between change of users' focus and performance. We present two novel interaction techniques allowing the users to maintain their focus in the physical world. Both use a cycling mechanism, respectively performed with a wrist rolling gesture for P2Roll or with a finger sliding gesture for P2Slide. A user experiment showed that keeping users' focus in the physical world outperforms techniques that require the users to switch their focus to a digital representation distant from the physical objects, when disambiguating up to 8 objects

SnapLink: Fast and Accurate Vision-Based Appliance Control in Large Commercial Buildings

As the number and heterogeneity of appliances in smart buildings increases, identifying and controlling them becomes challenging. Existing methods face various challenges when deployed in large commercial buildings. For example, voice command assistants require users to memorize many control commands. Attaching Bluetooth dongles or QR codes to appliances introduces considerable deployment overhead. In comparison, identifying an appliance by simply pointing a smartphone camera at it and controlling the appliance using a graphical overlay interface is more intuitive. We introduce SnapLink, a responsive and accurate vision-based system for mobile appliance identification and interaction using image localization. Compared to the image retrieval approaches used in previous vision-based appliance control systems, SnapLink exploits 3D models to improve identification accuracy and reduce deployment overhead via quick video captures and a simplified labeling process. We also introduce a feature sub-sampling mechanism to achieve low latency at the scale of a commercial building. To evaluate SnapLink, we collected training videos from 39 rooms to represent the scale of a modern commercial building. It achieves a 94% successful appliance identification rate among 1526 test images of 179 appliances within 120 ms average server processing time. Furthermore, we show that SnapLink is robust to viewing angle and distance differences, illumination changes, as well as daily changes in the environment. We believe the SnapLink use case is not limited to appliance control: it has the potential to enable various new smart building applications.</jats:p

A 2-Way Laser-Assisted Selection Scheme for Handhelds in a Physical Environment

Abstract. We present a 2-way selection method to select objects in a physical environment with a novel feedback and transfer of control mechanism. A modulated laser pointer signal sent from a handheld device triggers a photosensitive tag placed in the environment. The tag responds via a standard wireless channel directly to the handheld with information regarding an object it represents. We describe a prototype implementation for a Motorola iDEN i95cl cell phone, discuss the interaction challenges and application possibilities for this physical world selection that extends a common handheld device. We also compare this solution to related attempts in the literature.

Improving command selection in smart environments by exploiting spatial constancy

With the a steadily increasing number of digital devices, our environments are becoming increasingly smarter: we can now use our tablets to control our TV, access our recipe database while cooking, and remotely turn lights on and off. Currently, this Human-Environment Interaction (HEI) is limited to in-place interfaces, where people have to walk up to a mounted set of switches and buttons, and navigation-based interaction, where people have to navigate on-screen menus, for example on a smart-phone, tablet, or TV screen. Unfortunately, there are numerous scenarios in which neither of these two interaction paradigms provide fast and convenient access to digital artifacts and system commands. People, for example, might not want to touch an interaction device because their hands are dirty from cooking: they want device-free interaction. Or people might not want to have to look at a screen because it would interrupt their current task: they want system-feedback-free interaction. Currently, there is no interaction paradigm for smart environments that allows people for these kinds of interactions. In my dissertation, I introduce Room-based Interaction to solve this problem of HEI. With room-based interaction, people associate digital artifacts and system commands with real-world objects in the environment and point toward these real-world proxy objects for selecting the associated digital artifact. The design of room-based interaction is informed by a theoretical analysis of navigation- and pointing-based selection techniques, where I investigated the cognitive systems involved in executing a selection. An evaluation of room-based interaction in three user studies and a comparison with existing HEI techniques revealed that room-based interaction solves many shortcomings of existing HEI techniques: the use of real-world proxy objects makes it easy for people to learn the interaction technique and to perform accurate pointing gestures, and it allows for system-feedback-free interaction; the use of the environment as flat input space makes selections fast; the use of mid-air full-arm pointing gestures allows for device-free interaction and increases awareness of other’s interactions with the environment. Overall, I present an alternative selection paradigm for smart environments that is superior to existing techniques in many common HEI-scenarios. This new paradigm can make HEI more user-friendly, broaden the use cases of smart environments, and increase their acceptance for the average user

Physical Selection in Ubiquitous Computing

Jokapaikan tietotekniikassa (ubiquitous computing) tietotekniset laitteet sulautuvat fyysiseen ympäristöön siten että niiden käyttäjät voivat olla yhtä aikaa vuorovaikutuksessa näiden laitteiden kanssa ja toimia fyysisessä ympäristössään. Laitteet ovat yhteydessä toisiinsa, ne ovat eri kokoisia ja niillä on erilaisia syöttö- ja tulostusmahdollisuuksia tarkoituksestaan riippuen. Nämä jokapaikan tietotekniikan ominaisuudet luovat tarpeen vuorovaikutustavoille, jotka eroavat huomattavasti tavanomaisten työpöytätietokoneiden vuorovaikutustavoista. Fyysinen valinta (physical selection) on jokapaikan tietotekniikan vuorovaikutustehtävä, jota käytetään kertomaan käyttäjän kannettavalle päätelaitteelle minkä fyysisen esineen kanssa käyttäjä haluaa olla vuorovaikutuksessa. Fyysinen valinta perustuu tunnisteisiin (tag), jotka yksilöivät fyysiset esineet tai sisältävät fyysisen hyperlinkin digitaalisessa muodossa olevaan tietoon, joka liittyy esineeseen, johon kyseinen tunniste on liitetty. Käyttäjä valitsee fyysisen hyperlinkin koskettamalla, osoittamalla tai skannaamalla tunnistetta sopivalla lukulaitteella varustetulla päätelaitteellaan. Fyysinen valinta voidaan toteuttaa erilaisilla teknologioilla, kuten sähköisesti luettavilla tunnisteilla ja niiden lukijoilla, infrapunalähettimillä sekä optisesti luettavilla tunnisteilla ja matkapuhelinten kameroilla. Tässä väitöskirjassa analysoidaan fyysistä valintaa vuorovaikutustehtävänä ja toteutusteknisestä näkökulmasta sekä esitellään eri valintatavat ­ kosketus, osoitus ja skannaus. Koskeusta ja osoitusta on tutkittu toteuttamalla prototyyppi ja tutkimalla sen avulla valintatapoja kokeellisesti. Tämän väitöskirjan tuloksiin kuuluu fyysisen valinnan analysointi jokapaikan tietotekniikan kontekstissa, ehdotuksia fyysisten hyperlinkkien visualisoinnista sekä fyysisessä ympäristössä että päätelaitteessa, ja käyttäjävaatimuksia fyysiselle valinnalle osana jokapaikan tietotekniikan arkkitehtuuria.In ubiquitous computing, the computing devices are embedded into the physical environment so that the users can interact with the devices at the same time as they interact with the physical environment. The various devices are connected to each other, and have various sizes and input and output capabilities depending on their purpose. These features of ubiquitous computing create a need for interaction methods that are radically different from the desktop computer interactions. Physical selection is an interaction task for ubiquitous computing and it is used to tell the user s mobile terminal which physical object the user wants to interact with. It is based on tags that identify physical objects or store a physical hyperlink to digital information related to the object the tag is attached to. The user selects the physical hyperlink by touching, pointing or scanning the tag with the mobile terminal that is equipped with an appropriate reader. Physical selection has been implemented with various technologies, such as radio-frequency tags and readers, infrared transceivers, and optically readable tags and mobile phone cameras. In this dissertation, physical selection is analysed as a user interaction task, and from the implementation viewpoint. Different selection methods ­ touching, pointing and scanning ­ are presented. Touching and pointing have been studied by implementing a prototype and conducting user experiments with it. The contributions of this dissertation include an analysis of physical selection in the ubiquitous computing context, suggestions for visualising the physical hyperlinks in both the physical environment and in the mobile terminal, and user requirements for physical selection as a part of an ambient intelligence architecture

Physical Selection in Ubiquitous Computing

Jokapaikan tietotekniikassa (ubiquitous computing) tietotekniset laitteet sulautuvat fyysiseen ympäristöön siten että niiden käyttäjät voivat olla yhtä aikaa vuorovaikutuksessa näiden laitteiden kanssa ja toimia fyysisessä ympäristössään. Laitteet ovat yhteydessä toisiinsa, ne ovat eri kokoisia ja niillä on erilaisia syöttö- ja tulostusmahdollisuuksia tarkoituksestaan riippuen. Nämä jokapaikan tietotekniikan ominaisuudet luovat tarpeen vuorovaikutustavoille, jotka eroavat huomattavasti tavanomaisten työpöytätietokoneiden vuorovaikutustavoista. Fyysinen valinta (physical selection) on jokapaikan tietotekniikan vuorovaikutustehtävä, jota käytetään kertomaan käyttäjän kannettavalle päätelaitteelle minkä fyysisen esineen kanssa käyttäjä haluaa olla vuorovaikutuksessa. Fyysinen valinta perustuu tunnisteisiin (tag), jotka yksilöivät fyysiset esineet tai sisältävät fyysisen hyperlinkin digitaalisessa muodossa olevaan tietoon, joka liittyy esineeseen, johon kyseinen tunniste on liitetty. Käyttäjä valitsee fyysisen hyperlinkin koskettamalla, osoittamalla tai skannaamalla tunnistetta sopivalla lukulaitteella varustetulla päätelaitteellaan. Fyysinen valinta voidaan toteuttaa erilaisilla teknologioilla, kuten sähköisesti luettavilla tunnisteilla ja niiden lukijoilla, infrapunalähettimillä sekä optisesti luettavilla tunnisteilla ja matkapuhelinten kameroilla. Tässä väitöskirjassa analysoidaan fyysistä valintaa vuorovaikutustehtävänä ja toteutusteknisestä näkökulmasta sekä esitellään eri valintatavat ­ kosketus, osoitus ja skannaus. Koskeusta ja osoitusta on tutkittu toteuttamalla prototyyppi ja tutkimalla sen avulla valintatapoja kokeellisesti. Tämän väitöskirjan tuloksiin kuuluu fyysisen valinnan analysointi jokapaikan tietotekniikan kontekstissa, ehdotuksia fyysisten hyperlinkkien visualisoinnista sekä fyysisessä ympäristössä että päätelaitteessa, ja käyttäjävaatimuksia fyysiselle valinnalle osana jokapaikan tietotekniikan arkkitehtuuria.In ubiquitous computing, the computing devices are embedded into the physical environment so that the users can interact with the devices at the same time as they interact with the physical environment. The various devices are connected to each other, and have various sizes and input and output capabilities depending on their purpose. These features of ubiquitous computing create a need for interaction methods that are radically different from the desktop computer interactions. Physical selection is an interaction task for ubiquitous computing and it is used to tell the user s mobile terminal which physical object the user wants to interact with. It is based on tags that identify physical objects or store a physical hyperlink to digital information related to the object the tag is attached to. The user selects the physical hyperlink by touching, pointing or scanning the tag with the mobile terminal that is equipped with an appropriate reader. Physical selection has been implemented with various technologies, such as radio-frequency tags and readers, infrared transceivers, and optically readable tags and mobile phone cameras. In this dissertation, physical selection is analysed as a user interaction task, and from the implementation viewpoint. Different selection methods ­ touching, pointing and scanning ­ are presented. Touching and pointing have been studied by implementing a prototype and conducting user experiments with it. The contributions of this dissertation include an analysis of physical selection in the ubiquitous computing context, suggestions for visualising the physical hyperlinks in both the physical environment and in the mobile terminal, and user requirements for physical selection as a part of an ambient intelligence architecture