A New Layout Method for Graphical User Interfaces

International audienceThe layout mechanisms for many GUI toolkits are hard to understand, the associated tools and API's often difficult to use. This work investigates new, easy-to-understand layout mechanisms and evaluates its implementation. We will analyze the requirements for the definition of layouts of a graphical user interface. Part of the issue is that several aspects need to be considered simultaneously while laying-out a component: the alignment with other components as well as its own behaviour while resizing its container. Moreover, the used tools should isolate the designer/drawer from the implementation details of the framework. We present the details of our new GUI layout system, discuss the choices we made for our new layout algorithm and detail implementation issues. Moreover, we present also the user interface for our new GUI builder system that contains several innovations, such as a preview window to show the effects of layout configuration choices in real-time. We present an evaluation of our new system by attacking the complex GUI layout problem mentioned above

Boîte à outils pour le développement de techniques d'interaction post-WIMP sur dispositifs mobiles

poster présenté à la 21ème Conférence francophone sur l'Interaction Homme-Machine (IHM 09).National audienceno abstrac

A Novel Taxonomy for Gestural Interaction Techniques Based on Accelerometers

Session: Multimodal interfacesInternational audienceA large variety of gestural interaction techniques based on accelerometers is now available. In this article, we propose a new taxonomic space as a systematic structure for supporting the comparative analysis of these techniques as well as for designing new ones. An interaction technique is plotted as a point in a space where the vertical axis denotes the semantic coverage of the techniques, and the horizontal axis expresses the physical actions users are engaged in, i.e. the lexicon. In addition, syntactic modifiers are used to express the interpretation process of input tokens into semantics, as well as pragmatic modifiers to make explicit the level of indirection between users' actions and system responses. To demonstrate the coverage of the taxonomy, we have classified 25 interaction techniques based on accelerometers. The analysis of the design space per se reveals directions for future research

Techniques d'interaction gestuelles pour dispositifs mobiles combinant accéléromètres et écrans tactiles multipoints

In this thesis, we address the question of gesture interaction on mobile device. These devices, now common, differ from conventional computers primarily by the input devices the user interact with (screen size small but tactile, various sensors such as accelerometers) as well as the context in which they are used. The work presented here is an exploration of the vast area of interaction techniques on these mobile devices. First we try to structure this space by focusing on the techniques based on accelerometers for which we propose a taxonomy. Its descriptive and discriminant power is validated by and the classification of thirty-seven interaction techniques in the literature. Second we focus on the achievement of gestural interaction techniques for these mobile devices. With TouchOver, we show that it is possible to take advantage of complementary two-channels input (touch screen and accelerometers) to add a state to the finger-drag, thus enriching the interaction. Finally, we focus on mobile device menus and offer a new form of sign language menus. We discuss their implementation with the GeLATI software library that allows their integration into a pre-existing GUI toolkit.Dans cette thèse, j'aborde la question de l'interaction gestuelle sur dispositif mobile. Ces dispositifs, à présent communs, se distinguent des ordinateurs conventionnels principalement par leurs périphériques d'interaction avec l'utilisateur (écrans de taille restreinte mais tactiles, capteurs divers tels que les accéléromètres) ainsi que par le contexte dans lequel ils sont utilisés. Le travail que je présente est une exploration du vaste domaine des techniques d'interaction sur ces dispositifs mobiles. Je structure cet espace en me concentrant sur les techniques à base d'accéléromètres pour lesquelles je propose une taxonomie. Son pouvoir descriptif et discriminant est validé par la classification de trente-sept techniques d'interaction de la littérature. La suite de mon travail se penche sur la réalisation de techniques d'interaction gestuelles pour ces dispositifs mobiles. Avec TouchOver, je montre qu'il est possible de tirer parti de manière complémentaire de deux canaux d'entrée (écran tactile et accéléromètres) pour ajouter un état au glissé du doigt, permettant ainsi d'enrichir cette interaction. Enfin, je m'intéresse aux menus sur dispositif mobile et propose une nouvelle forme de menus gestuels. Je présente leur réalisation avec la bibliothèque logicielle GeLATI qui permet leur intégration à une boîte à outils de développement d'interface graphique préexistante.

A novel Taxonomy for Gestural Interaction Techniques: Considerations for automotive Environments

4 pagesInternational audienceA large variety of gestural interaction techniques is now available. In this article, we use a new taxonomic space [18] as a comparative structure to analyze the applicability of these techniques on automotive environment. The taxonomy plots a gestural interaction technique as a point in a space where the vertical axis denotes the semantic coverage of the technique, and the horizontal axis expresses the physical actions users are engaged in. In addition, syntactic modifiers are used to express the interpretation process of input tokens into semantics, as well as pragmatic modifiers to make explicit the level of indirections between users actions and system responses. In the taxonomy, the complexity of the gestural interaction lexicon, and the syntactic/pragmatic modifiers it is decorated with, are indexes of the cognitive load users are engaged in during the interaction. The integration of modern mobile devices, complex user interfaces and gestural interaction techniques into automotive environment rise the necessity to analyze gestural interaction technique from their cognitive load point of view

A novel Taxonomy for Gestural Interaction Techniques: Considerations for automotive Environments

4 pagesInternational audienceA large variety of gestural interaction techniques is now available. In this article, we use a new taxonomic space [18] as a comparative structure to analyze the applicability of these techniques on automotive environment. The taxonomy plots a gestural interaction technique as a point in a space where the vertical axis denotes the semantic coverage of the technique, and the horizontal axis expresses the physical actions users are engaged in. In addition, syntactic modifiers are used to express the interpretation process of input tokens into semantics, as well as pragmatic modifiers to make explicit the level of indirections between users actions and system responses. In the taxonomy, the complexity of the gestural interaction lexicon, and the syntactic/pragmatic modifiers it is decorated with, are indexes of the cognitive load users are engaged in during the interaction. The integration of modern mobile devices, complex user interfaces and gestural interaction techniques into automotive environment rise the necessity to analyze gestural interaction technique from their cognitive load point of view

Techniques d'interaction gestuelles pour dispositifs mobiles combinant accéléromètres et écrans tactiles multipoints

Dans cette thèse, j'aborde la question de l'interaction gestuelle sur dispositif mobile. Ces dispositifs, à présent communs, se distinguent des ordinateurs conventionnels principalement par leurs périphériques d'interaction avec l'utilisateur (écrans de taille restreinte mais tactiles, capteurs divers tels que les accéléromètres) ainsi que par le contexte dans lequel ils sont utilisés. Le travail que je présente est une exploration du vaste domaine des techniques d'interaction sur ces dispositifs mobiles. Je structure cet espace en me concentrant sur les techniques à base d'accéléromètres pour lesquelles je propose une taxonomie. Son pouvoir descriptif et discriminant est validé par la classification de trente-sept techniques d'interaction de la littérature. La suite de mon travail se penche sur la réalisation de techniques d'interaction gestuelles pour ces dispositifs mobiles. Avec TouchOver, je montre qu'il est possible de tirer parti de manière complémentaire de deux canaux d'entrée (écran tactile et accéléromètres) pour ajouter un état au glissé du doigt, permettant ainsi d'enrichir cette interaction. Enfin, je m'intéresse aux menus sur dispositif mobile et propose une nouvelle forme de menus gestuels. Je présente leur réalisation avec la bibliothèque logicielle GeLATI qui permet leur intégration à une boîte à outils de développement d'interface graphique préexistante. *In this thesis, we address the question of gesture interaction on mobile device. These devices, now common, differ from conventional computers primarily by the input devices the user interact with (screen size small but tactile, various sensors such as accelerometers) as well as the context in which they are used. The work presented here is an exploration of the vast area of interaction techniques on these mobile devices. First we try to structure this space by focusing on the techniques based on accelerometers for which we propose a taxonomy. Its descriptive and discriminant power is validated by and the classification of thirty-seven interaction techniques in the literature. Second we focus on the achievement of gestural interaction techniques for these mobile devices. With TouchOver, we show that it is possible to take advantage of complementary two-channels input (touch screen and accelerometers) to add a state to the finger-drag, thus enriching the interaction. Finally, we focus on mobile device menus and offer a new form of sign language menus. We discuss their implementation with the GeLATI software library that allows their integration into a pre-existing GUI toolkit.SAVOIE-SCD - Bib.électronique (730659901) / SudocGRENOBLE1/INP-Bib.électronique (384210012) / SudocGRENOBLE2/3-Bib.électronique (384219901) / SudocSudocFranceF

TouchOver: Decoupling Positioning from Selection on Touch-based Handheld Devices

Session: Interagir sur supports mobiles (article No 6)National audienceWhen compared to conventional desktop mouse input, touch input on handheld devices suffers from the lack of a main feature: that of a mouseover state that can provide users with dynamic pro-active information. In addition, with touch screens, selection precision is limited by undesired extra finger tracking during finger press and lift movements. We propose TouchOver, a multi-modal input technique for touch-screen accelerometers-enabled handheld devices where positioning is performed with a finger on the touch surface, while selection is triggered by a gentle "tilt forward" of the device. By doing so, TouchOver adds a mouseover-like state and improves selection precision while remaining compatible with existing interaction techniques such as Shift [10] devised to improve precision. Our formal user study shows a significant precision improvement over two other selection techniques as well as a good tradeoff between speed and accuracy