Interaction Tangible sur Table, définitions et modèles

International audienceIn recent years, tangible user interfaces, which imply interactions performed with one or several objects, gain more and more interest in research in Human-Computer Interaction (HCI). The tangible object represents a subject or an action. It acts on the system, as an action in classical user interfaces (e.g,. GUI). Interaction on a table, which is a common furniture in everyday life and used in multiple activities (desktop, coffee table, kitchen table, etc.), opens a new way for research and development in HCI. In this article, we present definitions, models, and key issues elicited from the literature that enable understanding and reasoning about the couple within an interactive system. Then, we propose a framework that allows to characterize applications supported by the couple in a domain-independent manner.Depuis quelques années les interfaces tangibles impliquant des interactions réalisées via un objet (ou plusieurs) prennent de plus en plus d’importance dans les recherches en interaction homme-machine. L’objet tangible représente un sujet ou une action ; l’objet agit sur le système, telle une action sur une interface « classique ». L’interaction sur table, c’est-à-dire sur un meuble présent dans la vie courante et utilisé à diverses fins (bureau, table à manger, table de salon, table bar, etc.), ouvre un champ nouveau de recherche et de développement. La mise en exergue, issue de l’état de l’art, des définitions, modèles et problématiques, permet d’abord d’appréhender le couple (table, objet tangible) au sein d’un système interactif. Puis, nous proposons un cadre qui permet de positionner des applications mettant en oeuvre le couple (table, objet tangible). Le cadre est décrit de manière à être utilisé pour positionner des applications indépendamment du domaine

An MDE-based framework to support the development of Mixed Interactive Systems

International audienceIn the domain of Human Computer Interaction (HCI), recent advances in sensors, communication technologies, miniaturization and computing capabilities have led to new and advanced forms of interaction. Among them, Mixed Interactive Systems (MIS), form a class of interactive systems that comprises augmented reality, tangible interfaces and ambient computing; MIS aim to take advantage of physical and digital worlds to promote a more transparent integration of interactive systems with the user's environment. Due to the constant change of technologies and the multiplicity of these interaction forms, specific development approaches have been developed. As a result, numerous taxonomies, frameworks, API and models have emerged, each one covering a specific and limited aspect of the development of MIS. To support a coherent use of these multiple development resources and contribute to the increasing popularity of MIS, we have developed a framework based on Model-Driven Engineering. The goal is to take advantage of Model-Driven Engineering (MDE) standards, methodology and tools to support the manipulation of complementary Domain Specific Languages (DSL), to organize and link the use of different design and implementation resources, and to ensure a rationalized implementation based on design choices. In this paper, we first summarize existing uses of MDE in HCI before focusing on five major benefits MDE can provide in a MIS development context. We then detail which MDE tools and resources support these benefits and thus form the pillars of the success of an MDE-based MIS development approach. Based on this analysis, we introduce our framework, called Guide-Me, and illustrate its use through a case study. This framework includes two design models. Model transformations are also included to link one model to another; as a result the frameworks coverage extends from the earliest design step to a software component-based prototyping platform. A toolset based on Eclipse Modeling Framework (EMF) that supports the use of the framework is also presented. We finally assess our MDE-based development process for MIS based on the five major MDE benefits for MIS

OP: A Novel Programming Model for Integrated Design and Prototyping of Mixed Objects

Part 1: Long and Short PapersInternational audienceIn the context of mixed systems that seek to smoothly merge physical and digital worlds, designing and prototyping interaction involves physical and digital aspects of mixed objects. However, even though mixed objects are recurrent in the literature, none of the existing prototyping tools explicitly supports this object level. Moreover, designers have to use distinct tools, on the one hand, tools for designing ideas and on the other hand tools for prototyping them: this makes the design process difficult. To help alleviate these two problems, we present OP (Object Prototyping), a toolkit that provides a new programming model focusing on mixed objects and allows us to seamlessly go back and forth from conceptual ideas to functional physical prototypes, making the iterative design process smooth and integrated. Indeed, OP is explicitly based on an existing conceptual design model, namely the Mixed Interaction Model that has been shown to be useful for exploring the design space of mixed objects. Our user studies show that, despite its threshold, designers and developers using OP can rapidly prototype functional physical objects as part of a design process deeply intertwining conceptual design with prototyping activities

Rapid prototyping of ubiquitous computing environments

Tese de doutoramento em InformáticaUbiquitous computing raises new usability challenges that cut across design and development. We are particularly interested in environments enhanced with sensors, public displays and personal devices. How can prototypes be used to explore the users' mobility and interaction, both explicitly and implicitly, to access services within these environments? Because of the potential cost of development and design failure, these systems must be explored using early assessment techniques and versions of the systems that could disrupt if deployed in the target environment. These techniques are required to evaluate alternative solutions before making the decision to deploy the system on location. This is crucial for a successful development, that anticipates potential user problems, and reduces the cost of redesign. This thesis reports on the development of a framework for the rapid prototyping and analysis of ubiquitous computing environments that facilitates the evaluation of design alternatives. It describes APEX, a framework that brings together an existing 3D Application Server with a modelling tool. APEX-based prototypes enable users to navigate a virtual world simulation of the envisaged ubiquitous environment. By this means users can experience many of the features of the proposed design. Prototypes and their simulations are generated in the framework to help the developer understand how the user might experience the system. These are supported through three different layers: a simulation layer (using a 3D Application Server); a modelling layer (using a modelling tool) and a physical layer (using external devices and real users). APEX allows the developer to move between these layers to evaluate different features. It supports exploration of user experience through observation of how users might behave with the system as well as enabling exhaustive analysis based on models. The models support checking of properties based on patterns. These patterns are based on ones that have been used successfully in interactive system analysis in other contexts. They help the analyst to generate and verify relevant properties. Where these properties fail then scenarios suggested by the failure provide an important aid to redesign.A computação ubíqua levanta novos desafios de usabilidade transversais ao seu desenvolvimento e design. Estamos particularmente interessados em ambientes enriquecidos com sensores, ecrãs públicos e dispositivos pessoais e em saber como podem ser utilizados protótipos na exploração da mobilidade e interação, implícita e explicita, dos utilizadores de forma a acederem a serviços desses ambientes. Devido às potenciais falhas do design proposto e aos elevados custos associados ao seu desenvolvimento, as características destes sistemas devem ser exploradas utilizando versões preliminares dos mesmos dado que estes podem vir a falhar quando implementados no destino, tornando a sua utilização inaceitável. Essas técnicas são necessárias por forma a avaliar soluções alternativas antes de decidir implementar o sistema fisicamente. Isto é crucial para um desenvolvimento com sucesso que antecipe potencias problemas do utilizador e reduza os custos de redesign. Esta tese descreve o desenvolvimento de uma ferramenta para a prototipagem rápida e análise de ambientes de computação ubíqua como suporte à avaliação de designs alternativos. É apresentado a APEX, uma plataforma que junta um servidor de aplicações 3D com uma ferramenta de modelação. Os protótipos baseados na APEX permitem aos seus utilizadores finais navegarem numa simulação 3D do ambiente ubíquo projetado. Desta forma muitas das características do design proposto podem ser experienciadas pelos utilizadores. Os protótipos e respetivas simulações são gerados na plataforma para ajudar os designers/developers a entender como é que os utilizadores podem experienciar o sistema. Os protótipos são suportadas através de três camadas: a camada de simulação (utilizando um servidor de aplicações 3D); a camada de modelação (utilizando uma ferramenta de modelação) e uma camada física (utilizando dispositivos externos e utilizadores reais). A plataforma possibilita aos designers/ developers moverem-se entre estas camadas de forma a avaliar diferentes características do sistema, desde a experiencia do utilizador até ao seu comportamento através de uma analise exaustiva do sistema ubíquo baseada em modelos. Os modelos suportam a verificação de propriedades baseadas em padrões. Estes padrões são baseados em padrões existentes e já utilizados com sucesso, noutros contextos, na análise de sistemas interativos. Eles auxiliam a geração e verificação de propriedades relevantes. O local onde estas propriedade falham sugere um cenário de falha que fornece uma ajuda importante no redesign do sistema.ERDF through the Programme COMPETE and by the Portuguese Government through FCT - Foundation for Science and Technology, project PTDC/EIA-EIA/116069/2009 and by FCT, under the grant SFRH/BD/41179/2007

Rapid prototyping of ubiquitous computing environments

Ubiquitous computing raises new usability challenges that cut across design and development. We are particularly interested in environments enhanced with sensors, public displays and personal devices. How can prototypes be used to explore the users' mobility and interaction, both explicitly and implicitly, to access services within these environments? Because of the potential cost of development and design failure, these systems must be explored using early assessment techniques and versions of the systems that could disrupt if deployed in the target environment. These techniques are required to evaluate alternative solutions before making the decision to deploy the system on location. This is crucial for a successful development, that anticipates potential user problems, and reduces the cost of redesign. This thesis reports on the development of a framework for the rapid prototyping and analysis of ubiquitous computing environments that facilitates the evaluation of design alternatives. It describes APEX, a framework that brings together an existing 3D Application Server with a modelling tool. APEX-based prototypes enable users to navigate a virtual world simulation of the envisaged ubiquitous environment. By this means users can experience many of the features of the proposed design. Prototypes and their simulations are generated in the framework to help the developer understand how the user might experience the system. These are supported through three different layers: a simulation layer (using a 3D Application Server); a modelling layer (using a modelling tool) and a physical layer (using external devices and real users). APEX allows the developer to move between these layers to evaluate different features. It supports exploration of user experience through observation of how users might behave with the system as well as enabling exhaustive analysis based on models. The models support checking of properties based on patterns. These patterns are based on ones that have been used successfully in interactive system analysis in other contexts. They help the analyst to generate and verify relevant properties. Where these properties fail then scenarios suggested by the failure provide an important aid to redesign.Fundação para a Ciência e Tecnologi