Essai sans prétention sur l'Interaction Homme-Machine et son évolution

National audienceCet article est une réflexion personnelle sur l'Interaction Homme-Machine, domaine auquel j'ai contribué à petits pas depuis une bonne trentaine d'années. Il s'agit donc d'une analyse incomplète et nécessairement biaisée. Mes amis informaticiens, qu'ils soient académiques ou industriels, ont (trop) longtemps sous-estimé le rôle de l'Interaction Homme-Machine dans les processus de développement des logiciels. Cet article est une réponse à ce constat

Essai sans prétention sur l'Interaction Homme-Machine et son évolution

National audienceCet article est une réflexion personnelle sur l'Interaction Homme-Machine, domaine auquel j'ai contribué à petits pas depuis une bonne trentaine d'années. Il s'agit donc d'une analyse incomplète et nécessairement biaisée. Mes amis informaticiens, qu'ils soient académiques ou industriels, ont (trop) longtemps sous-estimé le rôle de l'Interaction Homme-Machine dans les processus de développement des logiciels. Cet article est une réponse à ce constat

Adapting Multi-touch Systems to Capitalise on Different Display Shapes

The use of multi-touch interaction has become more widespread. With this increase of use, the change in input technique has prompted developers to reconsider other elements of typical computer design such as the shape of the display. There is an emerging need for software to be capable of functioning correctly with different display shapes. This research asked: ‘What must be considered when designing multi-touch software for use on different shaped displays?’ The results of two structured literature surveys highlighted the lack of support for multi-touch software to utilise more than one display shape. From a prototype system, observations on the issues of using different display shapes were made. An evaluation framework to judge potential solutions to these issues in multi-touch software was produced and employed. Solutions highlighted as being suitable were implemented into existing multi-touch software. A structured evaluation was then used to determine the success of the design and implementation of the solutions. The hypothesis of the evaluation stated that the implemented solutions would allow the applications to be used with a range of different display shapes in such a way that did not leave visual content items unfit for purpose. The majority of the results conformed to this hypothesis despite minor deviations from the designs of solutions being discovered in the implementation. This work highlights how developers, when producing multi-touch software intended for more than one display shape, must consider the issue of visual content items being occluded. Developers must produce, or identify, solutions to resolve this issue which conform to the criteria outlined in this research. This research shows that it is possible for multi-touch software to be made display shape independent

Estudo e aplicação de paradigmas multitoque no interface humano-computador de um sistema SCADA

Trabalho realizado na Efacec, sob a orient. do Eng.º Cláudio SilvaTese de Mestrado Integrado. Engenharia Informática e Computação. Universidade do Porto. Faculdade de Engenharia. 201

Designing Discoverable Digital Tabletop Menus for Public Settings

Ease of use with digital tabletops in public settings is contingent on how well the system invites and guides interaction. The same can be said for the interface design and individual graphical user interface elements of these systems. One such interface element is menus. Prior to a menu being used however, it must first be discovered within the interface. Existing research pertaining to digital tabletop menu design does not address this issue of discovering or opening a menu. This thesis investigates how the interface and interaction of digital tabletops can be designed to encourage menu discoverability in the context of public settings. A set of menu invocation designs varying on the invocation element and use of animation are proposed. These designs are then evaluated through an observational study at a museum to observe users interactions in a realistic public setting. Findings from this study propose the use of discernible and recognizable interface elements – buttons – supported by the use of animation to attract and guide users as a discoverable menu invocation design. Additionally, findings posit that when engaging with a public digital tabletop display, users transition through exploration and discovery states before becoming competent with the system. Finally, insights from this study point to a set of design recommendations for improving menu discoverability

Interactions gestuelles multi-point et géométrie déformable pour l’édition 3D sur écran tactile

Despite the advances made in the fields of existing objects capture and of procedural generation, creation of content for virtual worlds can not be perform without human interaction. This thesis suggests to exploit new touch devices ("multi-touch" screens) to obtain an easy, intuitive 2D interaction in order to navigate inside a virtual environment, to manipulate, position and deform 3D objects.First, we study the possibilities and limitations of the hand and finger gestures while interacting on a touch screen in order to discover which gestures are the most adapted to edit 3D scene and environment. In particular, we evaluate the effective number of degrees of freedom of the human hand when constrained on a planar surface. Meanwhile, we develop a new gesture analysis method using phases to identify key motion of the hand and fingers in real time. These results, combined to several specific user-studies, lead to a gestural design pattern which handle not only navigation (camera positioning), but also object positioning, rotation and global scaling. Then, this pattern is extended to complex deformation (such as adding and deleting material, bending or twisting part of objects, using local control). Using these results, we are able to propose and evaluate a 3D world editing interface that handle a naturaltouch interaction, in which mode selection (i.e. navigation, object positioning or object deformation) and task selections is automatically processed by the system, relying on the gesture and the interaction context (without any menu or button). Finally, we extend this interface to integrate more complex deformations, adapting the garment transfer from a character to any other in order to process interactive deformation of the garment while the wearing character is deformed.Malgré les progrès en capture d’objets réels et en génération procédurale, la création de contenus pour les mondes virtuels ne peut se faire sans interaction humaine. Cette thèse propose d’exploiter les nouvelles technologies tactiles (écrans "multi-touch") pour offrir une interaction 2D simple et intuitive afin de naviguer dans un environnement virtuel, et d’y manipuler, positionner et déformer des objets 3D.En premier lieu, nous étudions les possibilité et les limitations gestuelles de la main et des doigts lors d’une interaction sur écran tactile afin de découvrir quels gestes semblent les plus adaptés à l’édition des environnements et des objets 3D. En particulier, nous évaluons le nombre de degré de liberté efficaces d’une main humaine lorsque son geste est contraint à une surface plane. Nous proposons également une nouvelle méthode d’analyse gestuelle par phases permettant d’identifier en temps réel les mouvements clés de la main et des doigts. Ces résultats, combinés à plusieurs études utilisateur spécifiques, débouchent sur l’identification d’un patron pour les interactions gestuelles de base incluant non seulement navigation (placement de caméra), mais aussi placement, rotation et mise à l’échelle des objets. Ce patron est étendudans un second temps aux déformations complexes (ajout et suppression de matière ainsi que courbure ou torsion des objets, avec contrôle de la localité). Tout ceci nous permet de proposer et d’évaluer une interface d’édition des mondes 3D permettant une interaction tactile naturelle, pour laquelle le choix du mode (navigation, positionnement ou déformation) et des tâches correspondantes est automatiquement géré par le système en fonction du geste et de son contexte (sans menu ni boutons). Enfin, nous étendons cette interface pour y intégrer des déformations plus complexe à travers le transfert de vêtements d’un personnage à un autre, qui est étendu pour permettre la déformation interactive du vêtement lorsque le personnage qui le porte est déformé par interaction tactile

タブレット端末で用いられるノートアプリケーションのためのメニューデザイン

筑波大学 (University of Tsukuba)201

On the critical role of the sensorimotor loop on the design of interaction techniques and interactive devices

People interact with their environment thanks to their perceptual and motor skills. This is the way they both use objects around them and perceive the world around them. Interactive systems are examples of such objects. Therefore to design such objects, we must understand how people perceive them and manipulate them. For example, haptics is both related to the human sense of touch and what I call the motor ability. I address a number of research questions related to the design and implementation of haptic, gestural, and touch interfaces and present examples of contributions on these topics. More interestingly, perception, cognition, and action are not separated processes, but an integrated combination of them called the sensorimotor loop. Interactive systems follow the same overall scheme, with differences that make the complementarity of humans and machines. The interaction phenomenon is a set of connections between human sensorimotor loops, and interactive systems execution loops. It connects inputs with outputs, users and systems, and the physical world with cognition and computing in what I call the Human-System loop. This model provides a complete overview of the interaction phenomenon. It helps to identify the limiting factors of interaction that we can address to improve the design of interaction techniques and interactive devices.Les humains interagissent avec leur environnement grâce à leurs capacités perceptives et motrices. C'est ainsi qu'ils utilisent les objets qui les entourent et perçoivent le monde autour d'eux. Les systèmes interactifs sont des exemples de tels objets. Par conséquent, pour concevoir de tels objets, nous devons comprendre comment les gens les perçoivent et les manipulent. Par exemple, l'haptique est à la fois liée au sens du toucher et à ce que j'appelle la capacité motrice. J'aborde un certain nombre de questions de recherche liées à la conception et à la mise en œuvre d'interfaces haptiques, gestuelles et tactiles et je présente des exemples de contributions sur ces sujets. Plus intéressant encore, la perception, la cognition et l'action ne sont pas des processus séparés, mais une combinaison intégrée d'entre eux appelée la boucle sensorimotrice. Les systèmes interactifs suivent le même schéma global, avec des différences qui forme la complémentarité des humains et des machines. Le phénomène d'interaction est un ensemble de connexions entre les boucles sensorimotrices humaines et les boucles d'exécution des systèmes interactifs. Il relie les entrées aux sorties, les utilisateurs aux systèmes, et le monde physique à la cognition et au calcul dans ce que j'appelle la boucle Humain-Système. Ce modèle fournit un aperçu complet du phénomène d'interaction. Il permet d'identifier les facteurs limitatifs de l'interaction que nous pouvons aborder pour améliorer la conception des techniques d'interaction et des dispositifs interactifs

Innovative ICT solutions in telemedicine to support clinical practice and research in hospitals

2010/2011The scope of this study was to examine ICT telemedicine innovations and potentialities in web-portals, intranet services and tele-radiology topics respectively, in order to design, develop and, possibly, realize apposite telemedicine systems and solutions for healthcare and in particular for the hospitals. ICT techniques and technologies are nowadays applied in every area of our common living from work places to our homes, our free-time, schools, universities and so on. The healthcare services offered by hospitals are heavily supported by technologies and, behind them, by a wide research both in ICT and biomedical sciences. Thanks to these advances telemedicine is now becoming a fundamental part of services offered by hospitals and healthcare structures. The healthcare management, the doctors and the common people are now experimenting how telemedicine is an added value to all the services offered in terms of the quality of care, the patient follow up, the early diagnose and treatment of pathologies and diseases. In this research is presented an all-inclusive approach to telemedicine problems and challenges in particular studying, developing and proposing ICT methods and technologies in the above mentioned three areas of interest: •innovative healthcare and telemedicine-ready hospital website or portal design and development; •analysis and study of models for the realization of intranet healthcare services to enhance both quality of care and the management of healthcare personnel evaluation; •tele-radiology and some of its actual new perspectives as the study and the evaluation of the “mobile” tele-radiology approach using commercial tablets (and what it could mean).For the first topic the results may be summarized in the development of a more interactive and “social” hospital web-portal offering original solutions and services to all the categories of users (audience, professionals, researchers), allowing them – through the use of advanced tools - to configure and select their own pages and interests. The originality of this approach consists in a good cost/effective result in the respect of the last and worldwide accepted Internet regulations and policies too. A similar approach regarded the intranet services and the design of web interfaces for the clinical practice and the executive evaluation. These kind of innovative systems regard a limited and selected number of more skilled users, typically belonging to a corporation or to specific offices. As above the approach is important: interactive services, innovative tools and affordable instruments are the keywords of the systems designed or proposed to solve specific problems or needs. The last research topic concerned the proposal of a protocol for the assessment of medical images on commercial displays, interesting the stakeholders and the groups involved in medical images treatment, visualization and communication. The potentialities of the mobile tablet devices improve day after day and new devices are marketed every week and the innovation is round the corner. These potentialities must encounter the medical diagnostics world and meet the standards and the regulations the international community established. It will be difficult for a commercial tablet to obtain the medical device CE mark not only for commercial reasons, but the technical limits may be reached and even surpassed adopting objective measures and evaluations. This study demonstrates that commercial tablets may be used in clinical practice for the correct visualization and diagnose of medical images. The measures of some display characteristics may be considered acceptable for mobile interpretation (even report?) of medical images, but if and only if the ambient lighting conditions are under objective control and integrated automated systems in tablets warns physicians about bad or borderline technical and ambient restrictions or bonds.XXIII Ciclo197