International audienceIn the technologic and scientific fields connected to Enactive Interfaces, the term mapping is used in a variety of situations, with various meanings. Here, the mapping's domain is the human gesture, or more precisely a data stream acquired from a gesture transducer, and the mapping's codomain is the computer process. Also, one defines a mapping strategy as a set of general guidelines and instructions useful to design the mapping

Castagné, Nicolas

Lagarde, Julien

Hal - Université Grenoble Alpes

Mapping, in human-computer systemsNicolas Castagne´, Julien LagardeTo cite this version:Nicolas Castagne´, Julien Lagarde. Mapping, in human-computer systems. Enaction and en-active interfaces : a handbook of terms, Enactive System Books, pp.192-194, 2007. <hal-00977557v2>HAL Id: hal-00977557https://hal.archives-ouvertes.fr/hal-00977557v2Submitted on 11 Apr 2014HAL is a multi-disciplinary open accessarchive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come fromteaching and research institutions in France orabroad, or from public or private research centers.L’archive ouverte pluridisciplinaire HAL, estdestine´e au de´poˆt et a` la diffusion de documentsscientifiques de niveau recherche, publie´s ou non,e´manant des e´tablissements d’enseignement et derecherche franc¸ais ou e´trangers, des laboratoirespublics ou prive´s.Enaction and Enactive Interfaces: A Handbook of Terms 3 !7$88'#9:!'#!;<6$#=%(68<&+-!/>/&+6/!Nicolas Castagne [ACROE&INPG] Julien Lagarde [EDM-UM1] Contributors: Giovanna Varni [DIST] In the technologic and scientific fields connected to Enactive Interfaces, the term mapping is used in a variety of situations, with various meanings. These cover for example the very technical memory mapped protocol (mmap) for inputs/outputs of a computer CPU from/to its devices, the data mapping between data models or categories of data (for an example, see !! "#$%&%'()%#$*), the mapping between different modalities, etc. This item deals with another category of mapping particularly important in the context of Enactive Interfaces: the mapping of hu-man gestures onto a computer process. It is provided in the continuity of the theoretical definition in !! +(,,%$-*. Here, the mapping’s domain is the human gesture, or more pre-cisely a data stream acquired from a gesture transducer, and the mapping’s codomain is the computer process. Also, one defines a mapping strategy as a set of general guide-lines and instructions useful to design the mapping. The choice of an appropriate map-ping strategy is particularly important, and difficult. This being said, the item reviews such hu-man gesture mapping in three more specific cases. Mapping (of human gesture) in HCI In classical human computer interaction, and more generally in ergonomics, the map-ping concept has long been seen as being of a major importance. Hence, in [Norman, 88], mapping, and associated mapping strategies, are presented as one of the 5 most important things to carefully consider when designing a system usable by a human being (either a graphical computer interface, a telephone, a plane cockpit, etc.), along with mental mod-els, affordances !! .&&#/0($'12*, constraints and visibility/feedback. Examples of well-designed mapping are the mapping of wheel to power steering in cars (it is easy to learn…), and the logarith-mic-based mapping of the potentiometer to the power in audio amplifiers (which is well adapted to loudness, i.e. to the human per-ception of sound power). In the case of traditional man-computer interfaces, especially graphical interfaces, the domain is typically made of the mouse trajec-tories, or further of the motion of a graphical slider (or more generally widget) that accom-panies the mouse on screen, and the codo-main is the interface at hand, or more precisely various of the state parameters of the core system above which the interface is built. Here, the chosen mapping strategy not only affect the naturalness of the handling of the interface through the relatively poor device available (keyboard and mouse). In some case, it can also dramatically reduce the complexity of the whole interface. For exam-ple, implementing a well-chosen mapping can allow replacing numerous sliders, each of which would control a unique parameter in the system, by a unique control which state is mapped onto various parameters in the model (through a one-to-N mapping), allow-ing obtaining the desired effect much more easily. Mapping, when using Motion Capture In this context, mapping comes as an issue when interfaces are used to map the motion of particular points of the body onto an artificial display. Here, the mapping’s domain is made of the moving points trajectories captured on the real body in earth frame, and the codomain is the motion in the virtual space in the interface. 4 Enaction and Enactive Interfaces: A Handbook of Terms To design the mapping, the designer has first to choose specific points on the body, that could be end effectors or limbs, or joints, or any variable calculated from these basic elements. Second a particular mapping strategy has to be defined. The mapping strategy may, for example, map the captured points in a smaller or a larger dimensional space (e.g., a surface instead of a volume), delayed or not in time, via a possible transformation linear or non linear, keeping or not symmetry, keeping or not redundancy of the original inputs, scal-ing, etc. One can also imagine mapping onto a different space, for example from physical space to phase space. In this context, the possibility of an adap-tation (of the user) to mapping is an import-ant issue. The study of adaptation to such mappings is classical in experimental psychology and neurosciences. It originates in the study of adaptation to prismatic goggles that imposed a constant angle rotation of the environment, enabling a new spatial relationship between the “non rotated” tactile or proprioceptive information and the rotated visual layout. However, this area of study still lacks a sys-tematic or theoretical treatment, and the effects of variation in mappings are often underestimated. Particular mappings of body motion onto visual interfaces quite systematically changed the measured behavioural adaptation (which led to misunderstand divergent results be-tween apparently similar experiments) and sometimes simplified notably the learning and execution of otherwise difficult coordi-nation tasks [Flaugloire et al, 2004] [Mechsner et al, 2001] [Swinnen, 1996] [Swinnen et al 1997]. This line of research may well pave the way for rehabilitation interfaces. Mapping, in the context of Synthesis Mapping is also a very important issue in computer-based (sound and/or visual) syn-thesis. Here, the domain is the gesture signal sensed on a gesture device (a musical key-board, a motion capture system, etc.), and to codomain is made of the parameters of the synthesis model at hand. In this context, the concept of mapping is progressively made more and more objective, as a new area of research toward better (more expressive, more interesting, more diverse, etc.) synthesis systems. The item “mapping, in digital musical instruments” discusses further the various benefits of the mapping concepts in the case of digital musical in-struments, but can be generalized from sound synthesis to the general case of synthe-sis !! +(,,%$-34%$40%-%)(54672%'(54%$2)/761$)2*. However, despites the substantial benefits of the generalization of the mapping para-digm, a couple of drawbacks can be dis-cussed. The item “mapping and control vs. instrumental interaction” goes further on this discussion !! +(,,%$-4 ($04 '#$)/#54 8294 %$2)/761$)(54%$)1/(')%#$*. ?+.+-+#%+/![Faugloire&al, 2004] Faugloire, E., Bardy, B. G., Merhi, O., & Stoffregen, T.A (2004). Exploring coordination dynamics of the postural system with real-time visual feedback. Neuroscience Letters, 374, 136-141. [Mechsner &al, 2001] Mechsner, F., Kerzel, D., Knoblich, G., Prinz, W. (2001). Perceptual basis of bimanual coordination. Nature, 414:69-73. [Norman, 1988] Norman, DA : The Psychology of Everyday Things – Basic Book, New-York – 1988. – Réédité en 1990 sous le titre : The Design of Everyday Things, Doubleday, 1990. [Swinnen, 1996] Swinnen, S. P. (1996). Information feedback for motor skill learning: A review. In H. N. Zelaznik (Ed.), Advances in motor learning and control (pp. 37-66). Champaign, Il.: Human Kinetics. [Swinnen&al, 1997] Swinnen, S. P., Lee, T. D., Verschueren, S., Serrien, D.J. & Bogaerds, H. (1997). Interlimb coordination: Learning and transfer under different feedback conditions. Human Movement Science, 16, 749-785. ?+@$&+)!'&+6/!.&&#/0($'124:76($4'#6,7)1/4%$)1/(')%#$4+(,,%$-4+(,,%$-4($04'#$)/#548294%$2)/761$)(54%$)1/(')%#$4+(,,%$-34%$40%-%)(54672%'(54%$2)/761$)24"#$%&%'()%#$44

Mapping, in human-computer systems

https://hal.archives-ouvertes.fr/hal-00977557

Mapping, in human-computer systems

Abstract

Similar works

Full text

Available Versions

Hal - Université Grenoble Alpes