The design-by-adaptation approach to universal access: learning from videogame technology

This paper proposes an alternative approach to the design of universally accessible interfaces to that provided by formal design frameworks applied ab initio to the development of new software. This approach, design-byadaptation, involves the transfer of interface technology and/or design principles from one application domain to another, in situations where the recipient domain is similar to the host domain in terms of modelled systems, tasks and users. Using the example of interaction in 3D virtual environments, the paper explores how principles underlying the design of videogame interfaces may be applied to a broad family of visualization and analysis software which handles geographical data (virtual geographic environments, or VGEs). One of the motivations behind the current study is that VGE technology lags some way behind videogame technology in the modelling of 3D environments, and has a less-developed track record in providing the variety of interaction methods needed to undertake varied tasks in 3D virtual worlds by users with varied levels of experience. The current analysis extracted a set of interaction principles from videogames which were used to devise a set of 3D task interfaces that have been implemented in a prototype VGE for formal evaluation

Informing the design of a multisensory learning environment for elementary mathematics learning

It is well known that primary school children may face difficulties in acquiring mathematical competence, possibly because teaching is generally based on formal lessons with little opportunity to exploit more multisensory-based activities within the classroom. To overcome such difficulties, we report here the exemplary design of a novel multisensory learning environment for teaching mathematical concepts based on meaningful inputs from elementary school teachers. First, we developed and administered a questionnaire to 101 teachers asking them to rate based on their experience the learning difficulty for specific arithmetical and geometrical concepts encountered by elementary school children. Additionally, the questionnaire investigated the feasibility to use multisensory information to teach mathematical concepts. Results show that challenging concepts differ depending on children school level, thus providing a guidance to improve teaching strategies and the design of new and emerging learning technologies accordingly. Second, we obtained specific and practical design inputs with workshops involving elementary school teachers and children. Altogether, these findings are used to inform the design of emerging multimodal technological applications, that take advantage not only of vision but also of other sensory modalities. In the present work, we describe in detail one exemplary multisensory environment design based on the questionnaire results and design ideas from the workshops: the Space Shapes game, which exploits visual and haptic/proprioceptive sensory information to support mental rotation, 2D–3D transformation and percentages. Corroborating research evidence in neuroscience and pedagogy, our work presents a functional approach to develop novel multimodal user interfaces to improve education in the classroom

Design of a 2-DoF Haptic Device for Motion Guidance

International audienceWe present a 2-degrees-of-freedom (2-DoF) haptic device, which can be either used as a grounded or a hand-held device. It is composed of two platforms moving with respect to each other, actuated by two servomotors housed in one of structures. The device implements a rigid coupling mechanism between the two platforms, based on a threelegged 3-4R constrained parallel linkage, with the two servomotors actuating two of these legs. The device can apply position/kinesthetic haptic feedback to the user hand(s). This paper presents the device and its kinematics, together with a human subjects experiment where we evaluate its capabilities to provide meaningful directional information

Haptic Guidance for Extended Range Telepresence

A novel navigation assistance for extended range telepresence is presented. The haptic information from the target environment is augmented with guidance commands to assist the user in reaching desired goals in the arbitrarily large target environment from the spatially restricted user environment. Furthermore, a semi-mobile haptic interface was developed, one whose lightweight design and setup configuration atop the user provide for an absolutely safe operation and high force display quality

The design-by-adaptation approach to universal access: learning from videogame technology

This paper proposes an alternative approach to the design of universally accessible interfaces to that provided by formal design frameworks applied ab initio to the development of new software. This approach, design-byadaptation, involves the transfer of interface technology and/or design principles from one application domain to another, in situations where the recipient domain is similar to the host domain in terms of modelled systems, tasks and users. Using the example of interaction in 3D virtual environments, the paper explores how principles underlying the design of videogame interfaces may be applied to a broad family of visualization and analysis software which handles geographical data (virtual geographic environments, or VGEs). One of the motivations behind the current study is that VGE technology lags some way behind videogame technology in the modelling of 3D environments, and has a less-developed track record in providing the variety of interaction methods needed to undertake varied tasks in 3D virtual worlds by users with varied levels of experience. The current analysis extracted a set of interaction principles from videogames which were used to devise a set of 3D task interfaces that have been implemented in a prototype VGE for formal evaluation

Haptics: Science, Technology, Applications

This open access book constitutes the proceedings of the 12th International Conference on Human Haptic Sensing and Touch Enabled Computer Applications, EuroHaptics 2020, held in Leiden, The Netherlands, in September 2020. The 60 papers presented in this volume were carefully reviewed and selected from 111 submissions. The were organized in topical sections on haptic science, haptic technology, and haptic applications. This year's focus is on accessibility

Learnability makes things click : a grounded theory approach to the software product evaluation

The aim of this doctoral dissertation is to investigate the phenomenon of learnability more deeply in order to better understand the learnability process. Grounded theory was used to determine the ground concepts based on fifteen users’ (N=15) actions (N=1836) in the WebCT Campus Edition’s virtual environment. Based on this study, the phenomenon of learnability and the learnability process is understood in greater detail and defined from the human centric of view, where the human being is the key actor. This doctoral dissertation answers the following research problem: 1. How learnable is the WebCT Campus Edition’s virtual environment? 2. How can the phenomenon of learnability be defined in a new way? The WebCT Campus Edition virtual environment’s learnability was measured with performance time and directions of action. In addition, the traditional learnability metrics of performance time and direction of users’ actions was used to verify the theoretical model of learnability and its nonlinearity. The result of this study showed that the variety of the WebCT Campus Edition’s learnability was higher between the individual users than it was between the different tasks. Therefore, the variety of task difficulty, i.e. the complexity or easiness of the different part of the user interface, have less influence on learnability in the WebCT Campus Edition than do the individual users’characteristics. Thus, the research results confirm the results found in earlier studies, where two important issues for usability evaluation and therefore evaluation on learnability, are the tasks and users individual characteristics. The theoretical model of learnability with following phases of information search, data collection, knowledge management, knowledge form, knowledge build and the result of action were determined from data. The theoretical model of learnability and its main patterns of a) data collection-information search, b)knowledge build-knowledge form and c) information searchknowledge management proves that learnability is a non-linear process. Therefore, the phenomenon of learnability cannot purely be defined by the separate properties of learnability, i.e. the properties of a user interface and a progressively enhanced linear process illustrated with learning curves. The theoretical model of learnability is one of the rare models of learnability that is based on empirical data. The use of grounded theory methodology means that the phenomenon of learnability is studied through tacit knowledge, i.e. through users’ real actions and though explicit knowledge, the users cognitive processes during interaction i.e. the phenomenon of learnability is approached from the holistic point of view, where the phenomenon of learnability is seen as one holistic process. Thus triangulation, where the phenomenon is interpreted through several split case studies are therefore unnecessary in this research setting. In conclusion, too many studies are still conducted in a laboratory situation using traditional methodological paradigms. More learnability studies with new methodological approaches in the natural environments are needed were the human, learning and non-linear process of learnability are in focus. It is important to understand more deeply the process of learnability and investigate more in greater detail the key elements that enhance learnability and on the other hand, cause learnability problems for users. Finally, based on the theoretical models of learnability, we can develop tools for the commercial user interface world in order to measure and test the learnability process more precisely and better understand how skills are actually learnt and how “to click” learnability

Multisensory learning in adaptive interactive systems

The main purpose of my work is to investigate multisensory perceptual learning and sensory integration in the design and development of adaptive user interfaces for educational purposes. To this aim, starting from renewed understanding from neuroscience and cognitive science on multisensory perceptual learning and sensory integration, I developed a theoretical computational model for designing multimodal learning technologies that take into account these results. Main theoretical foundations of my research are multisensory perceptual learning theories and the research on sensory processing and integration, embodied cognition theories, computational models of non-verbal and emotion communication in full-body movement, and human-computer interaction models. Finally, a computational model was applied in two case studies, based on two EU ICT-H2020 Projects, "weDRAW" and "TELMI", on which I worked during the PhD