In the dark – designing navigation for a haptic theatre experience

We describe the ongoing work of a collaborative theatre project, in which blind and sighted members of an interdisciplinary team are working on the creation of an immersive and accessible theatre experience. The theatre experience is set in pitch dark, and uses audio and haptic ubiquitous technologies to guide both blind and sighted members of the audience. During two sessions which explored the use of enactive navigation in the dark space, participants were able to locate areas of interest within the dark, using enactive explorative navigation, and some participants described this as a ‘dense’ experience

The mobile Oracle: a tool for early user involvement

This paper describes a novel tool for eliciting user requirements early in the design process of mobile applications. The "Mobile Oracle", as we have called it, is intended to help developers and designers obtain a better understanding of what the user wants at different points in space and time. It is an extension of a lo-fi version of the well-established Wizard of Oz technique, but it adds an "on demand" component to force users to explicitly request the information they need. The technique has been tested in an investigation involving 15 users (sighted, visually impaired, and elderly). Our preliminary results show it to generate valuable information concerning the ways people ask about directions and distances, as well as the services they would like to have in future mobile applications

Providing tablets as collaborative task workspace for human-robot interaction

©2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.Presented at the 8th ACM/IEEE International Conference on Human-robot Interaction, HRI '13, Tokyo, Japan, March 3-6, 2013.In a recent conference on assistive technology in special education and rehabilitation, over 54 percentage of the sessions were directly or indirectly involved with tablets. Following this trend, many traditional assistive technologies are now transitioning from standalone devices into apps on mobile devices. As such, this paper follows this trend by discussing transforming a tablet into an HRI research platform where our robotic system engages the user in social interaction by learning how to operate a given app (task) using guidance from the user. The objective is to engage the robot within the context of the user's task by understanding the task's underlying rules and structures. An overview of the HRI toolkit is presented and a knowledge-based approach in modeling a task is discussed where previously learned cases are reused to solve a new problem

An investigation into virtual objects learning by using haptic interface for visually impaired children

Children play, touch, see and listen in order to build the foundation for later learning stage of solving problems and understanding themselves within the world surrounding them. However, visually impaired children have limited opportunities in learning new things compared to normal sighted children who have one of the important senses of a human being. Children gain knowledge through learning, playing, touching, seeing, listening and interacting with things that they are interested in. For visually impaired children, learning is different from normal sighted children in that they cannot go out and play with things without guidance and they are not able to see the picture or video of the things or objects like normal children are. A computer simulated virtual reality environment can provide better opportunities for visually impaired children especially in learning the shapes of new objects. An application utilizing the force feedback technology, i.e. Haptic technology, together with the aid of audio has been developed in this research project. Seven different objects are modelled to create haptic shapes for this application which allows visually impaired users to have a better learning environment and assists them in learning the shapes of different objects and also memorizing the shapes of different objects together with the name. The created application is deployed in a fully equipped computer with a stylus based haptic device and a set of speakers. The new architecture can provide an alternative learning environment for visually impaired children especially in learning the shapes of new objects. Based on the findings of this research, as 79% of the users agreed that virtual reality learning is useful in learning the shapes of new objects, the new architecture creates a significant contribution in a novel research area and assists visually impaired children in continuing their learning process

THE CROSS-SENSORY GLOBE: Co-Designing a 3D Audio-Tactile Globe Prototype for Blind and Low- Vision Users to Learn Geography

This MRP presents a co-operatively and iteratively designed 3D audio-tactile globe that enables blind and low-vision users to perceive geo-spatial information. Blind and low-vision users rely on learning aids such as 2D-tactile graphics, braille maps and 3D models to learn about geography. I employed co-design as an approach to prototype and evaluate four different iterations of a cross-sensory globe that uses 3D detachable continents to provide geo-spatial haptic information in combination with audio labels. Informed by my co-design and evaluation, I discuss cross-sensory educational aids as an alternative to visually-oriented globes. My findings reveal affordances of 3D-tactile models for conveying concrete features of the Earth (such as varying elevations of landforms) and audio labels for conveying abstract categories about the Earth (such as continent names). I highlight the advantages of longitudinal participatory design that includes the lived experiences and DIY innovations of blind and low-vision users and makers

Exploring Future Challenges for Haptic, Audio and Visual Interfaces for Mobile Maps and Location Based Services

In this article we give an overview of some challenges in how to make geospatial information more useable and accessible. We also suggest a roadmap for dealing with these challenges – and introduce a new EU project HaptiMap

Improving accessibility for pederstrians with geographic information

Osajulkaisut: Publication 1: Mari Laakso, Tapani Sarjakoski, and L. Tiina Sarjakoski. 2011. Improving accessibility information in pedestrian maps and databases. Cartographica, volume 46, number 2, pages 101-108. University of Toronto. DOI:10.3138/carto.46.2.101 Publication 2: L. Tiina Sarjakoski, Pyry Kettunen, Hanna-Marika Flink, Mari Laakso, Mikko Rönneberg, and Tapani Sarjakoski. 2012. Analysis of verbal route descriptions and landmarks for hiking. Personal and Ubiquitous Computing, volume 16, number 8, pages 1001-1011. DOI:10.1007/s00779-011-0460-7 Publication 3: Mari Laakso, Tapani Sarjakoski, Lassi Lehto, and L. Tiina Sarjakoski. 2013. An information model for pedestrian routing and navigation databases supporting universal accessibility. Cartographica, volume 48, number 2, pages 89-99. University of Toronto. DOI:10.3138/carto.48.2.1837 Publication 4: Mari Laakso and L. Tiina Sarjakoski. 2010. Sonic maps for hiking—Use of sound in enhancing the map use experience. The Cartographic Journal, volume 47, number 4, pages 300-307. DOI:10.1179/000870410X12911298276237 Publication 5: Mari Laakso, Hanna-Marika Halkosaari, Tapani Sarjakoski, and L. Tiina Sarjakoski. 2013. User experiences with voice-based descriptive map content in a hiking context. In: Thomas Jekel, Adrijana Car, Josef Strobl, and Gerald Griesebner (editors). Creating the GISociety. Proceedings of the GI_Forum 2013 Conference. Salzburg, Austria. 2-5 July 2013. Berlin / Offenbach, Germany. Herbert Wichmann Verlag, VDE Verlag. Pages 49-58. ISBN 978-3-87907-532-4. DOI:10.1553/giscience2013s49Environments can be made more accessible by offering users information about barriers and objects that might hinder their progress, thus enabling more information about accessible routes. The study delineates the relevant geospatial information needed to describe the accessibility of an environment. Even though laws, acts and regulations give thorough building requirements for creating accessible environments, there is no holistic approach in geospatial data collection to represent the accessibility of geographical spaces. In this thesis, an information model is presented for representing the pedestrian environment. The model allows for accessibility issues and enables the use of geospatial information in pedestrian navigation applications. In addition to data contents and data modelling, this research studies how accessibility can be further increased by way of sound when communicating geospatial information. By communicating the geospatial information via sound the information content can be enhanced and usability improved. Sonic maps create remote access to nature and enhance the accessibility of a place. In this thesis, the fundamental aim was to study the information requirements in particular situations where different kinds of pedestrian users determine which route they might successfully complete. The results of the thesis will help data providers collect and store geospatial information, while taking accessibility issues into account, and hopefully it will raise awareness about issues pertaining to universal accessibility. Albeit, the main effort should focus on building accessible environments; in certain situations, people face hindrances and geospatial information could enable users overcome them.Ympäristöistä voidaan tehdä saavutettavampia tarjoamalla käyttäjille tietoa mahdollisista esteistä tai muista kulkua vaikeuttavista kohteista. Tässä tutkimuksessa määritellään tarvittava paikkatieto, jolla jalankulkijan ympäristö ja sen esteettömyys voidaan kuvata. Esteettömien ympäristöjen luomiseksi on olemassa joukko lakeja ja asetuksia, mutta ympäristön esteettömyyden kuvaamiseksi tarvittavalle paikkatiedolle ei ole määritelty kattavaa keräys- ja esitysmuotoa. Tässä väitöskirjassa esitellään tietomalli, jolla jalankulkijan ympäristö ja sen esteettömyys voidaan kuvata. Malliin voidaan sisällyttää esteettömyyttä kuvaavia tietoja ja se mahdollistaa tämän tiedon käytön myös navigointisovelluksilla. Tietosisällön ja sen mallintamisen lisäksi tässä työssä on tutkittu kuinka ympäristön saavutettavuutta voidaan lisätä kommunikoimalla paikkatietoa myös äänen avulla. Äänen avulla voidaan paikkatiedon määrää ja laatua sekä sen käytettävyyttä lisätä. Äänikartoilla voidaan luoda eräänlainen etäyhteys kuvattuun ympäristöön ja sen avulla lisätä ympäristön saavutettavuutta. Tämän väitöskirjan tavoitteena on määrittää erilaisten käyttäjien vaatima paikkatieto tilanteissa, joissa heidän on tehtävä päätös pystyvätkö he kulkemaan valitsemansa reitin. Tämän työn tulokset auttavat paikkatiedon tarjoajia keräämään ja tallentamaan paikkatietoa niin, että se kuvaa myös ympäristön esteettömyyttä. Ympäristöjen esteettömäksi rakentamisen tulisi edelleen olla ensisijainen tavoite, mutta koska jotkut käyttäjät tietyissä tilanteissa edelleen kohtaavat esteettömyysongelmia, heitä voitaisiin paikkatiedon avulla auttaa väistämään ne

Multimodal Content Delivery for Geo-services

This thesis describes a body of work carried out over several research projects in the area of multimodal interaction for location-based services. Research in this area has progressed from using simulated mobile environments to demonstrate the visual modality, to the ubiquitous delivery of rich media using multimodal interfaces (geo- services). To effectively deliver these services, research focused on innovative solutions to real-world problems in a number of disciplines including geo-location, mobile spatial interaction, location-based services, rich media interfaces and auditory user interfaces. My original contributions to knowledge are made in the areas of multimodal interaction underpinned by advances in geo-location technology and supported by the proliferation of mobile device technology into modern life. Accurate positioning is a known problem for location-based services, contributions in the area of mobile positioning demonstrate a hybrid positioning technology for mobile devices that uses terrestrial beacons to trilaterate position. Information overload is an active concern for location-based applications that struggle to manage large amounts of data, contributions in the area of egocentric visibility that filter data based on field-of-view demonstrate novel forms of multimodal input. One of the more pertinent characteristics of these applications is the delivery or output modality employed (auditory, visual or tactile). Further contributions in the area of multimodal content delivery are made, where multiple modalities are used to deliver information using graphical user interfaces, tactile interfaces and more notably auditory user interfaces. It is demonstrated how a combination of these interfaces can be used to synergistically deliver context sensitive rich media to users - in a responsive way - based on usage scenarios that consider the affordance of the device, the geographical position and bearing of the device and also the location of the device