Investigating design issues of context-aware mobile guides for people with visual impairments

While mobile wayfinding systems for visually impaired people offer huge potential, most insufficiently address the differences between visual impairments and contextual environments, and offer very little context-awareness - usability issues of which are vital in supporting independent mobility. Participants experiencing a loss of central vision, loss of peripheral vision, and total vision loss made up three groups. Our multidisciplinary model of context was used to design a user study, which involved asking participants to walk to pre-determined outdoor and indoor landmarks. Significant differences were found between groups relating to information requirements, and the environmental cues encoded and used to orientate and navigate. The study also found differences between indoor and outdoor contexts. It was concluded that what is meaningful to one form of visual impairment is incidental to another. These issues need to be captured and accounted for if wayfinding systems are to be usable

A Navigation and Augmented Reality System for Visually Impaired People

In recent years, we have assisted with an impressive advance in augmented reality systems and computer vision algorithms, based on image processing and artificial intelligence. Thanks to these technologies, mainstream smartphones are able to estimate their own motion in 3D space with high accuracy. In this paper, we exploit such technologies to support the autonomous mobility of people with visual disabilities, identifying pre-defined virtual paths and providing context information, reducing the distance between the digital and real worlds. In particular, we present ARIANNA+, an extension of ARIANNA, a system explicitly designed for visually impaired people for indoor and outdoor localization and navigation. While ARIANNA is based on the assumption that landmarks, such as QR codes, and physical paths (composed of colored tapes, painted lines, or tactile pavings) are deployed in the environment and recognized by the camera of a common smartphone, ARIANNA+ eliminates the need for any physical support thanks to the ARKit library, which we exploit to build a completely virtual path. Moreover, ARIANNA+ adds the possibility for the users to have enhanced interactions with the surrounding environment, through convolutional neural networks (CNNs) trained to recognize objects or buildings and enabling the possibility of accessing contents associated with them. By using a common smartphone as a mediation instrument with the environment, ARIANNA+ leverages augmented reality and machine learning for enhancing physical accessibility. The proposed system allows visually impaired people to easily navigate in indoor and outdoor scenarios simply by loading a previously recorded virtual path and providing automatic guidance along the route, through haptic, speech, and sound feedback

A pathway to independence : wayfinding systems which adapt to a visually impaired person's context

Despite an increased amount of technologies and systems designed to address the navigational requirements of the visually impaired community of approximately 7.4 million in Europe, current research has failed to sufficiently address the human issues associated to their design and use. As more types of sensing technologies are developed to facilitate visually impaired travellers for different navigational purposes (local vs. distant and indoor vs. outdoor), an effective process of synchronisation is required. This synchronisation is represented through context-aware computing, which allows contextual information to not just be sensed (like most current wayfinding systems), but also adapted, discovered and augmented. In this paper, three user studies concerning the suitability of different types of navigational information for visually impaired and sighted people are described. For such systems to be effective, human cognitive maps, models and intentions need to be the focus of further research, in order to provide information that is tailored to a user's task, situation or environment. Methodologies aimed at establishing these issues need to be demonstrated through a multidisciplinary framework

A multimodal smartphone interface for active perception by visually impaired

The diffuse availability of mobile devices, such as smartphones and tablets, has the potential to bring substantial benefits to the people with sensory impairments. The solution proposed in this paper is part of an ongoing effort to create an accurate obstacle and hazard detector for the visually impaired, which is embedded in a hand-held device. In particular, it presents a proof of concept for a multimodal interface to control the orientation of a smartphone's camera, while being held by a person, using a combination of vocal messages, 3D sounds and vibrations. The solution, which is to be evaluated experimentally by users, will enable further research in the area of active vision with human-in-the-loop, with potential application to mobile assistive devices for indoor navigation of visually impaired people

IO Vision – an integrated system to support the visually impaired

Security questions are one of the techniques used to recover passwords. The main limitation of security questions is that users find strong answers difficult to remember. This leads users to trade-off security for the convenience of an improved memorability. Previous research found that increased fun and enjoyment can lead to an enhanced memorability, which provides a better learning experience. Hence, we empirically investigate whether a serious game has the potential of improving the memorability of strong answers to security questions. For our serious game, we adopted the popular “4 Pics 1 word” mobile game because of its use of pictures and cues, which psychology research found to be important to help with memorability. Our findings indicate that the proposed serious game could potentially improve the memorability of answers to security questions. This potential improvement in memorability, could eventually help reduce the trade-off between usability and security in fall-back authentication

Vision-Based Tactile Paving Detection Method in Navigation Systems for Visually Impaired Persons

In general, a visually impaired person relies on guide canes in order to walk outside besides depending only on a tactile pavement as a warning and directional tool in order to avoid any obstructions or hazardous situations. However, still a lot of training is needed in order to recognize the tactile pattern, and it is quite difficult for persons who have recently become visually impaired. This chapter describes the development and evaluation of vision-based tactile paving detection method for visually impaired persons. Some experiments will be conducted on how it works to detect the tactile pavement and identify the shape of tactile pattern. In this experiment, a vision-based method is proposed by using MATLAB including the Arduino platform and speaker as guidance tools. The output of this system based on the result found from tactile detection in MATLAB then produces auditory output and notifies the visually impaired about the type of tactile detected. Consequently, the development of tactile pavement detection system can be used by visually impaired persons for easy detection and navigation purposes