Navigation Instruction Validation Tool and Indoor Wayfinding Training System for People with Disabilities

According to World Health Survey, there are 785 million (15.6%) people in the world that live with a disability. It is a well-known fact that lack of access to public transportation is a barrier for people with disabilities in seeking work or accessing health care. In this research, we seek to increase access to public transportation by introducing a virtual pre-travel training system that enables people with disabilities to get familiar with a public transportation venue prior to arriving at the venue. Using this system, users establish a mental map of the target environment prior to their arrival to the physical space, increasing their confidence and therefore increasing their chances of using public transportation. First, we have to guarantee that all navigation instructions sent to our training system are correct. Since the number of navigation instruction increases dramatically, instruction validation becomes a challenge. We propose a video game based validation tool which includes a game scene that represents in 2D the physical environment and uses a game avatar to verify the navigation instructions automatically in the game scene. The avatar traverses the virtual space following the corresponding navigation instructions. Only in case that it successfully reaches the planned destination, the current navigation instruction can be considered as correct. Then, we introduce a virtual reality based pre-travel wayfinding training system to assist people with disabilities to get familiar with a venue prior to their arrival at the physical space, which provides two modes: 1) Self-Guided mode in which the path between a source and a destination is shown to the user from third person perspective, and 2) Exploration mode in which the user explores and interacts with the environment. In the end, we have implemented visual analytics tools that track and evaluate trainees’ performance and help us optimize the game. These tools identify the difficulties faced by the trainees as well as obtain overall statistics on the trainees’ behavior in the indoor environment, helping us understand how to modify the system and adjust it to different classes of disabilities

Making touch-based kiosks accessible to blind users through simple gestures

Touch-based interaction is becoming increasingly popular and is commonly used as the main interaction paradigm for self-service kiosks in public spaces. Touch-based interaction is known to be visually intensive, and current non-haptic touch-display technologies are often criticized as excluding blind users. This study set out to demonstrate that touch-based kiosks can be designed to include blind users without compromising the user experience for non-blind users. Most touch-based kiosks are based on absolute positioned virtual buttons which are difficult to locate without any tactile, audible or visual cues. However, simple stroke gestures rely on relative movements and the user does not need to hit a target at a specific location on the display. In this study, a touch-based train ticket sales kiosk based on simple stroke gestures was developed and tested on a panel of blind and visually impaired users, a panel of blindfolded non-visually impaired users and a control group of non-visually impaired users. The tests demonstrate that all the participants managed to discover, learn and use the touch-based self-service terminal and complete a ticket purchasing task. The majority of the participants completed the task in less than 4 min on the first attempt

VisPercep: A Vision-Language Approach to Enhance Visual Perception for People with Blindness and Low Vision

People with blindness and low vision (pBLV) encounter substantial challenges when it comes to comprehensive scene recognition and precise object identification in unfamiliar environments. Additionally, due to the vision loss, pBLV have difficulty in accessing and identifying potential tripping hazards on their own. In this paper, we present a pioneering approach that leverages a large vision-language model to enhance visual perception for pBLV, offering detailed and comprehensive descriptions of the surrounding environments and providing warnings about the potential risks. Our method begins by leveraging a large image tagging model (i.e., Recognize Anything (RAM)) to identify all common objects present in the captured images. The recognition results and user query are then integrated into a prompt, tailored specifically for pBLV using prompt engineering. By combining the prompt and input image, a large vision-language model (i.e., InstructBLIP) generates detailed and comprehensive descriptions of the environment and identifies potential risks in the environment by analyzing the environmental objects and scenes, relevant to the prompt. We evaluate our approach through experiments conducted on both indoor and outdoor datasets. Our results demonstrate that our method is able to recognize objects accurately and provide insightful descriptions and analysis of the environment for pBLV

COVID-19 and Visual Disability: Can’t Look and Now Don’t Touch

Article provides a scientific explanation for pandemic-related challenges blind and visually impaired (BVI) people experience. These challenges include spatial cognition, nonvisual information access, and environmental perception. Also offers promising technical solutions for the above challenges

Policy Areas Impinging on Elderly Transportation Mobility: An Explanation with Ontario, Canada as Example

As countries face the challenges posed by rising numbers of older persons, the need to reassess their respective policies to address transport needs in aging societies is increasingly recognized in relation to health and sustainability goals. This paper proposes the examination of six interrelated policy areas affecting elderly mobility in a country or administrative region. A general survey of policy developments in each of these areas could improve current strategies and existing processes in the planning and implementation of mobility services that will be responsive to both elderly and the general population now and in the future. These include: 1) general transport policy framework; 2) travel mode preference; 3) alternative transport infrastructure stock and investments; 4) housing-land-use-transportation linkage; 5) research and technology applications that improve travel mode and environment; and 6) institutional and legal reforms. These policy areas are discussed and given concrete elucidation in the case of Ontario, Canada. Reflections and recommendations for further research and policy action deemed critical in the case region are highlighted.transportation, aging, regional policy, Canada