DETECTING WALKABLE PLANE AREAS BY USING RGB-D CAMERA AND ACCELEROMETER FOR VISUALLY IMPAIRED PEOPLE

When visually impaired person has to walk out, they have to use white canes, but the range that can be scanned by a white cane is not long enough to walk safely. We propose to detect walkable plane areas on road surface by using the RGB-D camera and the accelerometer in the tablet terminal that is attached to the RGB-D camera. Our approach can detect plane areas in longer distance than a white cane. It is achieved by using height information from the ground and normal vectors of the surface calculated from a depth image obtained by the RGB-D camera in real time.Published in: 2017 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON) Date of Conference: 7-9 June 2017 Conference Location: Copenhagen, Denmar

Assistive Systems for the Visually Impaired Based on Image Processing

In this chapter, we proposed three assistive systems for visually impaired individuals based on image processing: Kinect cane system, Kinect goggle system, and light checking system. The Kinect cane system can detect obstacles of various sizes and also recognize objects such as seats. A visually impaired user is notified of the results of detection and recognition by means of vibration feedback. The Kinect goggle system is another type of wearable system, and can make user’s hands free. The light checking system is implemented as an application for a smartphone, and can tell a visually impaired user the ON/OFF states of room lights and elevator button lights. The experimental results demonstrate that the proposed systems are effective in helping visually impaired individuals in everyday environments

Development of Obstacle and Pit-Detecting Ultrasonic Walking Stick for the Blind

This project focused on improving mobility for a blind person by creating an obstacle and pit detecting walking stick using ultrasonic sensors. The project comprised of both hardware and software. The hardware consists of ultrasonic sensors, buzzers and a microcontroller, while the software consists of Arduino Integrated Development Environment (Arduino IDE), which was used to program the microcontroller. A Polyvinyl Chloride (PVC) casing was used to house the hardware components. The ultrasonic sensor that detects obstacles was programmed to detect obstacles at a distance of 100 cm or below and causes the buzzer to sound so as to alert the blind person. Another ultrasonic sensor was programmed to identify pit at a depression of 18 cm and above. This stick was tested to detect obstacles by 80 different blindfolded individuals within a room with different objects placed at different positions. Results showed that the percentage reduction of collision rate when comparing the developed ultrasonic walking stick to a normal white cane is 90.1%. This shows that the ultrasonic walking stick is reliable for domestic use by a blind person. Keywords— Arduino, ATmega328 Microcontroller, Blind walking stick, Mobility aid, Smart cane, Ultrasonic sensor

Smartphone-Based Escalator Recognition for the Visually Impaired

It is difficult for visually impaired individuals to recognize escalators in everyday environments. If the individuals ride on escalators in the wrong direction, they will stumble on the steps. This paper proposes a novel method to assist visually impaired individuals in finding available escalators by the use of smartphone cameras. Escalators are recognized by analyzing optical flows in video frames captured by the cameras, and auditory feedback is provided to the individuals. The proposed method was implemented on an Android smartphone and applied to actual escalator scenes. The experimental results demonstrate that the proposed method is promising for helping visually impaired individuals use escalators

A Spot Reminder System for the Visually Impaired Based on a Smartphone Camera

The present paper proposes a smartphone-camera-based system to assist visually impaired users in recalling their memories related to important locations, called spots, that they visited. The memories are recorded as voice memos, which can be played back when the users return to the spots. Spot-to-spot correspondence is determined by image matching based on the scale invariant feature transform. The main contribution of the proposed system is to allow visually impaired users to associate arbitrary voice memos with arbitrary spots. The users do not need any special devices or systems except smartphones and do not need to remember the spots where the voice memos were recorded. In addition, the proposed system can identify spots in environments that are inaccessible to the global positioning system. The proposed system has been evaluated by two experiments: image matching tests and a user study. The experimental results suggested the effectiveness of the system to help visually impaired individuals, including blind individuals, recall information about regularly-visited spots

Technology-assisted white cane: evaluation and future directions

Background Several technology-assisted aids are available to help blind and visually impaired people perform their daily activities. The current research uses the state-of-the-art technology to enhance the utility of traditional navigational aids to produce solutions that are more reliable. In this regard, a white cane is no exception, which is supplemented with the existing technologies to design Electronic Travel Aids (ETAs), Electronic Orientation Aids (EOAs), and Position Locator Devices (PLDs). Although several review articles uncover the strengths and limitations of research contributions that extend traditional navigational aids, we find no review article that covers research contributions on a technology-assisted white cane. The authors attempt to fill this literature gap by reviewing the most relevant research articles published during 2010–2017 with the common objective of enhancing the utility of white cane with the existing technology. Methods The authors have collected the relevant literature published during 2010–17 by searching and browsing all the major digital libraries and publishers’ websites. The inclusion/exclusion criteria were applied to select the research articles that are relevant to the topic of this review article, and all other irrelevant papers were excluded. Among the 577 (534 through database searching and 43 through other sources) initially screened papers, the authors collected 228 full-text articles, which after applying exclusion/inclusion criteria resulted in 36 papers that were included in the evaluation, comparison, and discussion. This also includes research articles of commercially available aids published before the specified range. Results The findings show that the research trend is shifting towards developing a technology-assisted white cane solution that is applicable in both indoor and outdoor environments to aid blind users in navigation. In this regard, exploiting smartphones to develop low-cost and user-friendly navigation solution is among the best research opportunities to explore. In addition, the authors contribute a theoretical evaluation framework to compare and evaluate the state-of-the-art solutions, identify research trends and future directions. Discussion Researchers have been in the quest to find out ways of enhancing the utility of white cane using existing technology. However, for a more reliable enhancement, the design should have user-centric characteristics. It should be portable, reliable, trust-worthy, lightweight, less costly, less power hungry, and require minimal training with special emphasis on its ergonomics and social acceptance. Smartphones, which are the ubiquitous and general-purpose portable devices, should be considered to exploit its capabilities in making technology-assisted white cane smarter and reliable