Design, modeling and analysis of object localization through acoustical signals for cognitive electronic travel aid for blind people

El objetivo de la tesis consiste en el estudio y análisis de la localización de objetos en el entorno real mediante sonidos, así como la posterior integración y ensayo de un dispositivo real basado en tal técnica y destinado a personas con discapacidad visual. Con el propósito de poder comprender y analizar la localización de objetos se ha realizado un profundo estado de arte sobre los Sistemas de Navegación desarrollados durante las últimas décadas y orientados a personas con distintos grados de discapacidad visual. En el citado estado del arte, se han analizado y estructurado los dispositivos de navegación existentes, clasificándolos de acuerdo con los componentes de adquisición de datos del entorno utilizados. A este respecto, hay que señalar que, hasta el momento, se conocen tres clases de dispositivos de navegación: 'detectores de obstáculos', que se basan en dispositivos de ultrasonidos y sensores instalados en los dispositivos electrónicos de navegación con el objetivo de detectar los objetos que aparecen en el área de trabajo del sistema; 'sensores del entorno' - que tienen como objetivo la detección del objeto y del usuario. Esta clase de dispositivos se instalan en las estaciones de autobús, metro, tren, pasos de peatones etc., de forma que cuando el sensor del usuario penetra en el área de alcance de los sensores instalados en la estación, éstos informan al usuario sobre la presencia de la misma. Asimismo, el sensor del usuario detecta también los medios de transporte que tienen instalado el correspondiente dispositivo basado en láser o ultrasonidos, ofreciendo al usuario información relativa a número de autobús, ruta etc La tercera clase de sistemas electrónicos de navegación son los 'dispositivos de navegación'. Estos elementos se basan en dispositivos GPS, indicando al usuario tanto su locación, como la ruta que debe seguir para llegar a su punto de destino. Tras la primera etapa de elaboración del estaDunai ., L. (2010). Design, modeling and analysis of object localization through acoustical signals for cognitive electronic travel aid for blind people [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/8441Palanci

State of the art review on walking support system for visually impaired people

The technology for terrain detection and walking support system for blind people has rapidly been improved the last couple of decades but to assist visually impaired people may have started long ago. Currently, a variety of portable or wearable navigation system is available in the market to help the blind for navigating their way in his local or remote area. The focused category in this work can be subgroups as electronic travel aids (ETAs), electronic orientation aids (EOAs) and position locator devices (PLDs). However, we will focus mainly on electronic travel aids (ETAs). This paper presents a comparative survey among the various portable or wearable walking support systems as well as informative description (a subcategory of ETAs or early stages of ETAs) with its working principal advantages and disadvantages so that the researchers can easily get the current stage of assisting blind technology along with the requirement for optimising the design of walking support system for its users

Exploring haptic interfacing with a mobile robot without visual feedback

Search and rescue scenarios are often complicated by low or no visibility conditions. The lack of visual feedback hampers orientation and causes significant stress for human rescue workers. The Guardians project [1] pioneered a group of autonomous mobile robots assisting a human rescue worker operating within close range. Trials were held with fire fighters of South Yorkshire Fire and Rescue. It became clear that the subjects by no means were prepared to give up their procedural routine and the feel of security they provide: they simply ignored instructions that contradicted their routines

Sensory navigation device for blind people

[EN] This paper presents a new Electronic Travel Aid (ETA) 'Acoustic Prototype' which is especially suited to facilitate the navigation of visually impaired users. The device consists of a set of 3-Dimensional Complementary Metal Oxide Semiconductor (3-D CMOS) image sensors based on the three-dimensional integration and Complementary Metal-Oxide Semiconductor (CMOS) processing techniques implemented into a pair of glasses, stereo headphones as well as a Field-Programmable Gate Array (FPGA) used as processing unit. The device is intended to be used as a complementary device to navigation through both open known and unknown environments. The FPGA and the 3D-CMOS image sensor electronics control object detection. Distance measurement is achieved by using chip-integrated technology based on the Multiple Short Time Integration method. The processed information of the object distance is presented to the user via acoustic sounds through stereophonic headphones. The user interprets the information as an acoustic image of the surrounding environment. The Acoustic Prototype transforms the surface of the objects of the real environment into acoustical sounds. The method used is similar to a bat's acoustic orientation. Having good hearing ability, with few weeks training the users are able to perceive not only the presence of an object but also the object form (that is, if the object is round, if it has corners, if it is a car or a box, if it is a cardboard object or if it is an iron or cement object, a tree, a person, a static or moving object). The information is continuously delivered to the user in a few nanoseconds until the device is shut down, helping the end user to perceive the information in real time.The first author would like to acknowledge that this research was funded through the FP6 European project CASBLiP number 027063 and Project number 2062 of the Programa de Apoyo a la Investigacion y Desarrollo 2011 from the Universitat Politecnica de Valencia.Dunai, L.; Peris Fajarnes, G.; Lluna Gil, E.; Defez Garcia, B. (2013). Sensory navigation device for blind people. Journal of Navigation. 66(3):346-362. doi:10.1017/S0373463312000574S34636266

An Orientation & Mobility Aid for People with Visual Impairments

Orientierung&Mobilität (O&M) umfasst eine Reihe von Techniken für Menschen mit Sehschädigungen, die ihnen helfen, sich im Alltag zurechtzufinden. Dennoch benötigen sie einen umfangreichen und sehr aufwendigen Einzelunterricht mit O&M Lehrern, um diese Techniken in ihre täglichen Abläufe zu integrieren. Während einige dieser Techniken assistive Technologien benutzen, wie zum Beispiel den Blinden-Langstock, Points of Interest Datenbanken oder ein Kompass gestütztes Orientierungssystem, existiert eine unscheinbare Kommunikationslücke zwischen verfügbaren Hilfsmitteln und Navigationssystemen. In den letzten Jahren sind mobile Rechensysteme, insbesondere Smartphones, allgegenwärtig geworden. Dies eröffnet modernen Techniken des maschinellen Sehens die Möglichkeit, den menschlichen Sehsinn bei Problemen im Alltag zu unterstützen, die durch ein nicht barrierefreies Design entstanden sind. Dennoch muss mit besonderer Sorgfalt vorgegangen werden, um dabei nicht mit den speziellen persönlichen Kompetenzen und antrainierten Verhaltensweisen zu kollidieren, oder schlimmstenfalls O&M Techniken sogar zu widersprechen. In dieser Dissertation identifizieren wir eine räumliche und systembedingte Lücke zwischen Orientierungshilfen und Navigationssystemen für Menschen mit Sehschädigung. Die räumliche Lücke existiert hauptsächlich, da assistive Orientierungshilfen, wie zum Beispiel der Blinden-Langstock, nur dabei helfen können, die Umgebung in einem limitierten Bereich wahrzunehmen, während Navigationsinformationen nur sehr weitläufig gehalten sind. Zusätzlich entsteht diese Lücke auch systembedingt zwischen diesen beiden Komponenten — der Blinden-Langstock kennt die Route nicht, während ein Navigationssystem nahegelegene Hindernisse oder O&M Techniken nicht weiter betrachtet. Daher schlagen wir verschiedene Ansätze zum Schließen dieser Lücke vor, um die Verbindung und Kommunikation zwischen Orientierungshilfen und Navigationsinformationen zu verbessern und betrachten das Problem dabei aus beiden Richtungen. Um nützliche relevante Informationen bereitzustellen, identifizieren wir zuerst die bedeutendsten Anforderungen an assistive Systeme und erstellen einige Schlüsselkonzepte, die wir bei unseren Algorithmen und Prototypen beachten. Existierende assistive Systeme zur Orientierung basieren hauptsächlich auf globalen Navigationssatellitensystemen. Wir versuchen, diese zu verbessern, indem wir einen auf Leitlinien basierenden Routing Algorithmus erstellen, der auf individuelle Bedürfnisse anpassbar ist und diese berücksichtigt. Generierte Routen sind zwar unmerklich länger, aber auch viel sicherer, gemäß den in Zusammenarbeit mit O&M Lehrern erstellten objektiven Kriterien. Außerdem verbessern wir die Verfügbarkeit von relevanten georeferenzierten Datenbanken, die für ein derartiges bedarfsgerechtes Routing benötigt werden. Zu diesem Zweck erstellen wir einen maschinellen Lernansatz, mit dem wir Zebrastreifen in Luftbildern erkennen, was auch über Ländergrenzen hinweg funktioniert, und verbessern dabei den Stand der Technik. Um den Nutzen von Mobilitätsassistenz durch maschinelles Sehen zu optimieren, erstellen wir O&M Techniken nachempfundene Ansätze, um die räumliche Wahrnehmung der unmittelbaren Umgebung zu erhöhen. Zuerst betrachten wir dazu die verfügbare Freifläche und informieren auch über mögliche Hindernisse. Weiterhin erstellen wir einen neuartigen Ansatz, um die verfügbaren Leitlinien zu erkennen und genau zu lokalisieren, und erzeugen virtuelle Leitlinien, welche Unterbrechungen überbrücken und bereits frühzeitig Informationen über die nächste Leitlinie bereitstellen. Abschließend verbessern wir die Zugänglichkeit von Fußgängerübergängen, insbesondere Zebrastreifen und Fußgängerampeln, mit einem Deep Learning Ansatz. Um zu analysieren, ob unsere erstellten Ansätze und Algorithmen einen tatsächlichen Mehrwert für Menschen mit Sehschädigung erzeugen, vollziehen wir ein kleines Wizard-of-Oz-Experiment zu unserem bedarfsgerechten Routing — mit einem sehr ermutigendem Ergebnis. Weiterhin führen wir eine umfangreichere Studie mit verschiedenen Komponenten und dem Fokus auf Fußgängerübergänge durch. Obwohl unsere statistischen Auswertungen nur eine geringfügige Verbesserung aufzeigen, beeinflußt durch technische Probleme mit dem ersten Prototypen und einer zu geringen Eingewöhnungszeit der Probanden an das System, bekommen wir viel versprechende Kommentare von fast allen Studienteilnehmern. Dies zeigt, daß wir bereits einen wichtigen ersten Schritt zum Schließen der identifizierten Lücke geleistet haben und Orientierung&Mobilität für Menschen mit Sehschädigung damit verbessern konnten

Engineering data compendium. Human perception and performance. User's guide

The concept underlying the Engineering Data Compendium was the product of a research and development program (Integrated Perceptual Information for Designers project) aimed at facilitating the application of basic research findings in human performance to the design and military crew systems. The principal objective was to develop a workable strategy for: (1) identifying and distilling information of potential value to system design from the existing research literature, and (2) presenting this technical information in a way that would aid its accessibility, interpretability, and applicability by systems designers. The present four volumes of the Engineering Data Compendium represent the first implementation of this strategy. This is the first volume, the User's Guide, containing a description of the program and instructions for its use

Interaction Between Visual and Phonotactic Orientation During Flight in \u3ci\u3eMagicicada Cassini\u3c/i\u3e (Homoptera: Cicadidae)

Visual and phonotactic orientation often occur simultaneously in diurnal cicadas. and these animals generally have their largest sensory elaboration in eyes and hearing organs. Phonotactic orientation occurs principally during flight. Males and females of Magicicada cassini commonly perform low- altitude « 5 m) and short-distance « 15 m) flights in their natural habitat at flight speeds of 3 to 6 m/s. During flight, the long body axis is tilted 10° to Q , head upward. Wing beat frequencies of tethered animals at 24° to 26°C averaged 28.8 Hz. Body temperature in the field for flying individuals aver- aged 4.6°C above ambient. Compound eyes of females possess about 7% more facets than males, and the binocular field of view for both is especially expanded dorsa-frontally, frontally, and fronto-ventrally. The role of vision for phonoresponses, and in flight and landing behavior. was studied in nature by comparing controls with cicadas with eyes partly to completely covered with aluminum paint. Cicadas with their three ocelli covered behaved like controls and exhibited low-altitude and short-distance flights with landings on neighboring shrubs, as did cicadas with only both caudal halves or both dorsal halves of the compound eyes covered. Those with both compound eyes covered completely (with or without additionally covering the three ocelli) flew to higher altitudes and for longer distances. Higher and longer flight courses were also seen in cicadas (A) with only one compound eye covered. which in addition circled during walking and flight toward the side of unrestricted vision, (B) with both frontal or both ventral halves of their compound eyes covered. and (C) with either the binocular or monocular fields of the eyes covered. Thus, the paired fronta-antero-ventral regions of the compound eyes provide visual information for habitat-dependent low-altitude flights and landings. Females with intact compound eyes and ocelli responded to playbacks of just the frequency/intensity sweep at the end of the buzz in calling songs of a male by flying within 1.2 m above the ground and landing on a nylon screen- covered small bush directly above the loudspeaker from distances of 2 to 8 m. mostly from lower vegetation. Males that were blinded, or blinded and deafened, sang less and flew less than normal males. However. they performed all of those behaviors, and all also walked and fed. Periodical cicadas (Magicicada, Tibicininae) are known for synchronized adult emergence and noisy aggregations of millions of individuals of three intermingled species in each brood population (Alexander and Moore 1962). Broods are isolated geographically and chronologically, such that in some years no periodical cicada adults emerge, and most areas of the eastern United States have only one brood population appearing as adults at intervals of either 13 or 17 years. In all Magicicada species, daily flights affect spacing and aggregation of both sexes during feeding, chorusing, mating, and ovipositing. Flights are mediated by both acoustical and visual cues. Each species in these aggregations establishes mating leks. These aggregations continue to mix, every day and unpredictably, during the emergence period. Toward the end of the reproductive season, males die sooner than females, leading to little or no chorusing, and then females disperse progressively further from the lek sites. The cohesive effect of the acoustical cues of chorusing males on these cicada populations is obvious. Both sexes of all six species of periodical cicadas live and feed on shrubs and trees of different species, sizes, and shapes, and females lay eggs in their living twigs. Their niches overlap almost completely, the three species of 13­ year or 17-year cicadas being separated principally by diurnal acoustic behavior leading to aggregation sites that change every day and are seldom exclusive to a single Magicicada species. Adults frequently change location in these complex visual environments by short-distance and low-altitude flights. which we call bush-hopping. These flights are associated with sound communication and reproductive activities and are most commonly observed during bright sunlight and at ambient temperatures above 25°C with little wind (Alexander and Moore 1958,1962; Dunning et al. 1979). Otte (1990) and Toms (1992) discuss the common correlation between hearing and flying in orthop­teroid insects, interactions basically similar to those found in cicadas. The present paper describes the interaction of vision (compound eyes and ocelli) and phonoresponses of males and females of Magicicada cassini (Fisher) in walking, but especially in flight and landing behavior, within a natural habitat