Infrared ranging in multipath environments for indoor localization of mobile targets

Esta tesis aborda el problema de la medida de diferencias de distancia mediante señales ópticas afectadas por multicamino, aplicada a la localización de agentes móviles en espacios interiores. Los avances en robótica, entornos inteligentes y vehículos autónomos han creado un campo de aplicación específico para la localización en interiores, cuyos requerimientos de precisión (en el rango de los cm) son muy superiores a los demandados por las aplicaciones de localización orientadas a personas, en cuyo contexto se han desarrollado la mayor parte de las alternativas tecnológicas. La investigación con métodos de geometría proyectiva basados en cámaras y de multilateración basados en medida de distancia con señales de radiofrecuencia de banda ancha, de ultrasonido y ópticas han demostrado un rendimiento potencial adecuado para cubrir estos requerimientos. Sin embargo, todas estas alternativas, aún en fase de investigación, presentan dificultades que limitan su aplicación práctica. En el caso de los sistemas ópticos, escasamente estudiados en este contexto, los trabajos previos se han basado en medidas de diferencia de fase de llegada de señales infrarrojas moduladas sinusoidalmente en intensidad. Una infraestructura centralizada computa medidas diferenciales, entre receptores fijos, de la señal emitida desde el móvil a posicionar, y calcula la posición del móvil mediante trilateración hiperbólica a partir de éstas. Estas investigaciones demostraron que se pueden alcanzar precisiones de pocos centímetros; sin embargo, las interferencias por multicamino debidas a la reflexión de la señal óptica en superficies del entorno pueden degradar esta precisión hasta las decenas de centímetros dependiendo de las características del espacio. Así pues, el efecto del multicamino es actualmente la principal fuente de error en esta tecnología, y por tanto, la principal barrera a superar para su implementación en situaciones reales. En esta tesis se propone y analiza un sistema de medida con señales ópticas que permite obtener estimaciones de diferencias de distancia precisas reduciendo el efecto crítico del multicamino. El sistema propuesto introduce una modulación con secuencias de ruido pseudoaleatorio sobre la modulación sinusoidal típicamente usada para medida de fase por onda continua, y aprovecha las propiedades de ensanchamiento en frecuencia de estas secuencias para reducir el efecto del multicamino. El sistema, que realiza una doble estimación de tiempo y fase de llegada, está compuesto por una etapa de sincronización que posibilita la demodulación parcialmente coherente de la señal recibida, seguida de un medidor diferencial de fase sobre las componentes desensanchadas tras la demodulación. Las condiciones de multicamino óptico típicas en espacios interiores, con una componente de camino directo claramente dominante, permiten que el proceso de demodulación recupere más potencia del camino directo que del resto de contribuciones, reduciendo el efecto del multicamino en la estimación final. Los resultados obtenidos demuestran que la aplicación del método propuesto permitiría realizar posicionamiento a partir de señales ópticas con el rendimiento adecuando para aplicaciones de robótica y guiado de vehículos en espacios interiores; además, el progresivo aumento de la potencia y el ancho de banda de los dispositivos optoelectrónicos disponibles permite esperar un incremento considerable de las prestaciones de la propuesta en los próximos años

Visible Light Communication (VLC)

Visible light communication (VLC) using light-emitting diodes (LEDs) or laser diodes (LDs) has been envisioned as one of the key enabling technologies for 6G and Internet of Things (IoT) systems, owing to its appealing advantages, including abundant and unregulated spectrum resources, no electromagnetic interference (EMI) radiation and high security. However, despite its many advantages, VLC faces several technical challenges, such as the limited bandwidth and severe nonlinearity of opto-electronic devices, link blockage and user mobility. Therefore, significant efforts are needed from the global VLC community to develop VLC technology further. This Special Issue, “Visible Light Communication (VLC)”, provides an opportunity for global researchers to share their new ideas and cutting-edge techniques to address the above-mentioned challenges. The 16 papers published in this Special Issue represent the fascinating progress of VLC in various contexts, including general indoor and underwater scenarios, and the emerging application of machine learning/artificial intelligence (ML/AI) techniques in VLC

Design and theoretical analysis of advanced power based positioning in RF system

Accurate locating and tracking of people and resources has become a fundamental requirement for many applications. The global navigation satellite systems (GNSS) is widely used. But its accuracy suffers from signal obstruction by buildings, multipath fading, and disruption due to jamming and spoof. Hence, it is required to supplement GPS with inertial sensors and indoor localization schemes that make use of WiFi APs or beacon nodes. In the GPS-challenging or fault scenario, radio-frequency (RF) infrastructure based localization schemes can be a fallback solution for robust navigation. For the indoor/outdoor transition scenario, we propose hypothesis test based fusion method to integrate multi-modal localization sensors. In the first paper, a ubiquitous tracking using motion and location sensor (UTMLS) is proposed. As a fallback approach, power-based schemes are cost-effective when compared with the existing ToA or AoA schemes. However, traditional power-based positioning methods suffer from low accuracy and are vulnerable to environmental fading. Also, the expected accuracy of power-based localization is not well understood but is needed to derive the hypothesis test for the fusion scheme. Hence, in paper 2-5, we focus on developing more accurate power-based localization schemes. The second paper improves the power-based range estimation accuracy by estimating the LoS component. The ranging error model in fading channel is derived. The third paper introduces the LoS-based positioning method with corresponding theoretical limits and error models. In the fourth and fifth paper, a novel antenna radiation-pattern-aware power-based positioning (ARPAP) system and power contour circle fitting (PCCF) algorithm are proposed to address antenna directivity effect on power-based localization. Overall, a complete LoS signal power based positioning system has been developed that can be included in the fusion scheme --Abstract, page iv

Real-time spatial modeling to detect and track resources on construction sites

For more than 10 years the U.S. construction industry has experienced over 1,000 fatalities annually. Many fatalities may have been prevented had the individuals and equipment involved been more aware of and alert to the physical state of the environment around them. Awareness may be improved by automatic 3D (three-dimensional) sensing and modeling of the job site environment in real-time. Existing 3D modeling approaches based on range scanning techniques are capable of modeling static objects only, and thus cannot model in real-time dynamic objects in an environment comprised of moving humans, equipment, and materials. Emerging prototype 3D video range cameras offer another alternative by facilitating affordable, wide field of view, automated static and dynamic object detection and tracking at frame rates better than 1Hz (real-time). This dissertation presents an imperical work and methodology to rapidly create a spatial model of construction sites and in particular to detect, model, and track the position, dimension, direction, and velocity of static and moving project resources in real-time, based on range data obtained from a three-dimensional video range camera in a static or moving position. Existing construction site 3D modeling approaches based on optical range sensing technologies (laser scanners, rangefinders, etc.) and 3D modeling approaches (dense, sparse, etc.) that offered potential solutions for this research are reviewed. The choice of an emerging sensing tool and preliminary experiments with this prototype sensing technology are discussed. These findings led to the development of a range data processing algorithm based on three-dimensional occupancy grids which is demonstrated in detail. Testing and validation of the proposed algorithms have been conducted to quantify the performance of sensor and algorithm through extensive experimentation involving static and moving objects. Experiments in indoor laboratory and outdoor construction environments have been conducted with construction resources such as humans, equipment, materials, or structures to verify the accuracy of the occupancy grid modeling approach. Results show that modeling objects and measuring their position, dimension, direction, and speed had an accuracy level compatible to the requirements of active safety features for construction. Results demonstrate that video rate 3D data acquisition and analysis of construction environments can support effective detection, tracking, and convex hull modeling of objects. Exploiting rapidly generated three-dimensional models for improved visualization, communications, and process control has inherent value, broad application, and potential impact, e.g. as-built vs. as-planned comparison, condition assessment, maintenance, operations, and construction activities control. In combination with effective management practices, this sensing approach has the potential to assist equipment operators to avoid incidents that result in reduce human injury, death, or collateral damage on construction sites.Civil, Architectural, and Environmental Engineerin

Optical Synchronization of Time-of-Flight Cameras

Time-of-Flight (ToF)-Kameras erzeugen Tiefenbilder (3D-Bilder), indem sie Infrarotlicht aussenden und die Zeit messen, bis die Reflexion des Lichtes wieder empfangen wird. Durch den Einsatz mehrerer ToF-Kameras können ihre vergleichsweise geringere Auflösungen überwunden, das Sichtfeld vergrößert und Verdeckungen reduziert werden. Der gleichzeitige Betrieb birgt jedoch die Möglichkeit von Störungen, die zu fehlerhaften Tiefenmessungen führen. Das Problem der gegenseitigen Störungen tritt nicht nur bei Mehrkamerasystemen auf, sondern auch wenn mehrere unabhängige ToF-Kameras eingesetzt werden. In dieser Arbeit wird eine neue optische Synchronisation vorgestellt, die keine zusätzliche Hardware oder Infrastruktur erfordert, um ein Zeitmultiplexverfahren (engl. Time-Division Multiple Access, TDMA) für die Anwendung mit ToF-Kameras zu nutzen, um so die Störungen zu vermeiden. Dies ermöglicht es einer Kamera, den Aufnahmeprozess anderer ToF-Kameras zu erkennen und ihre Aufnahmezeiten schnell zu synchronisieren, um störungsfrei zu arbeiten. Anstatt Kabel zur Synchronisation zu benötigen, wird nur die vorhandene Hardware genutzt, um eine optische Synchronisation zu erreichen. Dazu wird die Firmware der Kamera um das Synchronisationsverfahren erweitert. Die optische Synchronisation wurde konzipiert, implementiert und in einem Versuchsaufbau mit drei ToF-Kameras verifiziert. Die Messungen zeigen die Wirksamkeit der vorgeschlagenen optischen Synchronisation. Während der Experimente wurde die Bildrate durch das zusätzliche Synchronisationsverfahren lediglich um etwa 1 Prozent reduziert.Time-of-Flight (ToF) cameras produce depth images (three-dimensional images) by measuring the time between the emission of infrared light and the reception of its reflection. A setup of multiple ToF cameras may be used to overcome their comparatively low resolution, increase the field of view, and reduce occlusion. However, the simultaneous operation of multiple ToF cameras introduces the possibility of interference resulting in erroneous depth measurements. The problem of interference is not only related to a collaborative multicamera setup but also to multiple ToF cameras operating independently. In this work, a new optical synchronization for ToF cameras is presented, requiring no additional hardware or infrastructure to utilize a time-division multiple access (TDMA) scheme to mitigate interference. It effectively enables a camera to sense the acquisition process of other ToF cameras and rapidly synchronizes its acquisition times to operate without interference. Instead of requiring cables to synchronize, only the existing hardware is utilized to enable an optical synchronization. To achieve this, the camera’s firmware is extended with the synchronization procedure. The optical synchronization has been conceptualized, implemented, and verified with an experimental setup deploying three ToF cameras. The measurements show the efficacy of the proposed optical synchronization. During the experiments, the frame rate was reduced by only about 1% due to the synchronization procedure

Ultra-wideband Based Indoor Localization of Mobile Nodes in ToA and TDoA Configurations

Zandian R. Ultra-wideband Based Indoor Localization of Mobile Nodes in ToA and TDoA Configurations. Bielefeld: Universität Bielefeld; 2019.This thesis discusses the utilization of ultra-wideband (UWB) technology in indoor localization scenarios and proposes system setup and evaluates different localization algorithms in order to improve the localization accuracy and stability of such systems in non-ideal conditions of the indoor environment. Recent developments and advances of technology in the areas of ubiquitous Internet, robotics and internet of things (IoT) have resulted in emerging new application areas in daily life in which localization systems are vital. The significant demand for a robust and accurate localization system that is applicable in indoor areas lacking satellites link, can be sensed. The UWB technology offers accurate localization systems with an accuracy of below 10 cm and covering the range of up to a few hundred meters thanks to their dedicated large bandwidth, modulation technique and signal power. In this thesis, the technology behind the UWB systems is discussed in detail. In terms of localization topologies, different scenarios with the focus on time-based methods are introduced. The main focus of this thesis is on the differential time of arrival localization systems (TDoA) with unilateral constellation that is suitable for robotic localization and navigation applications. A new approach for synchronization of TDoA topology is proposed and influence of clock inaccuracies in such systems are thoroughly evaluated. For localization engine, two groups of static and dynamic iterative algorithms are introduced. Among the possible dynamic methods, extended Kalman filter (EKF), H∞ and unscented Kalman filter (UKF) are discussed and meticulously evaluated. In order to tackle the non-line of sight (NLOS) problem of such systems, for detection stage several solutions which are based on parametric machine learning methods are proposed. Furthermore, for mitigation phase two solutions namely adjustment of measurement variance and innovation term are suggested. Practical results prove the efficiency and high reliability of the proposed algorithms with positive NLOS condition detection rate of more than 87%. In practical trials, the localization system is evaluated in indoor and outdoor arenas in both line of sight and non-line of sight conditions. The results show that the proposed detection and mitigation methods can be successfully applied for both small and large-scale arenas with the higher performance of the localization filters in terms of accuracy in large-scale scenarios

Visible Light Optical Camera Communication for Electroencephalography Applications

Due to the cable-free deployment and flexibility of wireless communications, the data transmission in the applications of home and healthcare has shown a trend of moving wired communications to wireless communications. One typical example is electroencephalography (EEG). Evolution in the radio frequency (RF) technology has made it is possible to transmit the EEG data without data cable bundles. However, presently, the RF-based wireless technology used in EEG suffers from electromagnetic interference and might also have adverse effects on the health of patient and other medical equipment used in hospitals or homes. This puts some limits in RF-based EEG solutions, which is particularly true in RF restricted zones like Intensive Care Units (ICUs). As a recently developed optical wireless communication (OWC) technology, visible light communication (VLC) using light-emitting diodes (LEDs) for both simultaneous illumination and data communication has shown its advantages of free from electromagnetic interference, potential huge unlicensed bandwidth and enhanced data privacy due to the line transmission of light. The most recent development of VLC is the optical camera communication (OCC), which is an extension of VLC IEEE standard 802.15.7, also referred to as visible light optical camera communication (VL-OCC). Different from the conventional VLC where traditional photodiodes are used to detect and receive the data, VL-OCC uses the imaging camera as the photodetector to receive the data in the form of visible light signals. The data rate requirement of EEG is dependent on the application; hence this thesis investigates a low cost, organic LED (OLED)-driven VL-OCC wireless data transmission system for EEG applications

Advances in Sonar Technology

The demand to explore the largest and also one of the richest parts of our planet, the advances in signal processing promoted by an exponential growth in computation power and a thorough study of sound propagation in the underwater realm, have lead to remarkable advances in sonar technology in the last years.The work on hand is a sum of knowledge of several authors who contributed in various aspects of sonar technology. This book intends to give a broad overview of the advances in sonar technology of the last years that resulted from the research effort of the authors in both sonar systems and their applications. It is intended for scientist and engineers from a variety of backgrounds and even those that never had contact with sonar technology before will find an easy introduction with the topics and principles exposed here