A Monocular Indoor Localiser Based on an Extended Kalman Filter and Edge Images from a Convolutional Neural Network

© 2018 IEEE. The main contribution of this paper is an extended Kalman filter (EKF)based algorithm for estimating the 6 DOF pose of a camera using monocular images of an indoor environment. In contrast to popular visual simultaneous localisation and mapping algorithms, the technique proposed relies on a pre-built map represented as an unsigned distance function of the ground plane edges. Images from the camera are processed using a Convolutional Neural Network (CNN)to extract a ground plane edge image. Pixels that belong to these edges are used in the observation equation of the EKF to estimate the camera location. Use of the CNN makes it possible to extract ground plane edges under significant changes to scene illumination. The EKF framework lends itself to use of a suitable motion model, fusing information from any other sensors such as wheel encoders or inertial measurement units, if available, and rejecting spurious observations. A series of experiments are presented to demonstrate the effectiveness of the proposed technique

Ultra-wideband Based Indoor Localization of Mobile Nodes in ToA and TDoA Configurations

Zandian R. Ultra-wideband Based Indoor Localization of Mobile Nodes in ToA and TDoA Configurations. Bielefeld: Universität Bielefeld; 2019.This thesis discusses the utilization of ultra-wideband (UWB) technology in indoor localization scenarios and proposes system setup and evaluates different localization algorithms in order to improve the localization accuracy and stability of such systems in non-ideal conditions of the indoor environment. Recent developments and advances of technology in the areas of ubiquitous Internet, robotics and internet of things (IoT) have resulted in emerging new application areas in daily life in which localization systems are vital. The significant demand for a robust and accurate localization system that is applicable in indoor areas lacking satellites link, can be sensed. The UWB technology offers accurate localization systems with an accuracy of below 10 cm and covering the range of up to a few hundred meters thanks to their dedicated large bandwidth, modulation technique and signal power. In this thesis, the technology behind the UWB systems is discussed in detail. In terms of localization topologies, different scenarios with the focus on time-based methods are introduced. The main focus of this thesis is on the differential time of arrival localization systems (TDoA) with unilateral constellation that is suitable for robotic localization and navigation applications. A new approach for synchronization of TDoA topology is proposed and influence of clock inaccuracies in such systems are thoroughly evaluated. For localization engine, two groups of static and dynamic iterative algorithms are introduced. Among the possible dynamic methods, extended Kalman filter (EKF), H∞ and unscented Kalman filter (UKF) are discussed and meticulously evaluated. In order to tackle the non-line of sight (NLOS) problem of such systems, for detection stage several solutions which are based on parametric machine learning methods are proposed. Furthermore, for mitigation phase two solutions namely adjustment of measurement variance and innovation term are suggested. Practical results prove the efficiency and high reliability of the proposed algorithms with positive NLOS condition detection rate of more than 87%. In practical trials, the localization system is evaluated in indoor and outdoor arenas in both line of sight and non-line of sight conditions. The results show that the proposed detection and mitigation methods can be successfully applied for both small and large-scale arenas with the higher performance of the localization filters in terms of accuracy in large-scale scenarios

Wireless sensor networks for landslide monitoring: application and optimization by visibility analysis on 3D point clouds

Occurring in many geographical, geological and climatic environments, landslides represent a major geological hazard. In landslide prone areas, monitoring devices associated with Early Warning Systems are a cost-effective means to reduce the risk with a low environmental and economic impact, and in some cases, they can be the only solution. In this framework, particular interest has been reserved for Wireless Sensor Networks (WSNs), defined as networks of usually low-size and low-cost devices denoted as nodes, which are integrated with sensors that can gather information through wireless links. In this thesis, data from a new prototypical ground instability monitoring instrument called Wi-GIM (Wireless sensor network for Ground Instability Monitoring) have been analysed. The system consists in a WSN made by nodes able to measure their mutual inter-distances by calculating the time of flight of an Ultra-Wide Band impulse. Therefore, no sensors are implemented in the network, as the same signals used for transmission are also used for ranging. The system has been tested in a controlled outdoor environment and applied for the monitoring of the displacements of an actual landslide, the Roncovetro mudflow in Central Italy, where a parallel monitoring with a Robotic Total Station (RTS) allowed to validate the system. The outputs are displacement time series showing the distance of each couple of nodes belonging to the same cluster. Data retrieved from the tests revealed a precision of 2–5 cm and that measurements are influenced by the temperature. Since the correlation with this parameter has proved to be linear, a simple correction is sufficient to improve the precision and remove the effect of temperature. The campaign also revealed that measurements were not affected by rain or snow, and that the system can efficiently communicate up to 150 m with a 360° angle of view without affecting precision. Other key features of the implemented system are easy and quick installation, flexibility, low cost, real-time monitoring and acquisition frequency changeability. The comparison between Wi-GIM and RTS measurements pointed out the presence of an offset (in an order that vary from centimetric to decametric) constant for each single couple, due mainly to the presence of obstacles that can obstruct the Line Of Sight (LOS). The presence of vegetation is the main cause of the non-LOS condition between two nodes, which translates in a longer path of the signals and therefore to a less accurate distance measurements. To go further inside this issue, several tests have been carried out proving the strong influence of the vegetation over both data quantity and quality. To improve them, a MATLAB tool (R2018a, MAthWorks, Natick, MA, USA) called WiSIO (Wireless Sensor network Installation Optimizer) has been developed. The algorithm finds the best devices deployment following three criteria: (i) inter-visibility by means of a modified version of the Hidden Point Removal operator; (ii) equal distribution; (iii) positioning in preselected priority areas. With respect to the existing viewshed analysis, the main novelty is that it works directly with 3D point clouds, without rendering them or performing any surface. This lead to skip the process of generating surface models avoiding errors and approximations, that is essential when dealing with vegetation. A second installation of the Wi-GIM system has been therefore carried out considering the deployment suggested by WiSIO. The comparison of data acquired by the system positioned with and without the help of the proposed algorithm allowed to better comprehend the effectiveness of the tool. The presented results are very promising, showing how a simple elaboration can be essential to have more and more reliable data, improving the Wi-GIM system performances, making it even more usable in very complex environments and increasing its flexibility. The main left limitation of the Wi-GIM system is currently the precision. Such issue is connected to the aim of using only low-cost components, and it can be prospectively overcome if the system undergoes an industrialization process. Furthermore, since the system architecture is re-adaptable, it is prone to enhancements as soon as the technology advances and new low cost hardware enters the market