Optimal Image-Aided Inertial Navigation

The utilization of cameras in integrated navigation systems is among the most recent scientific research and high-tech industry development. The research is motivated by the requirement of calibrating off-the-shelf cameras and the fusion of imaging and inertial sensors in poor GNSS environments. The three major contributions of this dissertation are The development of a structureless camera auto-calibration and system calibration algorithm for a GNSS, IMU and stereo camera system. The auto-calibration bundle adjustment utilizes the scale restraint equation, which is free of object coordinates. The number of parameters to be estimated is significantly reduced in comparison with the ones in a self-calibrating bundle adjustment based on the collinearity equations. Therefore, the proposed method is computationally more efficient. The development of a loosely-coupled visual odometry aided inertial navigation algorithm. The fusion of the two sensors is usually performed using a Kalman filter. The pose changes are pairwise time-correlated, i.e. the measurement noise vector at the current epoch is only correlated with the one from the previous epoch. Time-correlated errors are usually modelled by a shaping filter. The shaping filter developed in this dissertation uses Cholesky factors as coefficients derived from the variance and covariance matrices of the measurement noise vectors. Test results with showed that the proposed algorithm performs better than the existing ones and provides more realistic covariance estimates. The development of a tightly-coupled stereo multi-frame aided inertial navigation algorithm for reducing position and orientation drifts. Usually, the image aiding based on the visual odometry uses the tracked features only from a pair of the consecutive image frames. The proposed method integrates the features tracked from multiple overlapped image frames for reducing the position and orientation drifts. The measurement equation is derived from SLAM measurement equation system where the landmark positions in SLAM are algebraically by time-differencing. However, the derived measurements are time-correlated. Through a sequential de-correlation, the Kalman filter measurement update can be performed sequentially and optimally. The main advantages of the proposed algorithm are the reduction of computational requirements when compared to SLAM and a seamless integration into an existing GNSS aided-IMU system

Autonomous Navigation for Mars Exploration

The autonomous navigation technology uses the multiple sensors to percept and estimate the spatial locations of the aerospace prober or the Mars rover and to guide their motions in the orbit or the Mars surface. In this chapter, the autonomous navigation methods for the Mars exploration are reviewed. First, the current development status of the autonomous navigation technology is summarized. The popular autonomous navigation methods, such as the inertial navigation, the celestial navigation, the visual navigation, and the integrated navigation, are introduced. Second, the application of the autonomous navigation technology for the Mars exploration is presented. The corresponding issues in the Entry Descent and Landing (EDL) phase and the Mars surface roving phase are mainly discussed. Third, some challenges and development trends of the autonomous navigation technology are also addressed

Location-Enabled IoT (LE-IoT): A Survey of Positioning Techniques, Error Sources, and Mitigation

The Internet of Things (IoT) has started to empower the future of many industrial and mass-market applications. Localization techniques are becoming key to add location context to IoT data without human perception and intervention. Meanwhile, the newly-emerged Low-Power Wide-Area Network (LPWAN) technologies have advantages such as long-range, low power consumption, low cost, massive connections, and the capability for communication in both indoor and outdoor areas. These features make LPWAN signals strong candidates for mass-market localization applications. However, there are various error sources that have limited localization performance by using such IoT signals. This paper reviews the IoT localization system through the following sequence: IoT localization system review -- localization data sources -- localization algorithms -- localization error sources and mitigation -- localization performance evaluation. Compared to the related surveys, this paper has a more comprehensive and state-of-the-art review on IoT localization methods, an original review on IoT localization error sources and mitigation, an original review on IoT localization performance evaluation, and a more comprehensive review of IoT localization applications, opportunities, and challenges. Thus, this survey provides comprehensive guidance for peers who are interested in enabling localization ability in the existing IoT systems, using IoT systems for localization, or integrating IoT signals with the existing localization sensors

Exploring the challenges and opportunities of image processing and sensor fusion in autonomous vehicles: A comprehensive review

Autonomous vehicles are at the forefront of future transportation solutions, but their success hinges on reliable perception. This review paper surveys image processing and sensor fusion techniques vital for ensuring vehicle safety and efficiency. The paper focuses on object detection, recognition, tracking, and scene comprehension via computer vision and machine learning methodologies. In addition, the paper explores challenges within the field, such as robustness in adverse weather conditions, the demand for real-time processing, and the integration of complex sensor data. Furthermore, we examine localization techniques specific to autonomous vehicles. The results show that while substantial progress has been made in each subfield, there are persistent limitations. These include a shortage of comprehensive large-scale testing, the absence of diverse and robust datasets, and occasional inaccuracies in certain studies. These issues impede the seamless deployment of this technology in real-world scenarios. This comprehensive literature review contributes to a deeper understanding of the current state and future directions of image processing and sensor fusion in autonomous vehicles, aiding researchers and practitioners in advancing the development of reliable autonomous driving systems

Advances in Intelligent Vehicle Control

This book is a printed edition of the Special Issue Advances in Intelligent Vehicle Control that was published in the journal Sensors. It presents a collection of eleven papers that covers a range of topics, such as the development of intelligent control algorithms for active safety systems, smart sensors, and intelligent and efficient driving. The contributions presented in these papers can serve as useful tools for researchers who are interested in new vehicle technology and in the improvement of vehicle control systems

The four key challenges of advanced multisensor navigation and positioning

The next generation of navigation and positioning systems must provide greater accuracy and reliability in a range of challenging environments to meet the needs of a variety of mission-critical applications. No single navigation technology is robust enough to meet these requirements on its own, so a multisensor solution is required. Although many new navigation and positioning methods have been developed in recent years, little has been done to bring them together into a robust, reliable, and cost-effective integrated system. To achieve this, four key challenges must be met: complexity, context, ambiguity, and environmental data handling. This paper addresses each of these challenges. It describes the problems, discusses possible approaches, and proposes a program of research and standardization activities to solve them. The discussion is illustrated with results from research into urban GNSS positioning, GNSS shadow matching, environmental feature matching, and context detection

The Estimation Methods for an Integrated INS/GPS UXO Geolocation System

This work was supported by a project funded by the US Army Corps of Engineers, Strategic Environment Research and Development Program, contract number W912HQ- 08-C-0044.This report was also submitted to the Graduate School of the Ohio State University in partial fulfillment of the PhD degree in Geodetic Science.Unexploded ordnance (UXO) is the explosive weapons such as mines, bombs, bullets, shells and grenades that failed to explode when they were employed. In North America, especially in the US, the UXO is the result of weapon system testing and troop training by the DOD. The traditional UXO detection method employs metal detectors which measure distorted signals of local magnetic fields. Based on detected magnetic signals, holes are dug to remove buried UXO. However, the detection and remediation of UXO contaminated sites using the traditional methods are extremely inefficient in that it is difficult to distinguish the buried UXO from the noise of geologic magnetic sources or anthropic clutter items. The reliable discrimination performance of UXO detection system depends on the employed sensor technology as well as on the data processing methods that invert the collected data to infer the UXO. The detection systems require very accurate positioning (or geolocation) of the detection units to detect and discriminate the candidate UXO from the non-hazardous clutter, greater position and orientation precision because the inversion of magnetic or EMI data relies on their precise relative locations, orientation, and depth. The requirements of position accuracy for MEC geolocation and characterization using typical state-of-the-art detection instrumentation are classified according to levels of accuracy outlined in: the screening level with position tolerance of 0.5 m (as standard deviation), area mapping (less than 0.05 m), and characterize and discriminate level of accuracy (less than 0.02m). The primary geolocation system is considered as a dual-frequency GPS integrated with a three dimensional inertial measurement unit (IMU); INS/GPS system. Selecting the appropriate estimation method has been the key problem to obtain highly precise geolocation of INS/GPS system for the UXO detection performance in dynamic environments. For this purpose, the Extended Kalman Filter (EKF) has been used as the conventional algorithm for the optimal integration of INS/GPS system. However, the newly introduced non-linear based filters can deal with the non-linear nature of the positioning dynamics as well as the non-Gaussian statistics for the instrument errors, and the non-linear based estimation methods (filtering/smoothing) have been developed and proposed. Therefore, this study focused on the optimal estimation methods for the highly precise geolocation of INS/GPS system using simulations and analyses of two Laboratory tests (cart-based and handheld geolocation system). First, the non-linear based filters (UKF and UKF) have been shown to yield superior performance than the EKF in various specific simulation tests which are designed similar to the UXO geolocation environment (highly dynamic and small area). The UKF yields 50% improvement in the position accuracy over the EKF particularly in the curved sections (medium-grade IMUs case). The UKF also performed significantly better than EKF and shows comparable improvement over the UKF when the IMU noise probability iii density function is symmetric and non-symmetric. Also, since the UXO detection survey does not require the real-time operations, each of the developed filters was modified to accommodate the standard Rauch-Tung-Striebel (RTS) smoothing algorithms. The smoothing methods are applied to the typical UXO detection trajectory; the position error was reduced significantly using a minimal number of control points. Finally, these simulation tests confirmed that tactical-grade IMUs (e.g. HG1700 or HG1900) are required to bridge gaps of high-accuracy ranging solution systems longer than 1 second. Second, these result of the simulation tests were validated from the laboratory tests using navigation-grade and medium-grade accuracy IMUs. To overcome inaccurate a priori knowledge of process noise of the system, the adaptive filtering methods have been applied to the EKF and UKF and they are called the AEKS and AUKS. The neural network aided adaptive nonlinear filtering/smoothing methods (NN-EKS and NN-UKS) which are augmented with RTS smoothing method were compared with the AEKS and AUKS. Each neural network-aided, adaptive filter/smoother improved the position accuracy in both straight and curved sections. The navigation grade IMU (H764G) can achieve the area mapping level of accuracy when the gap of control points is about 8 seconds. The medium grade IMUs (HG1700 and HG1900) with NN-AUKS can maintain less than 10cm under the same conditions as above. Also, the neural network aiding can decrease the difference of position error between the straight and the curved section. Third, in the previous simulation test, the UPF performed better than the other filters. However since the UPF needs a large number of samples to represent the a posteriori statistics in high-dimensional space, the RBPF can be used as an alternative to avoid the inefficiency of particle filter. The RBPF is tailored to precise geolocation for UXO detection using IMU/GPS system and yielded improved estimation results with a small number of samples. The handheld geolocation system using HG1900 with a nonlinear filter-based smoother can achieve the discrimination level of accuracy if the update rate of control points is less than 0.5Hz and 1Hz for the sweep and swing respectively. Also, the sweep operation is more preferred than the swing motion because the position accuracy of the sweep test was better than that of the swing test