Multi-Antenna Vision-and-Inertial-Aided CDGNSS for Micro Aerial Vehicle Pose Estimation

A system is presented for multi-antenna carrier phase differential GNSS (CDGNSS)-based pose (position and orientation) estimation aided by monocular visual measurements and a smartphone-grade inertial sensor. The system is designed for micro aerial vehicles, but can be applied generally for low-cost, lightweight, high-accuracy, geo-referenced pose estimation. Visual and inertial measurements enable robust operation despite GNSS degradation by constraining uncertainty in the dynamics propagation, which improves fixed-integer CDGNSS availability and reliability in areas with limited sky visibility. No prior work has demonstrated an increased CDGNSS integer fixing rate when incorporating visual measurements with smartphone-grade inertial sensing. A central pose estimation filter receives measurements from separate CDGNSS position and attitude estimators, visual feature measurements based on the ROVIO measurement model, and inertial measurements. The filter's pose estimates are fed back as a prior for CDGNSS integer fixing. A performance analysis under both simulated and real-world GNSS degradation shows that visual measurements greatly increase the availability and accuracy of low-cost inertial-aided CDGNSS pose estimation.Aerospace Engineering and Engineering Mechanic

Reliable Positioning and Journey Planning for Intelligent Transport Systems

Safety and reliability of intelligent transport systems applications require positioning accuracy at the sub-meter level with availability and integrity above 99%. At present, no single positioning sensor can meet these requirements in particular in the urban environment. Possible sensors that can be used for this task are first reviewed. Next, a suggested integrated system of low-cost real-time kinematic (RTK) GNSS, inertial measurement units (IMU) and vehicle odometer is discussed. To ensure positioning integrity, a method for fault detection in GNSS observations and computation of the protection levels (PL) that bound the position errors at a pre-set risk probability of the integrated sensors are presented. A case study is performed for demonstration. Moreover, to save energy, reduce pollution, and to improve the economy of the trip, proper journey planning is required. A new approach is introduced using 3D city models to predict the route with the best positioning integrity, availability and precision for route selection among different possible routes. The practical demonstration shows that effectiveness of this method. Finally, the potential of using the next generation SBAS for ITS applications was tested using kinematic tests carried out in various environments characterized by different levels of sky-visibility that may affect observations from GNSS

Survey on Recent Advances in Integrated GNSSs Towards Seamless Navigation Using Multi-Sensor Fusion Technology

During the past few decades, the presence of global navigation satellite systems (GNSSs) such as GPS, GLONASS, Beidou and Galileo has facilitated positioning, navigation and timing (PNT) for various outdoor applications. With the rapid increase in the number of orbiting satellites per GNSS, enhancements in the satellite-based augmentation systems (SBASs) such as EGNOS and WAAS, as well as commissioning new GNSS constellations, the PNT capabilities are maximized to reach new frontiers. Additionally, the recent developments in precise point positioning (PPP) and real time kinematic (RTK) algorithms have provided more feasibility to carrier-phase precision positioning solutions up to the third-dimensional localization. With the rapid growth of internet of things (IoT) applications, seamless navigation becomes very crucial for numerous PNT dependent applications especially in sensitive fields such as safety and industrial applications. Throughout the years, GNSSs have maintained sufficiently acceptable performance in PNT, in RTK and PPP applications however GNSS experienced major challenges in some complicated signal environments. In many scenarios, GNSS signal suffers deterioration due to multipath fading and attenuation in densely obscured environments that comprise stout obstructions. Recently, there has been a growing demand e.g. in the autonomous-things domain in adopting reliable systems that accurately estimate position, velocity and time (PVT) observables. Such demand in many applications also facilitates the retrieval of information about the six degrees of freedom (6-DOF - x, y, z, roll, pitch, and heading) movements of the target anchors. Numerous modern applications are regarded as beneficiaries of precise PNT solutions such as the unmanned aerial vehicles (UAV), the automatic guided vehicles (AGV) and the intelligent transportation system (ITS). Hence, multi-sensor fusion technology has become very vital in seamless navigation systems owing to its complementary capabilities to GNSSs. Fusion-based positioning in multi-sensor technology comprises the use of multiple sensors measurements for further refinement in addition to the primary GNSS, which results in high precision and less erroneous localization. Inertial navigation systems (INSs) and their inertial measurement units (IMUs) are the most commonly used technologies for augmenting GNSS in multi-sensor integrated systems. In this article, we survey the most recent literature on multi-sensor GNSS technology for seamless navigation. We provide an overall perspective for the advantages, the challenges and the recent developments of the fusion-based GNSS navigation realm as well as analyze the gap between scientific advances and commercial offerings. INS/GNSS and IMU/GNSS systems have proven to be very reliable in GNSS-denied environments where satellite signal degradation is at its peak, that is why both integrated systems are very abundant in the relevant literature. In addition, the light detection and ranging (LiDAR) systems are widely adopted in the literature for its capability to provide 6-DOF to mobile vehicles and autonomous robots. LiDARs are very accurate systems however they are not suitable for low-cost positioning due to the expensive initial costs. Moreover, several other techniques from the radio frequency (RF) spectrum are utilized as multi-sensor systems such as cellular networks, WiFi, ultra-wideband (UWB) and Bluetooth. The cellular-based systems are very suitable for outdoor navigation applications while WiFi-based, UWB-based and Bluetooth-based systems are efficient in indoor positioning systems (IPS). However, to achieve reliable PVT estimations in multi-sensor GNSS navigation, optimal algorithms should be developed to mitigate the estimation errors resulting from non-line-of-sight (NLOS) GNSS situations. Examples of the most commonly used algorithms for trilateration-based positioning are Kalman filters, weighted least square (WLS), particle filters (PF) and many other hybrid algorithms by mixing one or more algorithms together. In this paper, the reviewed articles under study and comparison are presented by highlighting their motivation, the methodology of implementation, the modelling utilized and the performed experiments. Then they are assessed with respect to the published results focusing on achieved accuracy, robustness and overall implementation cost-benefits as performance metrics. Our summarizing survey assesses the most promising, highly ranked and recent articles that comprise insights into the future of GNSS technology with multi-sensor fusion technique.©2021 The Authors. Published by ION.fi=vertaisarvioimaton|en=nonPeerReviewed

3D LiDAR Aided GNSS NLOS Mitigation for Reliable GNSS-RTK Positioning in Urban Canyons

GNSS and LiDAR odometry are complementary as they provide absolute and relative positioning, respectively. Their integration in a loosely-coupled manner is straightforward but is challenged in urban canyons due to the GNSS signal reflections. Recent proposed 3D LiDAR-aided (3DLA) GNSS methods employ the point cloud map to identify the non-line-of-sight (NLOS) reception of GNSS signals. This facilitates the GNSS receiver to obtain improved urban positioning but not achieve a sub-meter level. GNSS real-time kinematics (RTK) uses carrier phase measurements to obtain decimeter-level positioning. In urban areas, the GNSS RTK is not only challenged by multipath and NLOS-affected measurement but also suffers from signal blockage by the building. The latter will impose a challenge in solving the ambiguity within the carrier phase measurements. In the other words, the model observability of the ambiguity resolution (AR) is greatly decreased. This paper proposes to generate virtual satellite (VS) measurements using the selected LiDAR landmarks from the accumulated 3D point cloud maps (PCM). These LiDAR-PCM-made VS measurements are tightly-coupled with GNSS pseudorange and carrier phase measurements. Thus, the VS measurements can provide complementary constraints, meaning providing low-elevation-angle measurements in the across-street directions. The implementation is done using factor graph optimization to solve an accurate float solution of the ambiguity before it is fed into LAMBDA. The effectiveness of the proposed method has been validated by the evaluation conducted on our recently open-sourced challenging dataset, UrbanNav. The result shows the fix rate of the proposed 3DLA GNSS RTK is about 30% while the conventional GNSS-RTK only achieves about 14%. In addition, the proposed method achieves sub-meter positioning accuracy in most of the data collected in challenging urban areas

Open-World Virtual Reality Headset Tracking

A novel outdoor Virtual Reality (VR) concept called Open-World Virtual Reality (OWVR) is presented that combines precise GNSS positioning and a smartphone-grade inertial sensor to provide globally-referenced centimeter-and-degree-accurate tracking of the VR headset. Unlike existing augmented and virtual reality systems, which perform camera-based inside-out headset tracking relative to a local reference frame (e.g., an ad-hoc frame fixed to a living room), OWVR's globally-referenced tracking enables a novel VR experience in which the user's outdoor exploration is robust to extremes in lighting conditions and local visual texture. This paper introduces the OWVR concept and presents a prototype OWVR system with two candidate sensor fusion architectures, one loosely and one tightly coupled. Comparative performance is evaluated in terms of tracking accuracy and availability of an integer-aperture-test-validated fixed tracking solution. For scenarios with degraded GNSS availability, which will be typical for outdoor VR, the tightly-coupled architecture is shown to offer a critical tracking robustness advantage.Aerospace Engineering and Engineering Mechanic

Innovative Solutions for Navigation and Mission Management of Unmanned Aircraft Systems

The last decades have witnessed a significant increase in Unmanned Aircraft Systems (UAS) of all shapes and sizes. UAS are finding many new applications in supporting several human activities, offering solutions to many dirty, dull, and dangerous missions, carried out by military and civilian users. However, limited access to the airspace is the principal barrier to the realization of the full potential that can be derived from UAS capabilities. The aim of this thesis is to support the safe integration of UAS operations, taking into account both the user's requirements and flight regulations. The main technical and operational issues, considered among the principal inhibitors to the integration and wide-spread acceptance of UAS, are identified and two solutions for safe UAS operations are proposed: A. Improving navigation performance of UAS by exploiting low-cost sensors. To enhance the performance of the low-cost and light-weight integrated navigation system based on Global Navigation Satellite System (GNSS) and Micro Electro-Mechanical Systems (MEMS) inertial sensors, an efficient calibration method for MEMS inertial sensors is required. Two solutions are proposed: 1) The innovative Thermal Compensated Zero Velocity Update (TCZUPT) filter, which embeds the compensation of thermal effect on bias in the filter itself and uses Back-Propagation Neural Networks to build the calibration function. Experimental results show that the TCZUPT filter is faster than the traditional ZUPT filter in mapping significant bias variations and presents better performance in the overall testing period. Moreover, no calibration pre-processing stage is required to keep measurement drift under control, improving the accuracy, reliability, and maintainability of the processing software; 2) A redundant configuration of consumer grade inertial sensors to obtain a self-calibration of typical inertial sensors biases. The result is a significant reduction of uncertainty in attitude determination. In conclusion, both methods improve dead-reckoning performance for handling intermittent GNSS coverage. B. Proposing novel solutions for mission management to support the Unmanned Traffic Management (UTM) system in monitoring and coordinating the operations of a large number of UAS. Two solutions are proposed: 1) A trajectory prediction tool for small UAS, based on Learning Vector Quantization (LVQ) Neural Networks. By exploiting flight data collected when the UAS executes a pre-assigned flight path, the tool is able to predict the time taken to fly generic trajectory elements. Moreover, being self-adaptive in constructing a mathematical model, LVQ Neural Networks allow creating different models for the different UAS types in several environmental conditions; 2) A software tool aimed at supporting standardized procedures for decision-making process to identify UAS/payload configurations suitable for any type of mission that can be authorized standing flight regulations. The proposed methods improve the management and safe operation of large-scale UAS missions, speeding up the flight authorization process by the UTM system and supporting the increasing level of autonomy in UAS operations

Optimized Filter Design for Non-Differential GPS/IMU Integrated Navigation

The endeavours in improving the performance of a conventional non-differential GPS/MEMS IMU tightly-coupled navigation system through filter design, involving nonlinear filtering methods, inertial sensors' stochastic error modelling and the carrier phase implementation, are described and introduced in this thesis. The main work is summarised as follows. Firstly, the performance evaluation of a recently developed nonlinear filtering method, the Cubature Kalman filter (CKF), is analysed based on the Taylor expansion. The theoretical analysis indicates that the nonlinear filtering method CKF shows its benefits only when implemented in a nonlinear system. Accordingly, a nonlinear attitude expression with direction cosine matrix (DCM) is introduced to tightly-coupled navigation system in order to describe the misalignment between the true and the estimated navigation frames. The simulation and experiment results show that the CKF performs better than the extended Kalman filter (EKF) in the unobservable, large misalignment and GPS outage cases when attitude errors accumulate quickly, rendering the psi-angle expression invalid and subsequently showing certain nonlinearity. Secondly, the use of shaping filter theory to model the inertial sensors' stochastic errors in a navigation Kalman filter is also introduced. The coefficients of the inertial sensors' noises are determined from the Allan variance plot. The shaping filter transfer function is deduced from the power spectral density (PSD) of the noises for both stationary and non-stationary processes. All the coloured noises are modelled together in the navigation Kalman filter according to equivalence theory. The coasting performance shows that the shaping filter based modelling method has a similar and even smaller maximum position drift than the conventional 1st-order Markovian process modelling method during GPS outages, thus indicating its effectiveness. Thirdly, according to the methods of dealing with carrier phase ambiguities, tightly-coupled navigation systems with time differenced carrier phase (TDCP) and total carrier phase (TCP) as Kalman filter measurements are deduced. The simulation and experiment results show that the TDCP can improve the velocity estimation accuracy and smooth trajectories, but position accuracy can only achieve the single point positioning (SPP) level if the TDCP is augmented with the pseudo-range, while the TCP based method's position accuracy can reach the sub-meter level. In order to further improve the position accuracy of the TDCP based method, a particle filter (PF) with modified TDCP observation is implemented in the TDCP/IMU tightly-coupled navigation system. The modified TDCP is defined as the carrier phase difference between the reference and observation epochs. The absolute position accuracy is determined by the reference position accuracy. If the reference position is taken from DGPS, the absolute position accuracy can reach the sub-meter level. For TCP/IMU tightly-coupled navigation systems, because the implementation of TCP in the navigation Kalman filter introduces additional states to the state vector, a hybrid CKF+EKF filtering method with the CKF estimating nonlinear states and the EKF estimating linear states, is proposed to maintain the CKF's benefits while reducing the computational load. The navigation results indicate the effectiveness of the method. After applying the improvements, the performance of a non-differential GPS/MEMS IMU tightly-coupled navigation system can be greatly improved

Generic Multisensor Integration Strategy and Innovative Error Analysis for Integrated Navigation

A modern multisensor integrated navigation system applied in most of civilian applications typically consists of GNSS (Global Navigation Satellite System) receivers, IMUs (Inertial Measurement Unit), and/or other sensors, e.g., odometers and cameras. With the increasing availabilities of low-cost sensors, more research and development activities aim to build a cost-effective system without sacrificing navigational performance. Three principal contributions of this dissertation are as follows: i) A multisensor kinematic positioning and navigation system built on Linux Operating System (OS) with Real Time Application Interface (RTAI), York University Multisensor Integrated System (YUMIS), was designed and realized to integrate GNSS receivers, IMUs, and cameras. YUMIS sets a good example of a low-cost yet high-performance multisensor inertial navigation system and lays the ground work in a practical and economic way for the personnel training in following academic researches. ii) A generic multisensor integration strategy (GMIS) was proposed, which features a) the core system model is developed upon the kinematics of a rigid body; b) all sensor measurements are taken as raw measurement in Kalman filter without differentiation. The essential competitive advantages of GMIS over the conventional error-state based strategies are: 1) the influences of the IMU measurement noises on the final navigation solutions are effectively mitigated because of the increased measurement redundancy upon the angular rate and acceleration of a rigid body; 2) The state and measurement vectors in the estimator with GMIS can be easily expanded to fuse multiple inertial sensors and all other types of measurements, e.g., delta positions; 3) one can directly perform error analysis upon both raw sensor data (measurement noise analysis) and virtual zero-mean process noise measurements (process noise analysis) through the corresponding measurement residuals of the individual measurements and the process noise measurements. iii) The a posteriori variance component estimation (VCE) was innovatively accomplished as an advanced analytical tool in the extended Kalman Filter employed by the GMIS, which makes possible the error analysis of the raw IMU measurements for the very first time, together with the individual independent components in the process noise vector