Asynchronous sensor fusion of GPS, IMU and CAN-based odometry for heavy-duty vehicles

In heavy-duty vehicles, multiple signals are available to estimate the vehicle's kinematics, such as Inertial Measurement Unit (IMU), Global Positioning System (GPS) and linear and angular speed readings from wheel tachometers on the internal Controller Area Network (CAN). These signals have different noise variance, bandwidth and sampling rate (being the latter, possibly, irregular). In this paper we present a non-linear sensor fusion algorithm allowing asynchronous sampling and non-causal smoothing. It is applied to achieve accuracy improvements when incorporating odometry measurements from CAN bus to standard GPS+IMU kinematic estimation, as well as the robustness against missing data. Our results show that this asynchronous multi-sensor (GPS+IMU+CAN-based odometry) fusion is advantageous in low-speed manoeuvres, improving accuracy and robustness to missing data, thanks to non-causal filtering. The proposed algorithm is based on Extended Kalman Filter and Smoother, with exponential discretization of continuous-time stochastic differential equations, in order to process measurements at arbitrary time instants; it can provide data to subsequent processing steps at arbitrary time instants, not necessarily coincident with the original measurement ones. Given the extra information available in the smoothing case, its estimation performance is less sensitive to the noise-variance parameter setting, compared to causal filtering. Working Matlab code is provided at the end of this work

Automated Automotive Radar Calibration With Intelligent Vehicles

While automotive radar sensors are widely adopted and have been used for automatic cruise control and collision avoidance tasks, their application outside of vehicles is still limited. As they have the ability to resolve multiple targets in 3D space, radars can also be used for improving environment perception. This application, however, requires a precise calibration, which is usually a time-consuming and labor-intensive task. We, therefore, present an approach for automated and geo-referenced extrinsic calibration of automotive radar sensors that is based on a novel hypothesis filtering scheme. Our method does not require external modifications of a vehicle and instead uses the location data obtained from automated vehicles. This location data is then combined with filtered sensor data to create calibration hypotheses. Subsequent filtering and optimization recovers the correct calibration. Our evaluation on data from a real testing site shows that our method can correctly calibrate infrastructure sensors in an automated manner, thus enabling cooperative driving scenarios.Comment: 5 pages, 4 figures, accepted for presentation at the 31st European Signal Processing Conference (EUSIPCO), September 4 - September 8, 2023, Helsinki, Finlan

The Estimation Methods for an Integrated INS/GPS UXO Geolocation System

This work was supported by a project funded by the US Army Corps of Engineers, Strategic Environment Research and Development Program, contract number W912HQ- 08-C-0044.This report was also submitted to the Graduate School of the Ohio State University in partial fulfillment of the PhD degree in Geodetic Science.Unexploded ordnance (UXO) is the explosive weapons such as mines, bombs, bullets, shells and grenades that failed to explode when they were employed. In North America, especially in the US, the UXO is the result of weapon system testing and troop training by the DOD. The traditional UXO detection method employs metal detectors which measure distorted signals of local magnetic fields. Based on detected magnetic signals, holes are dug to remove buried UXO. However, the detection and remediation of UXO contaminated sites using the traditional methods are extremely inefficient in that it is difficult to distinguish the buried UXO from the noise of geologic magnetic sources or anthropic clutter items. The reliable discrimination performance of UXO detection system depends on the employed sensor technology as well as on the data processing methods that invert the collected data to infer the UXO. The detection systems require very accurate positioning (or geolocation) of the detection units to detect and discriminate the candidate UXO from the non-hazardous clutter, greater position and orientation precision because the inversion of magnetic or EMI data relies on their precise relative locations, orientation, and depth. The requirements of position accuracy for MEC geolocation and characterization using typical state-of-the-art detection instrumentation are classified according to levels of accuracy outlined in: the screening level with position tolerance of 0.5 m (as standard deviation), area mapping (less than 0.05 m), and characterize and discriminate level of accuracy (less than 0.02m). The primary geolocation system is considered as a dual-frequency GPS integrated with a three dimensional inertial measurement unit (IMU); INS/GPS system. Selecting the appropriate estimation method has been the key problem to obtain highly precise geolocation of INS/GPS system for the UXO detection performance in dynamic environments. For this purpose, the Extended Kalman Filter (EKF) has been used as the conventional algorithm for the optimal integration of INS/GPS system. However, the newly introduced non-linear based filters can deal with the non-linear nature of the positioning dynamics as well as the non-Gaussian statistics for the instrument errors, and the non-linear based estimation methods (filtering/smoothing) have been developed and proposed. Therefore, this study focused on the optimal estimation methods for the highly precise geolocation of INS/GPS system using simulations and analyses of two Laboratory tests (cart-based and handheld geolocation system). First, the non-linear based filters (UKF and UKF) have been shown to yield superior performance than the EKF in various specific simulation tests which are designed similar to the UXO geolocation environment (highly dynamic and small area). The UKF yields 50% improvement in the position accuracy over the EKF particularly in the curved sections (medium-grade IMUs case). The UKF also performed significantly better than EKF and shows comparable improvement over the UKF when the IMU noise probability iii density function is symmetric and non-symmetric. Also, since the UXO detection survey does not require the real-time operations, each of the developed filters was modified to accommodate the standard Rauch-Tung-Striebel (RTS) smoothing algorithms. The smoothing methods are applied to the typical UXO detection trajectory; the position error was reduced significantly using a minimal number of control points. Finally, these simulation tests confirmed that tactical-grade IMUs (e.g. HG1700 or HG1900) are required to bridge gaps of high-accuracy ranging solution systems longer than 1 second. Second, these result of the simulation tests were validated from the laboratory tests using navigation-grade and medium-grade accuracy IMUs. To overcome inaccurate a priori knowledge of process noise of the system, the adaptive filtering methods have been applied to the EKF and UKF and they are called the AEKS and AUKS. The neural network aided adaptive nonlinear filtering/smoothing methods (NN-EKS and NN-UKS) which are augmented with RTS smoothing method were compared with the AEKS and AUKS. Each neural network-aided, adaptive filter/smoother improved the position accuracy in both straight and curved sections. The navigation grade IMU (H764G) can achieve the area mapping level of accuracy when the gap of control points is about 8 seconds. The medium grade IMUs (HG1700 and HG1900) with NN-AUKS can maintain less than 10cm under the same conditions as above. Also, the neural network aiding can decrease the difference of position error between the straight and the curved section. Third, in the previous simulation test, the UPF performed better than the other filters. However since the UPF needs a large number of samples to represent the a posteriori statistics in high-dimensional space, the RBPF can be used as an alternative to avoid the inefficiency of particle filter. The RBPF is tailored to precise geolocation for UXO detection using IMU/GPS system and yielded improved estimation results with a small number of samples. The handheld geolocation system using HG1900 with a nonlinear filter-based smoother can achieve the discrimination level of accuracy if the update rate of control points is less than 0.5Hz and 1Hz for the sweep and swing respectively. Also, the sweep operation is more preferred than the swing motion because the position accuracy of the sweep test was better than that of the swing test

Tracking and Estimation Algorithms for Bearings Only Measurements

The Bearings-only tracking problem is to estimate the state of a moving object from noisy observations of its direction relative to a sensor. The Kalman filter, which provides least squares estimates for linear Gaussian filtering problems is not directly applicable because of the highly nonlinear measurement function of the state, representing the bearings measurements and so other types of filters must be considered. The shifted Rayleigh filter (SRF) is a highly effective moment-matching bearings-only tracking algorithm which has been shown, in 2D, to achieve the accuracy of computationally demanding particle filters in situations where the well-known extended Kalman filter and unscented Kalman filter often fail. This thesis has two principal aims. The first is to develop accurate and computationally efficient algorithms for bearings-only tracking in 3D space. We propose algorithms based on the SRF, that allow tracking, in the presence of clutter, of both nonmaneuvering and maneuvering targets. Their performances are assessed, in relation to competing methods, in highly challenging tracking scenarios, where they are shown to match the accuracy of high-order sophisticated particle filters, at a fraction of the computational cost. The second is to design accurate and consistent algorithms for bearings-only simultaneous localization and mapping (SLAM). The difficulty of this problem, originating from the uncertainty in the position and orientation of the sensor, and the absence of range information of observed landmarks, motivates the use of advanced bearings-only tracking algorithms. We propose the quadrature-SRF SLAM algorithm, which is a moment-matching filter based on the SRF, that numerically evaluates the exact mean and covariance of the posterior. Simulations illustrate the accuracy and consistency of its estimates in a situation where a widely used moment-matching algorithm fails to produce consistent estimates. We also propose a Rao-Blackwellized SRF implementation of a particle filter, which, however, does not exhibit favorable consistency properties

Clothoid-based Planning and Control in Intelligent Vehicles (Autonomous and Manual-Assisted Driving)

[EN] Nowadays, there are many electronic products that incorporate elements and features coming from the research in the field of mobile robotics. For instance, the well-known vacuum cleaning robot Roomba by iRobot, which belongs to the field of service robotics, one of the most active within the sector. There are also numerous autonomous robotic systems in industrial warehouses and plants. It is the case of Autonomous Guided Vehicles (AGVs), which are able to drive completely autonomously in very structured environments. Apart from industry and consumer electronics, within the automotive field there are some devices that give intelligence to the vehicle, derived in most cases from advances in mobile robotics. In fact, more and more often vehicles incorporate Advanced Driver Assistance Systems (ADAS), such as navigation control with automatic speed regulation, lane change and overtaking assistant, automatic parking or collision warning, among other features. However, despite all the advances there are some problems that remain unresolved and can be improved. Collisions and rollovers stand out among the most common accidents of vehicles with manual or autonomous driving. In fact, it is almost impossible to guarantee driving without accidents in unstructured environments where vehicles share the space with other moving agents, such as other vehicles and pedestrians. That is why searching for techniques to improve safety in intelligent vehicles, either autonomous or manual-assisted driving, is still a trending topic within the robotics community. This thesis focuses on the design of tools and techniques for planning and control of intelligent vehicles in order to improve safety and comfort. The dissertation is divided into two parts, the first one on autonomous driving and the second one on manual-assisted driving. The main link between them is the use of clothoids as mathematical formulation for both trajectory generation and collision detection. Among the problems solved the following stand out: obstacle avoidance, rollover avoidance and advanced driver assistance to avoid collisions with pedestrians.[ES] En la actualidad se comercializan infinidad de productos de electrónica de consumo que incorporan elementos y características procedentes de avances en el sector de la robótica móvil. Por ejemplo, el conocido robot aspirador Roomba de la empresa iRobot, el cual pertenece al campo de la robótica de servicio, uno de los más activos en el sector. También hay numerosos sistemas robóticos autónomos en almacenes y plantas industriales. Es el caso de los vehículos autoguiados (AGVs), capaces de conducir de forma totalmente autónoma en entornos muy estructurados. Además de en la industria y en electrónica de consumo, dentro del campo de la automoción también existen dispositivos que dotan de cierta inteligencia al vehículo, derivados la mayoría de las veces de avances en robótica móvil. De hecho, cada vez con mayor frecuencia los vehículos incorporan sistemas avanzados de asistencia al conductor (ADAS por sus siglas en inglés), tales como control de navegación con regulación automática de velocidad, asistente de cambio de carril y adelantamiento, aparcamiento automático o aviso de colisión, entre otras prestaciones. No obstante, pese a todos los avances siguen existiendo problemas sin resolver y que pueden mejorarse. La colisión y el vuelco destacan entre los accidentes más comunes en vehículos con conducción tanto manual como autónoma. De hecho, la dificultad de conducir en entornos desestructurados compartiendo el espacio con otros agentes móviles, tales como coches o personas, hace casi imposible garantizar la conducción sin accidentes. Es por ello que la búsqueda de técnicas para mejorar la seguridad en vehículos inteligentes, ya sean de conducción autónoma o manual asistida, es un tema que siempre está en auge en la comunidad robótica. La presente tesis se centra en el diseño de herramientas y técnicas de planificación y control de vehículos inteligentes, para la mejora de la seguridad y el confort. La disertación se ha dividido en dos partes, la primera sobre conducción autónoma y la segunda sobre conducción manual asistida. El principal nexo de unión es el uso de clotoides como elemento de generación de trayectorias y detección de colisiones. Entre los problemas que se resuelven destacan la evitación de obstáculos, la evitación de vuelcos y la asistencia avanzada al conductor para evitar colisiones con peatones.[CA] En l'actualitat es comercialitzen infinitat de productes d'electrònica de consum que incorporen elements i característiques procedents d'avanços en el sector de la robòtica mòbil. Per exemple, el conegut robot aspirador Roomba de l'empresa iRobot, el qual pertany al camp de la robòtica de servici, un dels més actius en el sector. També hi ha nombrosos sistemes robòtics autònoms en magatzems i plantes industrials. És el cas dels vehicles autoguiats (AGVs), els quals són capaços de conduir de forma totalment autònoma en entorns molt estructurats. A més de en la indústria i en l'electrònica de consum, dins el camp de l'automoció també existeixen dispositius que doten al vehicle de certa intel·ligència, la majoria de les vegades derivats d'avanços en robòtica mòbil. De fet, cada vegada amb més freqüència els vehicles incorporen sistemes avançats d'assistència al conductor (ADAS per les sigles en anglés), com ara control de navegació amb regulació automàtica de velocitat, assistent de canvi de carril i avançament, aparcament automàtic o avís de col·lisió, entre altres prestacions. No obstant això, malgrat tots els avanços segueixen existint problemes sense resoldre i que poden millorar-se. La col·lisió i la bolcada destaquen entre els accidents més comuns en vehicles amb conducció tant manual com autònoma. De fet, la dificultat de conduir en entorns desestructurats compartint l'espai amb altres agents mòbils, tals com cotxes o persones, fa quasi impossible garantitzar la conducció sense accidents. És per això que la recerca de tècniques per millorar la seguretat en vehicles intel·ligents, ja siguen de conducció autònoma o manual assistida, és un tema que sempre està en auge a la comunitat robòtica. La present tesi es centra en el disseny d'eines i tècniques de planificació i control de vehicles intel·ligents, per a la millora de la seguretat i el confort. La dissertació s'ha dividit en dues parts, la primera sobre conducció autònoma i la segona sobre conducció manual assistida. El principal nexe d'unió és l'ús de clotoides com a element de generació de trajectòries i detecció de col·lisions. Entre els problemes que es resolen destaquen l'evitació d'obstacles, l'evitació de bolcades i l'assistència avançada al conductor per evitar col·lisions amb vianants.Girbés Juan, V. (2016). Clothoid-based Planning and Control in Intelligent Vehicles (Autonomous and Manual-Assisted Driving) [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/65072TESI

Particle tracking using the unscented Kalman filter in high energy physics experiments

This thesis was submitted for the award of Doctor of Philosophy and was awarded by Brunel University London.The extended Kalman lter (EKF) has a long history in the field of non-linear tracking. More recently, statistically-based estimators have emerged that avoid the need for a deterministic linearisation process. The Unscented Kalman filter (UKF) is one such technique that has been shown to perform favourably for some non-linear systems when compared to an EKF implementation, both in terms of accuracy and robustness. In this Thesis, the UKF is applied to a high energy physics particle tracking problem where currently the EKF is being implemented. The effects of measurement redundancy are investigated to determine improvements in accuracy of particle track reconstruction. The relationship between measurement redundancy and relative observability is also investigated through an experimental and theoretical analysis. Smoothing (backward filtering), in the high energy physics experiments, is implementedusing the Rauch Tung Striebel (RTS) smoother with the EKF , however, in Unscented Kalman filter algorithms, the Jacobian matrices required by the RTS method, are not available. The Unscented Rauch Tung Striebel (URTS) smoother addresses this problem by avoiding the use of Jacobian matrices but is not effi cient for large dimensional systems such as high energy physics experiments. A technique is implemented in the RTS smoother to make it suitable for the UKF. The method is given the name the Jacobian Equivalent Rauch Tung Striebel (JE-RTS) smoother. The implementation of this method is quite straight forward when the UKF is used as an estimator

Long-Term Localization for Self-Driving Cars

Long-term localization is hard due to changing conditions, while relative localization within time sequences is much easier. To achieve long-term localization in a sequential setting, such as, for self-driving cars, relative localization should be used to the fullest extent, whenever possible.This thesis presents solutions and insights both for long-term sequential visual localization, and localization using global navigational satellite systems (GNSS), that push us closer to the goal of accurate and reliable localization for self-driving cars. It addresses the question: How to achieve accurate and robust, yet cost-effective long-term localization for self-driving cars?Starting in this question, the thesis explores how existing sensor suites for advanced driver-assistance systems (ADAS) can be used most efficiently, and how landmarks in maps can be recognized and used for localization even after severe changes in appearance. The findings show that:* State-of-the-art ADAS sensors are insufficient to meet the requirements for localization of a self-driving car in less than ideal conditions.GNSS and visual localization are identified as areas to improve.\ua0* Highly accurate relative localization with no convergence delay is possible by using time relative GNSS observations with a single band receiver, and no base stations.\ua0* Sequential semantic localization is identified as a promising focus point for further research based on a benchmark study comparing state-of-the-art visual localization methods in challenging autonomous driving scenarios including day-to-night and seasonal changes.\ua0* A novel sequential semantic localization algorithm improves accuracy while significantly reducing map size compared to traditional methods based on matching of local image features.\ua0* Improvements for semantic segmentation in challenging conditions can be made efficiently by automatically generating pixel correspondences between images from a multitude of conditions and enforcing a consistency constraint during training.\ua0* A segmentation algorithm with automatically defined and more fine-grained classes improves localization performance.\ua0* The performance advantage seen in single image localization for modern local image features, when compared to traditional ones, is all but erased when considering sequential data with odometry, thus, encouraging to focus future research more on sequential localization, rather than pure single image localization