Static Background Removal in Vehicular Radar: Filtering in Azimuth-Elevation-Doppler Domain

A significant challenge in autonomous driving systems lies in image understanding within complex environments, particularly dense traffic scenarios. An effective solution to this challenge involves removing the background or static objects from the scene, so as to enhance the detection of moving targets as key component of improving overall system performance. In this paper, we present an efficient algorithm for background removal in automotive radar applications, specifically utilizing a frequency-modulated continuous wave (FMCW) radar. Our proposed algorithm follows a three-step approach, encompassing radar signal preprocessing, three-dimensional (3D) ego-motion estimation, and notch filter-based background removal in the azimuth-elevation-Doppler domain. To begin, we model the received signal of the FMCW multiple-input multiple-output (MIMO) radar and develop a signal processing framework for extracting four-dimensional (4D) point clouds. Subsequently, we introduce a robust 3D ego-motion estimation algorithm that accurately estimates radar ego-motion speed, accounting for Doppler ambiguity, by processing the point clouds. Additionally, our algorithm leverages the relationship between Doppler velocity, azimuth angle, elevation angle, and radar ego-motion speed to identify the spectrum belonging to background clutter. Subsequently, we employ notch filters to effectively filter out the background clutter. The performance of our algorithm is evaluated using both simulated data and extensive experiments with real-world data. The results demonstrate its effectiveness in efficiently removing background clutter and enhacing perception within complex environments. By offering a fast and computationally efficient solution, our approach effectively addresses challenges posed by non-homogeneous environments and real-time processing requirements

Radars for Autonomous Driving: A Review of Deep Learning Methods and Challenges

Radar is a key component of the suite of perception sensors used for safe and reliable navigation of autonomous vehicles. Its unique capabilities include high-resolution velocity imaging, detection of agents in occlusion and over long ranges, and robust performance in adverse weather conditions. However, the usage of radar data presents some challenges: it is characterized by low resolution, sparsity, clutter, high uncertainty, and lack of good datasets. These challenges have limited radar deep learning research. As a result, current radar models are often influenced by lidar and vision models, which are focused on optical features that are relatively weak in radar data, thus resulting in under-utilization of radar's capabilities and diminishing its contribution to autonomous perception. This review seeks to encourage further deep learning research on autonomous radar data by 1) identifying key research themes, and 2) offering a comprehensive overview of current opportunities and challenges in the field. Topics covered include early and late fusion, occupancy flow estimation, uncertainty modeling, and multipath detection. The paper also discusses radar fundamentals and data representation, presents a curated list of recent radar datasets, and reviews state-of-the-art lidar and vision models relevant for radar research. For a summary of the paper and more results, visit the website: autonomous-radars.github.io

Motion Estimation and Compensation in Automotive MIMO SAR

With the advent of self-driving vehicles, autonomous driving systems will have to rely on a vast number of heterogeneous sensors to perform dynamic perception of the surrounding environment. Synthetic Aperture Radar (SAR) systems increase the resolution of conventional mass-market radars by exploiting the vehicle's ego-motion, requiring a very accurate knowledge of the trajectory, usually not compatible with automotive-grade navigation systems. In this regard, this paper deals with the analysis, estimation and compensation of trajectory estimation errors in automotive SAR systems, proposing a complete residual motion estimation and compensation workflow. We start by defining the geometry of the acquisition and the basic processing steps of Multiple-Input Multiple-Output (MIMO) SAR systems. Then, we analytically derive the effects of typical motion errors in automotive SAR imaging. Based on the derived models, the procedure is detailed, outlining the guidelines for its practical implementation. We show the effectiveness of the proposed technique by means of experimental data gathered by a 77 GHz radar mounted in a forward looking configuration.Comment: 14 page

A New Wave in Robotics: Survey on Recent mmWave Radar Applications in Robotics

We survey the current state of millimeterwave (mmWave) radar applications in robotics with a focus on unique capabilities, and discuss future opportunities based on the state of the art. Frequency Modulated Continuous Wave (FMCW) mmWave radars operating in the 76--81GHz range are an appealing alternative to lidars, cameras and other sensors operating in the near visual spectrum. Radar has been made more widely available in new packaging classes, more convenient for robotics and its longer wavelengths have the ability to bypass visual clutter such as fog, dust, and smoke. We begin by covering radar principles as they relate to robotics. We then review the relevant new research across a broad spectrum of robotics applications beginning with motion estimation, localization, and mapping. We then cover object detection and classification, and then close with an analysis of current datasets and calibration techniques that provide entry points into radar research.Comment: 19 Pages, 11 Figures, 2 Tables, TRO Submission pendin

Milli-RIO: Ego-Motion Estimation with Low-Cost Millimetre-Wave Radar

Robust indoor ego-motion estimation has attracted significant interest in the last decades due to the fast-growing demand for location-based services in indoor environments. Among various solutions, frequency-modulated continuous-wave (FMCW) radar sensors in millimeter-wave (MMWave) spectrum are gaining more prominence due to their intrinsic advantages such as penetration capability and high accuracy. Single-chip low-cost MMWave radar as an emerging technology provides an alternative and complementary solution for robust ego-motion estimation, making it feasible in resource-constrained platforms thanks to low-power consumption and easy system integration. In this paper, we introduce Milli-RIO, an MMWave radar-based solution making use of a single-chip low-cost radar and inertial measurement unit sensor to estimate six-degrees-of-freedom ego-motion of a moving radar. Detailed quantitative and qualitative evaluations prove that the proposed method achieves precisions on the order of few centimeters for indoor localization tasks.Comment: Submitted to IEEE Sensors, 9page

Estudo de formas de onda e conceção de algoritmos para operação conjunta de sistemas de comunicação e radar

The focus of this thesis is the processing of signals and design of algorithms that can be used to enable radar functions in communications systems. Orthogonal frequency division multiplexing (OFDM) is a popular multicarrier modulation waveform in communication systems. As a wideband signal, OFDM improves resolution and enables spectral efficiency in radar systems, while also improving detection performance thanks to its inherent frequency diversity. This thesis aims to use multicarrier waveforms for radar systems, to enable the simultaneous operation of radar and communication functions on the same device. The thesis is divided in two parts. The first part, studies the adaptation and application of other multicarrier waveforms to radar functions. At the present time many studies have been carried out to jointly use the OFDM signal for communication and radar functions, but other waveforms have shown to be possible candidates for communication applications. Therefore, studies on the evaluation of the application of these same signals to radar functions are necessary. In this thesis, to demonstrate that other multicarrier waveforms can overcome the OFDM waveform in radar/communication (RadCom) systems, we propose the adaptation of the filter bank multicarrier (FBMC), generalized frequency division multiplexing (GFDM) and universal filtering multicarrier (UFMC) waveforms for radar functions. These alternative waveforms were compared performance-wise regarding achievable target parameter estimation performance, amount of residual background noise in the radar image, impact of intersystem interference and flexibility of parameterization. In the second part of the thesis, signal processing techniques are explored to solve some of the limitations of the use of multicarrier waveforms for RadCom systems. Radar systems based on OFDM are promising candidates for future intelligent transport networks. Exploring the dual functionality enabled by OFDM, we presents cooperative methods for high-resolution delay-Doppler and direction-of-arrival estimation. High-resolution parameter estimation is an important requirement for automotive radar systems, especially in multi-target scenarios that require reliable target separation performance. By exploring the cooperation between vehicles, the studies presented in this thesis also enable the distributed tracking of targets. The result is a highly accurate multi-target tracking across the entire cooperative vehicle network, leading to improvements in transport reliability and safety.O foco desta tese é o processamento de sinais e desenvolvimento de algoritmos que podem ser utilizados para a habilitar a função de radar nos sistemas de comunicação. OFDM (Orthogonal Frequency Division Multiplexing) é uma forma de onda com modulação multi-portadora, popular em sistemas de comunicação. Para sistemas de radar, O OFDM melhora a resolução e fornece eficiência espectral, além disso sua diversidade de frequências melhora o desempenho na detecção do radar. Essa tese tem como objetivo utilizar formas de onda multi-portadoras para sistemas de radar, possibilitando a operação simultânea de funções de radar e de comunicação num mesmo dispositivo. A tese esta dividida em duas partes. Na primeira parte da tese são realizados estudos da adaptabilidade de outras formas de onda multi-portadora para funções de radar. Nos dias atuais, muitos estudos sobre o uso do sinal OFDM para funções de comunicação e radar vêm sendo realizados, no entanto, outras formas de onda mostram-se possíveis candidatas a aplicações em sistemas de comunicação, e assim, avaliações para funções de sistema de radar se tornam necessárias. Nesta tese, com a intenção de demonstrar que formas de onda multi-portadoras alternativas podem superar o OFDM nos sistemas de Radar/comunicação (RadCom), propomos a adaptação das seguintes formas de onda: FBMC (Filter Bank Multicarrier); GFDM (Generalized Frequency Division Multiplexing); e UFMC (Universal Filtering Multicarrier) para funções de radar. Também produzimos uma análise de desempenho dessas formas de onda sobre o aspecto da estimativa de parâmetros-alvo, ruído de fundo, interferência entre sistemas e parametrização do sistema. Na segunda parte da tese serão explorados técnicas de processamento de sinal de forma a solucionar algumas das limitações do uso de formas de ondas multi-portadora para sistemas RadCom. Os sistemas de radar baseados no OFDM são candidatos promissores para futuras redes de transporte inteligentes, porque combinam funções de estimativa de alvo com funções de rede de comunicação em um único sistema. Explorando a funcionalidade dupla habilitada pelo OFDM, nesta tese, apresentamos métodos cooperativos de alta resolução para estimar o posição, velocidade e direção dos alvos. A estimativa de parâmetros de alta resolução é um requisito importante para sistemas de radar automotivo, especialmente em cenários de múltiplos alvos que exigem melhor desempenho de separação de alvos. Ao explorar a cooperação entre veículos, os estudos apresentados nesta tese também permitem o rastreamento distribuído de alvos. O resultado é um rastreamento multi-alvo altamente preciso em toda a rede de veículos cooperativos, levando a melhorias na confiabilidade e segurança do transporte.Programa Doutoral em Telecomunicaçõe