A New Wave in Robotics: Survey on Recent mmWave Radar Applications in Robotics

We survey the current state of millimeterwave (mmWave) radar applications in robotics with a focus on unique capabilities, and discuss future opportunities based on the state of the art. Frequency Modulated Continuous Wave (FMCW) mmWave radars operating in the 76--81GHz range are an appealing alternative to lidars, cameras and other sensors operating in the near visual spectrum. Radar has been made more widely available in new packaging classes, more convenient for robotics and its longer wavelengths have the ability to bypass visual clutter such as fog, dust, and smoke. We begin by covering radar principles as they relate to robotics. We then review the relevant new research across a broad spectrum of robotics applications beginning with motion estimation, localization, and mapping. We then cover object detection and classification, and then close with an analysis of current datasets and calibration techniques that provide entry points into radar research.Comment: 19 Pages, 11 Figures, 2 Tables, TRO Submission pendin

Payload's sway angle measurement for container in the crane system based on remote sensing

The demand for a high quickly measuring angle in the port crane system should be considered when the container has been transferred from one place to another place. It is significant to build the feedback linking of payload's angle in the integrated crane system. The value of accurate measurement of the angle can be used to optimize the crane control system. In this context, the design and implementation of the experimental setup associated with emulated cranes will be carried out. Several solutions for remote angle measurement were considered one of the considered solutions being represented by millimeter microwave radar sensors. Special developments of algorithms to calculate the sway angle of payload or container were considered as so as the real-time processing using Arduino Uno computation platform. The following objectives were successfully reached. 1. Development of remote sensing system for payload's swing angle measurement considering radars such the sensing devices; 2. Development of a novel angle algorithm measurement and real-time processing of data; 3. Development of a prototype characterized by real-time processing and remote detection capabilities considering short-range and long-range measurements, such as lidar sensor or radar sensor.A demanda por um ângulo de medição rápido e alto no sistema de guindaste portuário deve ser considerada quando o contêiner for transferido de um local para outro. É significativo construir a ligação de feedback do ângulo da carga útil no sistema de guindaste integrado. O valor da medição precisa do ângulo pode ser usado para otimizar o sistema de controle do guindaste. Neste contexto, será realizada a concepção e implementação da configuração experimental associada a gruas emuladas. Diversas soluções para medição remota de ângulos foram consideradas uma das soluções consideradas sendo representadas por sensores de micro-ondas milimetrados. Desenvolvimentos especiais de algoritmos para calcular o ângulo de oscilação da carga útil ou contêiner foram considerados, assim como o processamento em tempo real usando a plataforma de computação Arduino Uno. Os seguintes objetivos foram alcançados com sucesso. 1. Desenvolvimento de sistema de sensoriamento remoto para medição do ângulo de oscilação da carga útil considerando radares como os dispositivos de detecção; 2. Desenvolvimento de um novo algoritmo de medição de ângulos e processamento de dados em tempo real; 3. Desenvolvimento de um protótipo caracterizado por processamento em tempo real e capacidade de detecção remota considerando medições de curto e longo alcance, como sensor LIDAR ou sensor de radar

Recent Advances in mmWave-Radar-Based Sensing, Its Applications, and Machine Learning Techniques: A Review

Human gesture detection, obstacle detection, collision avoidance, parking aids, automotive driving, medical, meteorological, industrial, agriculture, defense, space, and other relevant fields have all benefited from recent advancements in mmWave radar sensor technology. A mmWave radar has several advantages that set it apart from other types of sensors. A mmWave radar can operate in bright, dazzling, or no-light conditions. A mmWave radar has better antenna miniaturization than other traditional radars, and it has better range resolution. However, as more data sets have been made available, there has been a significant increase in the potential for incorporating radar data into different machine learning methods for various applications. This review focuses on key performance metrics in mmWave-radar-based sensing, detailed applications, and machine learning techniques used with mmWave radar for a variety of tasks. This article starts out with a discussion of the various working bands of mmWave radars, then moves on to various types of mmWave radars and their key specifications, mmWave radar data interpretation, vast applications in various domains, and, in the end, a discussion of machine learning algorithms applied with radar data for various applications. Our review serves as a practical reference for beginners developing mmWave-radar-based applications by utilizing machine learning techniques.publishedVersio

Integrating Millimeter Wave Radar with a Monocular Vision Sensor for On-Road Obstacle Detection Applications

This paper presents a systematic scheme for fusing millimeter wave (MMW) radar and a monocular vision sensor for on-road obstacle detection. As a whole, a three-level fusion strategy based on visual attention mechanism and driver’s visual consciousness is provided for MMW radar and monocular vision fusion so as to obtain better comprehensive performance. Then an experimental method for radar-vision point alignment for easy operation with no reflection intensity of radar and special tool requirements is put forward. Furthermore, a region searching approach for potential target detection is derived in order to decrease the image processing time. An adaptive thresholding algorithm based on a new understanding of shadows in the image is adopted for obstacle detection, and edge detection is used to assist in determining the boundary of obstacles. The proposed fusion approach is verified through real experimental examples of on-road vehicle/pedestrian detection. In the end, the experimental results show that the proposed method is simple and feasible

Radar Technology

In this book “Radar Technology”, the chapters are divided into four main topic areas: Topic area 1: “Radar Systems” consists of chapters which treat whole radar systems, environment and target functional chain. Topic area 2: “Radar Applications” shows various applications of radar systems, including meteorological radars, ground penetrating radars and glaciology. Topic area 3: “Radar Functional Chain and Signal Processing” describes several aspects of the radar signal processing. From parameter extraction, target detection over tracking and classification technologies. Topic area 4: “Radar Subsystems and Components” consists of design technology of radar subsystem components like antenna design or waveform design

The Feasibility of Quantitatively Characterizing the Vehicle Motion Environment (VME)

https://deepblue.lib.umich.edu/bitstream/2027.42/154108/1/ervin1990.pd

Autonomous Vehicles: MMW Radar Backscattering Modeling of Traffic Environment, Vehicular Communication Modeling, and Antenna Designs

77 GHz Millimeter-wave (mmWave) radar serves as an essential component among many sensors required for autonomous navigation. High-fidelity simulation is indispensable for nowadays’ development of advanced automotive radar systems because radar simulation can accelerate the design and testing process and help people to better understand and process the radar data. The main challenge in automotive radar simulation is to simulate the complex scattering behavior of various targets in real time, which is required for sensor fusion with other sensory simulation, e.g. optical image simulation. In this thesis, an asymptotic method based on a fast-wideband physical optics (PO) calculation is developed and applied to get high fidelity radar response of traffic scenes and generate the corresponding radar images from traffic targets. The targets include pedestrians, vehicles, and other stationary targets. To further accelerate the simulation into real time, a physics-based statistical approach is developed. The RCS of targets are fit into statistical distributions, and then the statistical parameters are summarized as functions of range and aspect angles, and other attributes of the targets. For advanced radar with multiple transmitters and receivers, pixelated-scatterer statistical RCS models are developed to represent objects as extend targets and relax the requirement for far-field condition. A real-time radar scene simulation software, which will be referred to as Michigan Automotive Radar Scene Simulator (MARSS), based on the statistical models are developed and integrated with a physical 3D scene generation software (Unreal Engine 4). One of the major challenges in radar signal processing is to detect the angle of arrival (AOA) of multiple targets. A new analytic multiple-sources AOA estimation algorithm that outperforms many well-known AOA estimation algorithms is developed and verified by experiments. Moreover, the statistical parameters of RCS from targets and radar images are used in target classification approaches based on machine learning methods. In realistic road traffic environment, foliage is commonly encountered that can potentially block the line-of-sight link. In the second part of the thesis, a non-line-of-sight (NLoS) vehicular propagation channel model for tree trunks at two vehicular communication bands (5.9 GHz and 60 GHz) is proposed. Both near-field and far-field scattering models from tree trunk are developed based on modal expansion and surface current integral method. To make the results fast accessible and retractable, a macro model based on artificial neural network (ANN) is proposed to fit the path loss calculated from the complex electromagnetic (EM) based methods. In the third part of the thesis, two broadband (bandwidth > 50%) omnidirectional antenna designs are discussed to enable polarization diversity for next-generation communication systems. The first design is a compact horizontally polarized (HP) antenna, which contains four folded dipole radiators and utilizing their mutual coupling to enhance the bandwidth. The second one is a circularly polarized (CP) antenna. It is composed of one ultra-wide-band (UWB) monopole, the compact HP antenna, and a dedicatedly designed asymmetric power divider based feeding network. It has about 53% overlapping bandwidth for both impedance and axial ratio with peak RHCP gain of 0.9 dBi.PHDElectrical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/163001/1/caixz_1.pd

Contextual Beamforming: Exploiting Location and AI for Enhanced Wireless Telecommunication Performance

The pervasive nature of wireless telecommunication has made it the foundation for mainstream technologies like automation, smart vehicles, virtual reality, and unmanned aerial vehicles. As these technologies experience widespread adoption in our daily lives, ensuring the reliable performance of cellular networks in mobile scenarios has become a paramount challenge. Beamforming, an integral component of modern mobile networks, enables spatial selectivity and improves network quality. However, many beamforming techniques are iterative, introducing unwanted latency to the system. In recent times, there has been a growing interest in leveraging mobile users' location information to expedite beamforming processes. This paper explores the concept of contextual beamforming, discussing its advantages, disadvantages and implications. Notably, the study presents an impressive 53% improvement in signal-to-noise ratio (SNR) by implementing the adaptive beamforming (MRT) algorithm compared to scenarios without beamforming. It further elucidates how MRT contributes to contextual beamforming. The importance of localization in implementing contextual beamforming is also examined. Additionally, the paper delves into the use of artificial intelligence schemes, including machine learning and deep learning, in implementing contextual beamforming techniques that leverage user location information. Based on the comprehensive review, the results suggest that the combination of MRT and Zero forcing (ZF) techniques, alongside deep neural networks (DNN) employing Bayesian Optimization (BO), represents the most promising approach for contextual beamforming. Furthermore, the study discusses the future potential of programmable switches, such as Tofino, in enabling location-aware beamforming

Proceedings of the Augmented VIsual Display (AVID) Research Workshop

The papers, abstracts, and presentations were presented at a three day workshop focused on sensor modeling and simulation, and image enhancement, processing, and fusion. The technical sessions emphasized how sensor technology can be used to create visual imagery adequate for aircraft control and operations. Participants from industry, government, and academic laboratories contributed to panels on Sensor Systems, Sensor Modeling, Sensor Fusion, Image Processing (Computer and Human Vision), and Image Evaluation and Metrics