Massive MIMO is a Reality -- What is Next? Five Promising Research Directions for Antenna Arrays

Massive MIMO (multiple-input multiple-output) is no longer a "wild" or "promising" concept for future cellular networks - in 2018 it became a reality. Base stations (BSs) with 64 fully digital transceiver chains were commercially deployed in several countries, the key ingredients of Massive MIMO have made it into the 5G standard, the signal processing methods required to achieve unprecedented spectral efficiency have been developed, and the limitation due to pilot contamination has been resolved. Even the development of fully digital Massive MIMO arrays for mmWave frequencies - once viewed prohibitively complicated and costly - is well underway. In a few years, Massive MIMO with fully digital transceivers will be a mainstream feature at both sub-6 GHz and mmWave frequencies. In this paper, we explain how the first chapter of the Massive MIMO research saga has come to an end, while the story has just begun. The coming wide-scale deployment of BSs with massive antenna arrays opens the door to a brand new world where spatial processing capabilities are omnipresent. In addition to mobile broadband services, the antennas can be used for other communication applications, such as low-power machine-type or ultra-reliable communications, as well as non-communication applications such as radar, sensing and positioning. We outline five new Massive MIMO related research directions: Extremely large aperture arrays, Holographic Massive MIMO, Six-dimensional positioning, Large-scale MIMO radar, and Intelligent Massive MIMO.Comment: 20 pages, 9 figures, submitted to Digital Signal Processin

Bayesian super-resolution with application to radar target recognition

This thesis is concerned with methods to facilitate automatic target recognition using images generated from a group of associated radar systems. Target recognition algorithms require access to a database of previously recorded or synthesized radar images for the targets of interest, or a database of features based on those images. However, the resolution of a new image acquired under non-ideal conditions may not be as good as that of the images used to generate the database. Therefore it is proposed to use super-resolution techniques to match the resolution of new images with the resolution of database images. A comprehensive review of the literature is given for super-resolution when used either on its own, or in conjunction with target recognition. A new superresolution algorithm is developed that is based on numerical Markov chain Monte Carlo Bayesian statistics. This algorithm allows uncertainty in the superresolved image to be taken into account in the target recognition process. It is shown that the Bayesian approach improves the probability of correct target classification over standard super-resolution techniques. The new super-resolution algorithm is demonstrated using a simple synthetically generated data set and is compared to other similar algorithms. A variety of effects that degrade super-resolution performance, such as defocus, are analyzed and techniques to compensate for these are presented. Performance of the super-resolution algorithm is then tested as part of a Bayesian target recognition framework using measured radar data

Utilizing Near-Field Measurements to Characterize Far-Field Radar Signatures

The increased need for stealth aircraft requires an on-site Far-Field (FF) Radar Cross-Section (RCS) measurement process. Conducting these measurements in on-site Near-Field (NF) monostatic facilities results in significant savings for manufacturers and acquisition programs. However, NF measurements are not directly extended to a FF RCS. Therefore, a large target Near-Field to Far-Field Transformation (NFFFT) is needed for RCS measurements. One approach requires an Inverse Synthetic Aperture Radar (ISAR) process to create accurate scattering maps. The focus of this work is the development of accurate NF scattering maps generated by a monostatic ISAR process. As a first look, the process is isolated to a simulated environment to avoid the uncontrollable effects of real measurement environments. The simulation begins with a NF Synthetic Target Generator (STG) which approximates a target using scattering centers illuminated by spherical electromagnetic waves to approximating NF scattering. The resulting NF In-phase and Quadrature (IQ) data is used in a Trapezoidal ISAR process to create spatially distorted images that are accurately corrected within the ISAR process resolution using a newly developed NF correction. The resulting spatially accurate ISAR images do not complete the NFFFT. However, accurate scattering maps are essential for process development

Cost-aware compressive sensing for networked sensing systems

Compressive Sensing is a technique that can help reduce the sampling rate of sensing tasks. In mobile crowdsensing applications or wireless sensor networks, the resource burden of collecting samples is often a major concern. Therefore, compressive sensing is a promising approach in such scenarios. An implicit assumption underlying compressive sensing - both in theory and its applications - is that every sample has the same cost: its goal is to simply reduce the number of samples while achieving a good recovery accuracy. In many networked sensing systems, however, the cost of obtaining a specific sample may depend highly on the location, time, condition of the device, and many other factors of the sample. In this paper, we study compressive sensing in situations where different samples have different costs, and we seek to find a good trade-off between minimizing the total sample cost and the resulting recovery accuracy. We design CostAware Compressive Sensing (CACS), which incorporates the cost-diversity of samples into the compressive sensing framework, and we apply CACS in networked sensing systems. Technically, we use regularized column sum (RCS) as a predictive metric for recovery accuracy, and use this metric to design an optimization algorithm for finding a least cost randomized sampling scheme with provable recovery bounds. We also show how CACS can be applied in a distributed context. Using traffic monitoring and air pollution as concrete application examples, we evaluate CACS based on large-scale real-life traces. Our results show that CACS achieves significant cost savings, outperforming natural baselines (greedy and random sampling) by up to 4x

3D Radar and Camera Co-Calibration: A Flexible and Accurate Method for Target-based Extrinsic Calibration

Advances in autonomous driving are inseparable from sensor fusion. Heterogeneous sensors are widely used for sensor fusion due to their complementary properties, with radar and camera being the most equipped sensors. Intrinsic and extrinsic calibration are essential steps in sensor fusion. The extrinsic calibration, independent of the sensor's own parameters, and performed after the sensors are installed, greatly determines the accuracy of sensor fusion. Many target-based methods require cumbersome operating procedures and well-designed experimental conditions, making them extremely challenging. To this end, we propose a flexible, easy-to-reproduce and accurate method for extrinsic calibration of 3D radar and camera. The proposed method does not require a specially designed calibration environment, and instead places a single corner reflector (CR) on the ground to iteratively collect radar and camera data simultaneously using Robot Operating System (ROS), and obtain radar-camera point correspondences based on their timestamps, and then use these point correspondences as input to solve the perspective-n-point (PnP) problem, and finally get the extrinsic calibration matrix. Also, RANSAC is used for robustness and the Levenberg-Marquardt (LM) nonlinear optimization algorithm is used for accuracy. Multiple controlled environment experiments as well as real-world experiments demonstrate the efficiency and accuracy (AED error is 15.31 pixels and Acc up to 89\%) of the proposed method

NORM: Knowledge Distillation via N-to-One Representation Matching

Existing feature distillation methods commonly adopt the One-to-one Representation Matching between any pre-selected teacher-student layer pair. In this paper, we present N-to-One Representation (NORM), a new two-stage knowledge distillation method, which relies on a simple Feature Transform (FT) module consisting of two linear layers. In view of preserving the intact information learnt by the teacher network, during training, our FT module is merely inserted after the last convolutional layer of the student network. The first linear layer projects the student representation to a feature space having N times feature channels than the teacher representation from the last convolutional layer, and the second linear layer contracts the expanded output back to the original feature space. By sequentially splitting the expanded student representation into N non-overlapping feature segments having the same number of feature channels as the teacher's, they can be readily forced to approximate the intact teacher representation simultaneously, formulating a novel many-to-one representation matching mechanism conditioned on a single teacher-student layer pair. After training, such an FT module will be naturally merged into the subsequent fully connected layer thanks to its linear property, introducing no extra parameters or architectural modifications to the student network at inference. Extensive experiments on different visual recognition benchmarks demonstrate the leading performance of our method. For instance, the ResNet18|MobileNet|ResNet50-1/4 model trained by NORM reaches 72.14%|74.26%|68.03% top-1 accuracy on the ImageNet dataset when using a pre-trained ResNet34|ResNet50|ResNet50 model as the teacher, achieving an absolute improvement of 2.01%|4.63%|3.03% against the individually trained counterpart. Code is available at https://github.com/OSVAI/NORMComment: The paper of NORM is published at ICLR 2023. Code and models are available at https://github.com/OSVAI/NOR

A Multispectral Look at Oil Pollution Detection, Monitoring, and Law Enforcement

The problems of detecting oil films on water, mapping the areal extent of slicks, measuring the slick thickness, and identifying oil types are discussed. The signature properties of oil in the ultraviolet, visible, infrared, microwave, and radar regions are analyzed

Application of Time-Frequency Representation to Non-Stationary Radar Cross Section

Radar Cross Section (RCS) imaging of a non-wide sense stationary signal poses significant problems in identifying scattering centers in the post processed radar- generated image. A non-wide sense stationary RCS is typically encountered when moving parts on the target impress a phase shift into the backscatter signal that is uncorrelated to the previous return pulse. When the Fourier transform of the phase shifted complex signal is taken, range and cross range information on scattering centers are misplaced. Time Frequency Representations (TFR) must be used to help locate these scattering centers so they can be properly treated to reduce the target’s RCS and increase its survivability. This thesis analyzes and compares various TFRs on non-wide sense stationary signals in hope of providing test centers with better methods for locating scattering centers under time variant conditions

Some contributions on MIMO radar

Motivated by recent advances in Multiple Input Multiple Output (MIMO) wireless communications, this dissertation aims at exploring the potential of MIMO approaches in the radar context. In communications, MIMO systems combat the fading effects of the multi-path channel with spatial diversity. Further, the scattering environment can be used by such systems to achieve spatial multiplexing. In radar, a complex target consisting of several scatterers takes the place of the multi-path channel of the communication problem. A target\u27s radar cross section (RCS), which determines the amount of returned power, greatly varies with the considered aspect. Those variations significantly impair the detection and estimation performance of conventional radar employing closely spaced arrays on transmit and receive sides. In contrast, by widely separating the transmit and receive elements, MIMO radar systems observe a target simultaneously from different aspects resulting in spatial diversity. This diversity overcomes the fluctuations in received power. Similar to the multiplexing gain in communications, the simultaneous observation of a target from several perspectives enables resolving its features with an accuracy beyond the one supported by the bandwidth. The dissertation studies the MIMO concept in radar in the following manner. First, angle of arrival estimation is explored for a system applying transmit diversity on the transmit side. Due to the target\u27s RCS fluctuations, the notion of ergodic and outage Cramer Rao bounds is introduced. Both bounds are compared with simulation results revealing the diversity potentials of MIMO radar. Afterwards, the detection of targets in white Gaussian noise is discussed including geometric considerations due to the wide separation between the system elements. The detection performance of MIMO radar is then compared to the one achieved by conventional phased array radar systems. The discussion is extended to include returns from homogeneous clutter. A Doppler processing based moving target detector for MIMO radar is developed in this context. Based on this detector, the moving target detection capabilities of MIMO radar are evaluated and compared to the ones of phased array and multi-static radar systems. It is shown, that MIMO radar is capable of reliably detecting targets moving in an arbitrary direction. The advantage of using several transmitters is illustrated and the constant false alarm rate (CFAR) property of adaptive MIMO moving target detectors is demonstrated. Finally, the high resolution capabilities of MIMO radar are explored. As noted above, the several individual scatterers constituting a target result in its fluctuating RCS. The high resolution mode is aimed at resolving those scatterers. With Cramer Rao bounds and simulation results, it is explored how observing a single isotropic scatterer from several aspects enhances the accuracy of estimating the location of this scatterer. In this context a new, two-dimensional ambiguity function is introduced. This ambiguity function is used to illustrate that several scatterers can be resolved within a conventional resolution cell defined by the bandwidth. The effect of different system parameters on this ambiguity function is discussed