Development of a Cost-Efficient Multi-Target Classification System Based on FMCW Radar for Security Gate Monitoring

Radar systems have a long history. Like many other great inventions, the origin of radar systems lies in warfare. Only in the last decade, radar systems have found widespread civil use in industrial measurement scenarios and automotive safety applications. Due to their resilience against harsh environments, they are used instead of or in addition to optical or ultrasonic systems. Radar sensors hold excellent capabilities to estimate distance and motion accurately, penetrate non-metallic objects, and remain unaffected by weather conditions. These capabilities make these devices extremely flexible in their applications. Electromagnetic waves centered at frequencies around 24 GHz offer high precision target measurements, compact antenna, and circuitry design, and lower atmospheric absorption than higher frequency-based systems. This thesis studies non-cooperative automatic radar multi-target detection and classification. A prototype of a radar system with a new microwave-radar-based technique for short-range detection and classification of multiple human and vehicle targets passing through a road gate is presented. It allows identifying different types of targets, i.e., pedestrians, motorcycles, cars, and trucks. The developed system is based on a low-cost 24 GHz off-the-shelf FMCW radar, combined with an embedded Raspberry Pi PC for data acquisition and transmission to a remote processing PC, which takes care of detection and classification. This approach, which can find applications in both security and infrastructure surveillance, relies upon the processing of the scattered-field data acquired by the radar. The developed method is based on an ad-hoc processing chain to accomplish the automatic target recognition task, which consists of blocks performing clutter and leakage removal with a frame subtraction technique, clustering with a DBSCAN approach, tracking algorithm based on the \u3b1-\u3b2 filter to follow the targets during traversal, features extraction, and finally classification of targets with a classification scheme based on support vector machines. The approach is validated in real experimental scenarios, showing its capabilities incorrectly detecting multiple targets belonging to different classes (i.e., pedestrians, cars, motorcycles, and trucks). The approach has been validated with experimental data acquired in different scenarios, showing good identification capabilities

Doppler-Spectrum Feature-Based Human-Vehicle Classification Scheme Using Machine Learning for an FMCW Radar Sensor

In this paper, we propose a Doppler-spectrum feature-based human–vehicle classification scheme for an FMCW (frequency-modulated continuous wave) radar sensor. We introduce three novel features referred to as the scattering point count, scattering point difference, and magnitude difference rate features based on the characteristics of the Doppler spectrum in two successive frames. We also use an SVM (support vector machine) and BDT (binary decision tree) for training and validation of the three aforementioned features. We measured the signals using a 24-GHz FMCW radar front-end module and a real-time data acquisition module and extracted three features from a walking human and a moving vehicle in the field. We then repeatedly measured the classification decision rate of the proposed algorithm using the SVM and BDT, finding that the average performance exceeded 99% and 96% for the walking human and the moving vehicle, respectively. © 2020 by the authors. Licensee MDPI, Basel, Switzerland.1

Machine Learning-Based Human Recognition Scheme Using a Doppler Radar Sensor for In-Vehicle Applications

In this paper, we propose a Doppler spectrum-based passenger detection scheme for a CW (Continuous Wave) radar sensor in vehicle applications. First, we design two new features, referred to as an ‘extended degree of scattering points’ and a ‘different degree of scattering points’ to represent the characteristics of the non-rigid motion of a moving human in a vehicle. We also design one newly defined feature referred to as the ‘presence of vital signs’, which is related to extracting the Doppler frequency of chest movements due to breathing. Additionally, we use a BDT (Binary Decision Tree) for machine learning during the training and test steps with these three extracted features. We used a 2.45 GHz CW radar front-end module with a single receive antenna and a real-time data acquisition module. Moreover, we built a test-bed with a structure similar to that of an actual vehicle interior. With the test-bed, we measured radar signals in various scenarios. We then repeatedly assessed the classification accuracy and classification error rate using the proposed algorithm with the BDT. We found an average classification accuracy rate of 98.6% for a human with or without motion. © 2020 by the authors. Licensee MDPI, Basel, Switzerland.1

A Short-Range FMCW Radar-Based Approach for Multi-Target Human-Vehicle Detection

In this article, a new microwave-radar-based technique for short-range detection and classification of multiple human and vehicle targets crossing a monitored area is proposed. This approach, which can find applications in both security and infrastructure surveillance, relies upon the processing of the scattered-field data acquired by low-cost off-The-shelf components, i.e., a 24 GHz frequency-modulated continuous wave (FMCW) radar module and a Raspberry Pi mini-PC. The developed method is based on an ad hoc processing chain to accomplish the automatic target recognition (ATR) task, which consists of blocks performing clutter and leakage removal with an infinite impulse response (IIR) filter, clustering with a density-based spatial clustering of applications with noise (DBSCAN) approach, tracking using a Benedict-Bordner $alpha$-$eta$ filter, features extraction, and finally classification of targets by means of a $k$-nearest neighbor ( $k$-NN) algorithm. The approach is validated in real experimental scenarios, showing its capabilities in correctly detecting multiple targets belonging to different classes (i.e., pedestrians, cars, motorcycles, and trucks)

Sensors for Vital Signs Monitoring

Sensor technology for monitoring vital signs is an important topic for various service applications, such as entertainment and personalization platforms and Internet of Things (IoT) systems, as well as traditional medical purposes, such as disease indication judgments and predictions. Vital signs for monitoring include respiration and heart rates, body temperature, blood pressure, oxygen saturation, electrocardiogram, blood glucose concentration, brain waves, etc. Gait and walking length can also be regarded as vital signs because they can indirectly indicate human activity and status. Sensing technologies include contact sensors such as electrocardiogram (ECG), electroencephalogram (EEG), photoplethysmogram (PPG), non-contact sensors such as ballistocardiography (BCG), and invasive/non-invasive sensors for diagnoses of variations in blood characteristics or body fluids. Radar, vision, and infrared sensors can also be useful technologies for detecting vital signs from the movement of humans or organs. Signal processing, extraction, and analysis techniques are important in industrial applications along with hardware implementation techniques. Battery management and wireless power transmission technologies, the design and optimization of low-power circuits, and systems for continuous monitoring and data collection/transmission should also be considered with sensor technologies. In addition, machine-learning-based diagnostic technology can be used for extracting meaningful information from continuous monitoring data

Radar target classification by micro-Doppler contributions

This thesis studies non-cooperative automatic radar target classification. Recent developments in silicon-germanium and monolithic microwave integrated circuit technologies allows to build cheap and powerful continuous wave radars. Availability of radars opens new applications in different areas. One of these applications is security. Radars could be used for surveillance of huge areas and detect unwanted moving objects. Determination of the type of the target is essential for such systems. Microwave radars use high frequencies that reflect from objects of millimetre size. The micro-Doppler signature of a target is a time-varying frequency modulated contribution that arose in radar backscattering and caused by the relative movement of separate parts of the target. The micro-Doppler phenomenon allows to classify non-rigid moving objects by analysing their signatures. This thesis is focused on designing of automatic target classification systems based on analysis of micro-Doppler signatures. Analysis of micro-Doppler radar signatures is usually performed by second-order statistics, i.e. common energy-based power spectra and spectrogram. However, the information about phase coupling content in backscattering is totally lost in these energy-based statistics. This useful phase coupling content can be extracted by higher-order spectral techniques. We show that this content is useful for radar target classification in terms of improved robustness to various corruption factors. A problem of unmanned aerial vehicle (UAV) classification using continuous wave radar is covered in the thesis. All steps of processing required to make a decision out of the raw radar data are considered. A novel feature extraction method is introduced. It is based on eigenpairs extracted from the correlation matrix of the signature. Different classes of UAVs are successfully separated in feature space by support vector machine. Within experiments or real radar data, achieved high classification accuracy proves the efficiency of the proposed solutions. Thesis also covers several applications of the automotive radar due to very high growth in technologies for intelligent vehicle radar systems. Such radars are already build-in in the vehicle and ready for new applications. We consider two novel applications. First application is a multi-sensor fusion of video camera and radar for more efficient vehicle-to-vehicle video transmission. Second application is a frequency band invariant pedestrian classification by an automotive radar. This system allows us to use the same signal processing hardware/software for different countries where regulations vary and radars with different operating frequency are required. We consider different radar applications: ground moving target classification, aerial target classification, unmanned aerial vehicles classification, pedestrian classification. The highest priority is given to verification of proposed methods on real radar data collected with frequencies equal to 9.5, 10, 16.8, 24 and 33 GHz

Edge Artificial Intelligence for Real-Time Target Monitoring

The key enabling technology for the exponentially growing cellular communications sector is location-based services. The need for location-aware services has increased along with the number of wireless and mobile devices. Estimation problems, and particularly parameter estimation, have drawn a lot of interest because of its relevance and engineers' ongoing need for higher performance. As applications expanded, a lot of interest was generated in the accurate assessment of temporal and spatial properties. In the thesis, two different approaches to subject monitoring are thoroughly addressed. For military applications, medical tracking, industrial workers, and providing location-based services to the mobile user community, which is always growing, this kind of activity is crucial. In-depth consideration is given to the viability of applying the Angle of Arrival (AoA) and Receiver Signal Strength Indication (RSSI) localization algorithms in real-world situations. We presented two prospective systems, discussed them, and presented specific assessments and tests. These systems were put to the test in diverse contexts (e.g., indoor, outdoor, in water...). The findings showed the localization capability, but because of the low-cost antenna we employed, this method is only practical up to a distance of roughly 150 meters. Consequently, depending on the use-case, this method may or may not be advantageous. An estimation algorithm that enhances the performance of the AoA technique was implemented on an edge device. Another approach was also considered. Radar sensors have shown to be durable in inclement weather and bad lighting conditions. Frequency Modulated Continuous Wave (FMCW) radars are the most frequently employed among the several sorts of radar technologies for these kinds of applications. Actually, this is because they are low-cost and can simultaneously provide range and Doppler data. In comparison to pulse and Ultra Wide Band (UWB) radar sensors, they also need a lower sample rate and a lower peak to average ratio. The system employs a cutting-edge surveillance method based on widely available FMCW radar technology. The data processing approach is built on an ad hoc-chain of different blocks that transforms data, extract features, and make a classification decision before cancelling clutters and leakage using a frame subtraction technique, applying DL algorithms to Range-Doppler (RD) maps, and adding a peak to cluster assignment step before tracking targets. In conclusion, the FMCW radar and DL technique for the RD maps performed well together for indoor use-cases. The aforementioned tests used an edge device and Infineon Technologies' Position2Go FMCW radar tool-set

Multi-User Gesture Recognition with Radar Technology

The aim of this work is the development of a Radar system for consumer applications. It is capable of tracking multiple people in a room and offers a touchless human-machine interface for purposes that range from entertainment to hygiene

All-weather object recognition using radar and infrared sensing

Autonomous cars are an emergent technology which has the capacity to change human lives. The current sensor systems which are most capable of perception are based on optical sensors. For example, deep neural networks show outstanding results in recognising objects when used to process data from cameras and Light Detection And Ranging (LiDAR) sensors. However these sensors perform poorly under adverse weather conditions such as rain, fog, and snow due to the sensor wavelengths. This thesis explores new sensing developments based on long wave polarised infrared (IR) imagery and imaging radar to recognise objects. First, we developed a methodology based on Stokes parameters using polarised infrared data to recognise vehicles using deep neural networks. Second, we explored the potential of using only the power spectrum captured by low-THz radar sensors to perform object recognition in a controlled scenario. This latter work is based on a data-driven approach together with the development of a data augmentation method based on attenuation, range and speckle noise. Last, we created a new large-scale dataset in the ”wild” with many different weather scenarios (sunny, overcast, night, fog, rain and snow) showing radar robustness to detect vehicles in adverse weather. High resolution radar and polarised IR imagery, combined with a deep learning approach, are shown as a potential alternative to current automotive sensing systems based on visible spectrum optical technology as they are more robust in severe weather and adverse light conditions.UK Engineering and Physical Research Council, grant reference EP/N012402/