Gait Classification Based on Micro-Doppler Features

This paper focuses on the classification of human gaits based on micro-Doppler signatures. The micro-Doppler signatures can represent detailed information about the human gaits, which helps in judging the threat of a personnel target. The proposed method consists of three major steps. Firstly, the micro-Doppler signatures are obtained by performing time-frequency analysis on the radar data. Then two micro-Doppler features are extracted from the time-frequency domain. Finally, the one-versus-one support vector machine (SVM) is used to realize multi-class classification. Experiments on real data show that, with the selected features, high classification accuracy of the human gaits of interest can be achieved

Representation of Radar Micro-Dopplers Using Customized Dictionaries

Human motions give rise to frequency modulations, known as micro-Dopplers, to continuous wave radar signals. Micro-Doppler signals have been extensively researched for the classification of different types of human motions as well as to distinguish humans from other moving targets. However, there are two main scenarios where the performance of existing algorithms deteriorates significantly—one, when the channel consists of multiple moving targets resulting in distorted signatures, and two, when the systems conditions during the training stage deviate significantly from the conditions during the test stage. In this chapter, it is demonstrated that both of these limitations can be overcome by representing the radar data through customized dictionaries, fine-tuned to provide sparser representations of the data, than traditional data-independent dictionaries such as Fourier or wavelets. The performances of the algorithms are evaluated with both simulated and measured radar data gathered from moving humans in indoor line-of-sight conditions

Review of radar classification and RCS characterisation techniques for small UAVs or drones

This review explores radar-based techniques currently utilised in the literature to monitor small unmanned aerial vehicle (UAV) or drones; several challenges have arisen due to their rapid emergence and commercialisation within the mass market. The potential security threats posed by these systems are collectively presented and the legal issues surrounding their successful integration are briefly outlined. Key difficulties involved in the identification and hence tracking of these `radar elusive' systems are discussed, along with how research efforts relating to drone detection, classification and radar cross section (RCS) characterisation are being directed in order to address this emerging challenge. Such methods are thoroughly analysed and critiqued; finally, an overall picture of the field in its current state is painted, alongside scope for future work over a broad spectrum

Advanced signal processing solutions for ATR and spectrum sharing in distributed radar systems

Previously held under moratorium from 11 September 2017 until 16 February 2022This Thesis presents advanced signal processing solutions for Automatic Target Recognition (ATR) operations and for spectrum sharing in distributed radar systems. Two Synthetic Aperture Radar (SAR) ATR algorithms are described for full- and single-polarimetric images, and tested on the GOTCHA and the MSTAR datasets. The first one exploits the Krogager polarimetric decomposition in order to enhance peculiar scattering mechanisms from manmade targets, used in combination with the pseudo-Zernike image moments. The second algorithm employs the Krawtchouk image moments, that, being discrete defined, provide better representations of targets’ details. The proposed image moments based framework can be extended to the availability of several images from multiple sensors through the implementation of a simple fusion rule. A model-based micro-Doppler algorithm is developed for the identification of helicopters. The approach relies on the proposed sparse representation of the signal scattered from the helicopter’s rotor and received by the radar. Such a sparse representation is obtained through the application of a greedy sparse recovery framework, with the goal of estimating the number, the length and the rotation speed of the blades, parameters that are peculiar for each helicopter’s model. The algorithm is extended to deal with the identification of multiple helicopters flying in formation that cannot be resolved in another domain. Moreover, a fusion rule is presented to integrate the results of the identification performed from several sensors in a distributed radar system. Tests performed both on simulated signals and on real signals acquired from a scale model of a helicopter, confirm the validity of the algorithm. Finally, a waveform design framework for joint radar-communication systems is presented. The waveform is composed by quasi-orthogonal chirp sub-carriers generated through the Fractional Fourier Transform (FrFT), with the aim of preserving the radar performance of a typical Linear Frequency Modulated (LFM) pulse while embedding data to be sent to a cooperative system. Techniques aimed at optimise the design parameters and mitigate the Inter-Carrier Interference (ICI) caused by the quasiorthogonality of the chirp sub-carriers are also described. The FrFT based waveform is extensively tested and compared with Orthogonal Frequency Division Multiplexing (OFDM) and LFM waveforms, in order to assess both its radar and communication performance.This Thesis presents advanced signal processing solutions for Automatic Target Recognition (ATR) operations and for spectrum sharing in distributed radar systems. Two Synthetic Aperture Radar (SAR) ATR algorithms are described for full- and single-polarimetric images, and tested on the GOTCHA and the MSTAR datasets. The first one exploits the Krogager polarimetric decomposition in order to enhance peculiar scattering mechanisms from manmade targets, used in combination with the pseudo-Zernike image moments. The second algorithm employs the Krawtchouk image moments, that, being discrete defined, provide better representations of targets’ details. The proposed image moments based framework can be extended to the availability of several images from multiple sensors through the implementation of a simple fusion rule. A model-based micro-Doppler algorithm is developed for the identification of helicopters. The approach relies on the proposed sparse representation of the signal scattered from the helicopter’s rotor and received by the radar. Such a sparse representation is obtained through the application of a greedy sparse recovery framework, with the goal of estimating the number, the length and the rotation speed of the blades, parameters that are peculiar for each helicopter’s model. The algorithm is extended to deal with the identification of multiple helicopters flying in formation that cannot be resolved in another domain. Moreover, a fusion rule is presented to integrate the results of the identification performed from several sensors in a distributed radar system. Tests performed both on simulated signals and on real signals acquired from a scale model of a helicopter, confirm the validity of the algorithm. Finally, a waveform design framework for joint radar-communication systems is presented. The waveform is composed by quasi-orthogonal chirp sub-carriers generated through the Fractional Fourier Transform (FrFT), with the aim of preserving the radar performance of a typical Linear Frequency Modulated (LFM) pulse while embedding data to be sent to a cooperative system. Techniques aimed at optimise the design parameters and mitigate the Inter-Carrier Interference (ICI) caused by the quasiorthogonality of the chirp sub-carriers are also described. The FrFT based waveform is extensively tested and compared with Orthogonal Frequency Division Multiplexing (OFDM) and LFM waveforms, in order to assess both its radar and communication performance

Investigation of non-cooperative target recognition of small and slow moving air targets in modern air defence surveillance radar

This thesis covers research in the field of non-cooperative target recognition given the limitations of modern air defence surveillance radars. The potential presence of low observable manned or unmanned targets within the vast surveillance volume demand highly sensitive systems. This may again introduce unwanted detections of single birds of comparable radar cross section, previously avoided by use of wide clutter rejection filters and sensitivity time control. The demand for methods effectively separating between birds and slow moving manmade targets is evident. The research questions addressed are connected to identification of characteristic features of birds and manmade targets of comparable size. Ultimately the goal has been to find methods that can utilize such features to effectively distinguish between the classes. In contrast to the vast majority of non-cooperative target recognition publications, this thesis includes non-rigid targets covering a range of dielectric properties and targets falling in the resonant and Rayleigh scattering regions. These factors combined with insufficient spatial resolution for classification require alternative approaches such as utilization of periodic RCS modulation, micro-Doppler- and polarimetric signatures. Signatures of birds and UAVs are investigated through electromagnetic prediction and radar measurements. A flexible and fully polarimetric radar capable of simultaneous operation in both L- and S-band is developed for collection of relevant signatures. Inspired by the use of polarimetric radar for classification of precipitation covered in the weather radar literature, focus has been on using similar methods to recognize signatures of rotors, propellers and bird wings. Novel micro-Doppler signatures combining polarimetric information from this sensor is found to hold information about the orientation of such target parts. This information combined with several other features is evaluated for classification. The benefit from involving polarimetric measurements is especially investigated, and is found to be highly valuable when information provided by other methods is limited

Walking Gait Measurement and Gait Parameters Extraction

A fourth generation walking gait measurement device has been designed to capture and analyze detailed gait and stride metrics which eventually provides a Fall-Risk Assessment score. Specifically, the device has been modified to fit the residential environment and the elderly consumers which is low-cost, user-friendly, and portable. The gait parameters would be obtained by the on-board gait analysis protocol. Through gait parameters people’s falling risk can then be calculated so that people can be alerted to take precautionary measures before falling. Overall, the device has been made and demonstrated having better performance than its previous generations. The on-board gait analyzing program executed slower than the computer version program but has the same accuracy. However, the overall performance is better than transforming data from the measurement device to a computer manually

Human activity classification using micro-Doppler signatures and ranging techniques

PhD ThesisHuman activity recognition is emerging as a very import research area due to its potential applications in surveillance, assisted living, and military operations. Various sensors including accelerometers, RFID, and cameras, have been applied to achieve automatic human activity recognition. Wearable sensor-based techniques have been well explored. However, some studies have shown that many users are more disinclined to use wearable sensors and also may forget to carry them. Consequently, research in this area started to apply contactless sensing techniques to achieve human activity recognition unobtrusively. In this research, two methods were investigated for human activity recognition, one method is radar-based and the other is using LiDAR (Light Detection and Ranging). Compared to other techniques, Doppler radar and LiDAR have several advantages including all-weather and all-day capabilities, non-contact and nonintrusive features. Doppler radar also has strong penetration to walls, clothes, trees, etc. LiDAR can capture accurate (centimetre-level) locations of targets in real-time. These characteristics make methods based on Doppler radar and LiDAR superior to other techniques. Firstly, this research measured micro-Doppler signatures of different human activities indoors and outdoors using Doppler radars. Micro-Doppler signatures are presented in the frequency domain to reflect different frequency shifts resulted from different components of a moving target. One of the major differences of this research in relation to other relevant research is that a simple pulsed radar system of very low-power was used. The outdoor experiments were performed in places of heavy clutter (grass, trees, uneven terrains), and confusers including animals and drones, were also considered in the experiments. Novel usages of machine learning techniques were implemented to perform subject classification, human activity classification, people counting, and coarse-grained localisation by classifying the micro-Doppler signatures. For the feature extraction of the micro-Doppler signatures, this research proposed the use of a two-directional twodimensional principal component analysis (2D2PCA). The results show that by applying 2D2PCA, the accuracy results of Support Vector Machine (SVM) and k-Nearest Neighbour (kNN) classifiers were greatly improved. A Convolutional Neural Network (CNN) was built for the target classifications of type, number, activity, and coarse localisation. The CNN model obtained very high classification accuracies (97% to 100%) for the outdoor experiments, which were superior to the results obtained by SVM and kNN. The indoor experiments measured several daily activities with the focus on dietary activities (eating and drinking). An overall classification rate of 92.8% was obtained in activity recognition in a kitchen scenario using the CNN. Most importantly, in nearly real-time, the proposed approach successfully recognized human activities in more than 89% of the time. This research also investigated the effects on the classification performance of the frame length of the sliding window, the angle of the direction of movement, and the number of radars used; providing valuable guidelines for machine learning modeling and experimental setup of micro-Doppler based research and applications. Secondly, this research used a two dimensional (2D) LiDAR to perform human activity detection indoors. LiDAR is a popular surveying method that has been widely used in localisation, navigation, and mapping. This research proposed the use of a 2D LiDAR to perform multiple people activity recognition by classifying their trajectories. Points collected by the LiDAR were clustered and classified into human and non-human classes. For the human class, the Kalman filter was used to track their trajectories, and the trajectories were further segmented and labelled with their corresponding activities. Spatial transformation was used for trajectory augmentation in order to overcome the problem of unbalanced classes and boost the performance of human activity recognition. Finally, a Long Short-term Memory (LSTM) network and a (Temporal Convolutional Network) TCN was built to classify the trajectory samples into fifteen activity classes. The TCN achieved the best result of 99.49% overall accuracy. In comparison, the proposed TCN slightly outperforms the LSTM. Both of them outperform hidden Markov Model (HMM), dynamic time warping (DTW), and SVM with a wide margin

A three-step classification framework to handle complex data distribution for radar UAV detection

Unmanned aerial vehicles (UAVs) have been used in a wide range of applications and become an increasingly important radar target. To better model radar data and to tackle the curse of dimensionality, a three-step classification framework is proposed for UAV detection. First we propose to utilize the greedy subspace clustering to handle potential outliers and the complex sample distribution of radar data. Parameters of the resulting multi-Gaussian model, especially the covariance matrices, could not be reliably estimated due to insufficient training samples and the high dimensionality. Thus, in the second step, a multi-Gaussian subspace reliability analysis is proposed to handle the unreliable feature dimensions of these covariance matrices. To address the challenges of classifying samples using the complex multi-Gaussian model and to fuse the distances of a sample to different clusters at different dimensionalities, a subspace-fusion scheme is proposed in the third step. The proposed approach is validated on a large benchmark dataset, which significantly outperforms the state-of-the-art approaches

Radar based discrete and continuous activity recognition for assisted living

In an era of digital transformation, there is an appetite for automating the monitoring process of motions and actions by individuals who are part of a society increasingly getting older on average. ”Activity recognition” is where sensors use motion information from participants who are wearing a wearable sensor or are in the field of view of a remote sensor which, coupled with machine learning algorithms, can automatically identify the movement or action the person is undertaking. Radar is a nascent sensor for this application, having been proposed in literature as an effective privacy-compliant sensor that can track movements of the body effectively. The methods of recording movements are separated into two types where ’Discrete’ movements provide an overview of a single activity within a fixed interval of time, while ’Continuous’ activities present sequences of activities performed in a series with variable duration and uncertain transitions, making these a challenging and yet much more realistic classification problem. In this thesis, first an overview of the technology of continuous wave (CW) and frequency modulated continuous wave (FMCW) radars and the machine learning algorithms and classification concepts is provided. Following this, state of the art for activity recognition with radar is presented and the key papers and significant works are discussed. The remaining chapters of this thesis discuss the research topics where contributions were made. This is commenced through analysing the effect of the physiology of the subject under test, to show that age can have an effect on the radar readings on the target. This is followed by porting existing radar recognition technologies and presenting novel use of radar based gait recognition to detect lameness in animals. Reverting to the human-centric application, improvements to activity recognition on humans and its accuracy was demonstrated by utilising features from different domains with feature selection and using different sensing technologies cooperatively. Finally, using a Bi-long short term memory (LSTM) based network, improved recognition of continuous activities and activity transitions without human-dependent feature extraction was demonstrated. Accuracy rate of 97% was achieved through sensor fusion and feature selection for discrete activities and for continuous activities, the Bi-LSTM achieved 92% accuracy with a sole radar sensor