Advances in Waveform and Photon Counting Lidar Processing for Forest Vegetation Applications

Full waveform (FW) and photon counting LiDAR (PCL) data have garnered greater attention due to increasing data availability, a wealth of information they contain and promising prospects for large scale vegetation mapping. However, many factors such as complex processing steps and scarce non-proprietary tools preclude extensive and practical uses of these data for vegetation characterization. Therefore, the overall goal of this study is to develop algorithms to process FW and PCL data and to explore their potential in real-world applications. Study I explored classical waveform decomposition methods such as the Gaussian decomposition, Richardson–Lucy (RL) deconvolution and a newly introduced optimized Gold deconvolution to process FW LiDAR data. Results demonstrated the advantages of the deconvolution and decomposition method, and the three approaches generated satisfactory results, while the best performances varied when different criteria were used. Built upon Study I, Study II applied the Bayesian non-linear modeling concepts for waveform decomposition and quantified the propagation of error and uncertainty along the processing steps. The performance evaluation and uncertainty analysis at the parameter, derived point cloud and surface model levels showed that the Bayesian decomposition could enhance the credibility of decomposition results in a probabilistic sense to capture the true error of estimates and trace the uncertainty propagation along the processing steps. In study III, we exploited FW LiDAR data to classify tree species through integrating machine learning methods (the Random forests (RF) and Conditional inference forests (CF)) and Bayesian inference method. Results of classification accuracy highlighted that the Bayesian method was a superior alternative to machine learning methods, and rendered users with more confidence for interpreting and applying classification results to real-world tasks such as forest inventory. Study IV focused on developing a framework to derive terrain elevation and vegetation canopy height from test-bed sensor data and to pre-validate the capacity of the upcoming Ice, Cloud and Land Elevation Satellite-2 (ICESat-2) mission. The methodology developed in this study illustrates plausible ways of processing the data that are structurally similar to expected ICESat-2 data and holds the potential to be a benchmark for further method adjustment once genuine ICESat-2 are available

Advances in Waveform and Photon Counting Lidar Processing for Forest Vegetation Applications

Full waveform (FW) and photon counting LiDAR (PCL) data have garnered greater attention due to increasing data availability, a wealth of information they contain and promising prospects for large scale vegetation mapping. However, many factors such as complex processing steps and scarce non-proprietary tools preclude extensive and practical uses of these data for vegetation characterization. Therefore, the overall goal of this study is to develop algorithms to process FW and PCL data and to explore their potential in real-world applications. Study I explored classical waveform decomposition methods such as the Gaussian decomposition, Richardson–Lucy (RL) deconvolution and a newly introduced optimized Gold deconvolution to process FW LiDAR data. Results demonstrated the advantages of the deconvolution and decomposition method, and the three approaches generated satisfactory results, while the best performances varied when different criteria were used. Built upon Study I, Study II applied the Bayesian non-linear modeling concepts for waveform decomposition and quantified the propagation of error and uncertainty along the processing steps. The performance evaluation and uncertainty analysis at the parameter, derived point cloud and surface model levels showed that the Bayesian decomposition could enhance the credibility of decomposition results in a probabilistic sense to capture the true error of estimates and trace the uncertainty propagation along the processing steps. In study III, we exploited FW LiDAR data to classify tree species through integrating machine learning methods (the Random forests (RF) and Conditional inference forests (CF)) and Bayesian inference method. Results of classification accuracy highlighted that the Bayesian method was a superior alternative to machine learning methods, and rendered users with more confidence for interpreting and applying classification results to real-world tasks such as forest inventory. Study IV focused on developing a framework to derive terrain elevation and vegetation canopy height from test-bed sensor data and to pre-validate the capacity of the upcoming Ice, Cloud and Land Elevation Satellite-2 (ICESat-2) mission. The methodology developed in this study illustrates plausible ways of processing the data that are structurally similar to expected ICESat-2 data and holds the potential to be a benchmark for further method adjustment once genuine ICESat-2 are available

Real-time spatial modeling to detect and track resources on construction sites

For more than 10 years the U.S. construction industry has experienced over 1,000 fatalities annually. Many fatalities may have been prevented had the individuals and equipment involved been more aware of and alert to the physical state of the environment around them. Awareness may be improved by automatic 3D (three-dimensional) sensing and modeling of the job site environment in real-time. Existing 3D modeling approaches based on range scanning techniques are capable of modeling static objects only, and thus cannot model in real-time dynamic objects in an environment comprised of moving humans, equipment, and materials. Emerging prototype 3D video range cameras offer another alternative by facilitating affordable, wide field of view, automated static and dynamic object detection and tracking at frame rates better than 1Hz (real-time). This dissertation presents an imperical work and methodology to rapidly create a spatial model of construction sites and in particular to detect, model, and track the position, dimension, direction, and velocity of static and moving project resources in real-time, based on range data obtained from a three-dimensional video range camera in a static or moving position. Existing construction site 3D modeling approaches based on optical range sensing technologies (laser scanners, rangefinders, etc.) and 3D modeling approaches (dense, sparse, etc.) that offered potential solutions for this research are reviewed. The choice of an emerging sensing tool and preliminary experiments with this prototype sensing technology are discussed. These findings led to the development of a range data processing algorithm based on three-dimensional occupancy grids which is demonstrated in detail. Testing and validation of the proposed algorithms have been conducted to quantify the performance of sensor and algorithm through extensive experimentation involving static and moving objects. Experiments in indoor laboratory and outdoor construction environments have been conducted with construction resources such as humans, equipment, materials, or structures to verify the accuracy of the occupancy grid modeling approach. Results show that modeling objects and measuring their position, dimension, direction, and speed had an accuracy level compatible to the requirements of active safety features for construction. Results demonstrate that video rate 3D data acquisition and analysis of construction environments can support effective detection, tracking, and convex hull modeling of objects. Exploiting rapidly generated three-dimensional models for improved visualization, communications, and process control has inherent value, broad application, and potential impact, e.g. as-built vs. as-planned comparison, condition assessment, maintenance, operations, and construction activities control. In combination with effective management practices, this sensing approach has the potential to assist equipment operators to avoid incidents that result in reduce human injury, death, or collateral damage on construction sites.Civil, Architectural, and Environmental Engineerin

Elevation and Deformation Extraction from TomoSAR

3D SAR tomography (TomoSAR) and 4D SAR differential tomography (Diff-TomoSAR) exploit multi-baseline SAR data stacks to provide an essential innovation of SAR Interferometry for many applications, sensing complex scenes with multiple scatterers mapped into the same SAR pixel cell. However, these are still influenced by DEM uncertainty, temporal decorrelation, orbital, tropospheric and ionospheric phase distortion and height blurring. In this thesis, these techniques are explored. As part of this exploration, the systematic procedures for DEM generation, DEM quality assessment, DEM quality improvement and DEM applications are first studied. Besides, this thesis focuses on the whole cycle of systematic methods for 3D & 4D TomoSAR imaging for height and deformation retrieval, from the problem formation phase, through the development of methods to testing on real SAR data. After DEM generation introduction from spaceborne bistatic InSAR (TanDEM-X) and airborne photogrammetry (Bluesky), a new DEM co-registration method with line feature validation (river network line, ridgeline, valley line, crater boundary feature and so on) is developed and demonstrated to assist the study of a wide area DEM data quality. This DEM co-registration method aligns two DEMs irrespective of the linear distortion model, which improves the quality of DEM vertical comparison accuracy significantly and is suitable and helpful for DEM quality assessment. A systematic TomoSAR algorithm and method have been established, tested, analysed and demonstrated for various applications (urban buildings, bridges, dams) to achieve better 3D & 4D tomographic SAR imaging results. These include applying Cosmo-Skymed X band single-polarisation data over the Zipingpu dam, Dujiangyan, Sichuan, China, to map topography; and using ALOS L band data in the San Francisco Bay region to map urban building and bridge. A new ionospheric correction method based on the tile method employing IGS TEC data, a split-spectrum and an ionospheric model via least squares are developed to correct ionospheric distortion to improve the accuracy of 3D & 4D tomographic SAR imaging. Meanwhile, a pixel by pixel orbit baseline estimation method is developed to address the research gaps of baseline estimation for 3D & 4D spaceborne SAR tomography imaging. Moreover, a SAR tomography imaging algorithm and a differential tomography four-dimensional SAR imaging algorithm based on compressive sensing, SAR interferometry phase (InSAR) calibration reference to DEM with DEM error correction, a new phase error calibration and compensation algorithm, based on PS, SVD, PGA, weighted least squares and minimum entropy, are developed to obtain accurate 3D & 4D tomographic SAR imaging results. The new baseline estimation method and consequent TomoSAR processing results showed that an accurate baseline estimation is essential to build up the TomoSAR model. After baseline estimation, phase calibration experiments (via FFT and Capon method) indicate that a phase calibration step is indispensable for TomoSAR imaging, which eventually influences the inversion results. A super-resolution reconstruction CS based study demonstrates X band data with the CS method does not fit for forest reconstruction but works for reconstruction of large civil engineering structures such as dams and urban buildings. Meanwhile, the L band data with FFT, Capon and the CS method are shown to work for the reconstruction of large manmade structures (such as bridges) and urban buildings

Anomaly detection & object classification using multi-spectral LiDAR and sonar

In this thesis, we present the theory of high-dimensional signal approximation of multifrequency signals. We also present both linear and non-linear compressive sensing (CS) algorithms that generate encoded representations of time-correlated single photon counting (TCSPC) light detection and ranging (LiDAR) data, side-scan sonar (SSS) and synthetic aperture sonar (SAS). The main contributions of this thesis are summarised as follows: 1. Research is carried out studying full-waveform (FW) LiDARs, in particular, the TCSPC data, capture, storage and processing. 2. FW-LiDARs are capable of capturing large quantities of photon-counting data in real-time. However, the real-time processing of the raw LiDAR waveforms hasn’t been widely exploited. This thesis answers some of the fundamental questions: • can semantic information be extracted and encoded from raw multi-spectral FW-LiDAR signals? • can these encoded representations then be used for object segmentation and classification? 3. Research is carried out into signal approximation and compressive sensing techniques, its limitations and the application domains. 4. Research is also carried out in 3D point cloud processing, combining geometric features with material spectra (spectral-depth representation), for object segmentation and classification. 5. Extensive experiments have been carried out with publicly available datasets, e.g. the Washington RGB Image and Depth (RGB-D) dataset [108], YaleB face dataset1 [110], real-world multi-frequency aerial laser scans (ALS)2 and an underwater multifrequency (16 wavelengths) TCSPC dataset collected using custom-build targets especially for this thesis. 6. The multi-spectral measurements were made underwater on targets with different shapes and materials. A novel spectral-depth representation is presented with strong discrimination characteristics on target signatures. Several custom-made and realistically scaled exemplars with known and unknown targets have been investigated using a multi-spectral single photon counting LiDAR system. 7. In this work, we also present a new approach to peak modelling and classification for waveform enabled LiDAR systems. Not all existing approaches perform peak modelling and classification simultaneously in real-time. This was tested on both simulated waveform enabled LiDAR data and real ALS data2 . This PhD also led to an industrial secondment at Carbomap, Edinburgh, where some of the waveform modelling algorithms were implemented in C++ and CUDA for Nvidia TX1 boards for real-time performance. 1http://vision.ucsd.edu/~leekc/ExtYaleDatabase/ 2This dataset was captured in collaboration with Carbomap Ltd. Edinburgh, UK. The data was collected during one of the trials in Austria using commercial-off-the-shelf (COTS) sensors

Space-time adaptive processing techniques for multichannel mobile passive radar

Passive radar technology has reached a level of maturity for stationary sensor operations, widely proving the ability to detect, localize and track targets, by exploiting different kinds of illuminators of opportunity. In recent years, a renewed interest from both the scientific community and the industry has opened new perspectives and research areas. One of the most interesting and challenging ones is the use of passive radar sensors onboard moving platforms. This may offer a number of strategic advantages and extend the functionalities of passive radar to applications like synthetic aperture radar (SAR) imaging and ground moving target indication (GMTI). However, these benefits are paid in terms of motion-induced Doppler distortions of the received signals, which can adversely affect the system performance. In the case of surveillance applications, the detection of slowly moving targets is hindered by the Doppler-spread clutter returns, due to platform motion, and requires the use of space-time processing techniques, applied on signals collected by multiple receiving channels. Although in recent technical literature the feasibility of this concept has been preliminarily demonstrated, mobile passive radar is still far from being a mature technology and several issues still need to be addressed, mostly connected to the peculiar characteristics of the passive bistatic scenario. Specifically, significant limitations may come from the continuous and time-varying nature of the typical waveforms of opportunity, not suitable for conventional space-time processing techniques. Moreover, the low directivity of the practical receiving antennas, paired with a bistatic omni-directional illumination, further increases the clutter Doppler bandwidth and results in the simultaneous reception of non-negligible clutter contributions from a very wide angular sector. Such contributions are likely to undergo an angle-dependent imbalance across the receiving channels, exacerbated by the use of low-cost hardware. This thesis takes research on mobile passive radar for surveillance applications one step further, finding solutions to tackle the main limitations deriving from the passive bistatic framework, while preserving the paradigm of a simple system architecture. Attention is devoted to the development of signal processing algorithms and operational strategies for multichannel mobile passive radar, focusing on space-time processing techniques aimed at clutter cancellation and slowly moving target detection and localization. First, a processing scheme based on the displaced phase centre antenna (DPCA) approach is considered, for dual-channel systems. The scheme offers a simple and effective solution for passive radar GMTI, but its cancellation performance can be severely compromised by the presence of angle-dependent imbalances affecting the receiving channels. Therefore, it is paired with adaptive clutter-based calibration techniques, specifically devised for mobile passive radar. By exploiting the fine Doppler resolution offered by the typical long integration times and the one-to-one relationship between angle of arrival and Doppler frequency of the stationary scatterers, the devised techniques compensate for the angle-dependent imbalances and prove largely necessary to guarantee an effective clutter cancellation. Then, the attention is focused on space-time adaptive processing (STAP) techniques for multichannel mobile passive radar. In this case, the clutter cancellation capability relies on the adaptivity of the space-time filter, by resorting to an adjacent-bin post-Doppler (ABPD) approach. This allows to significantly reduce the size of the adaptive problem and intrinsically compensate for potential angle-dependent channel errors, by operating on a clutter subspace accounting for a limited angular sector. Therefore, ad hoc strategies are devised to counteract the effects of channel imbalance on the moving target detection and localization performance. By exploiting the clutter echoes to correct the spatial steering vector mismatch, the proposed STAP scheme is shown to enable an accurate estimation of target direction of arrival (DOA), which represents a critical task in system featuring few wide beam antennas. Finally, a dual cancelled channel STAP scheme is proposed, aimed at further reducing the system computational complexity and the number of required training data, compared to a conventional full-array solution. The proposed scheme simplifies the DOA estimation process and proves to be robust against the adaptivity losses commonly arising in a real bistatic clutter scenario, allowing effective operation even in the case of a limited sample support. The effectiveness of the techniques proposed in this work is validated by means of extensive simulated analyses and applications to real data, collected by an experimental multichannel passive radar installed on a moving platform and based on DVB-T transmission

An artificial neural network approach for soil moisture retrieval using passive microwave data

Soil moisture is a key variable that defines land surface-atmosphere (boundary layer) interactions, by contributing directly to the surface energy and water balance. Soil moisture values derived from remote sensing platforms only accounts for the near surface soil layers, generally the top 5cm. Passive microwave data at L-band (1.4 GHz, 21cm wavelength) measurements are shown to be a very effective observation for surface soil moisture retrieval. The first space-borne L-band mission dedicated to observing soil moisture, the European Space Agency's (ESA) Soil Moisture and Ocean Salinity (SMOS) mission, was launched on 2nd November 2009.Artificial Neural Network (ANN) methods have been used to empirically ascertain the complex statistical relationship between soil moisture and brightness temperature in the presence of vegetation cover. The current problem faced by this method is its inability to predict soil moisture values that are 'out-of-range' of the training data.In this research, an optimization model is developed for the Backpropagation Neural Network model. This optimization model utilizes the combination of the mean and standard deviation of the soil moisture values, together with the prediction process at different pre-determined, equal size regions to cope with the spatial and temporal variation of soil moisture values. This optimized model coupled with an ANN of optimum architecture, in terms of inputs and the number of neurons in the hidden layers, is developed to predict scale-to-scale and downscaling of soil moisture values. The dependency on the accuracy of the mean and standard deviation values of soil moisture data is also studied in this research by simulating the soil moisture values using a multiple regression model. This model obtains very encouraging results for these research problems.The data used to develop and evaluate the model in this research has been obtained from the National Airborne Field Experiments in 2005