A Signal processing approach for preprocessing and 3d analysis of airborne small-footprint full waveform lidar data

The extraction of structural object metrics from a next generation remote sensing modality, namely waveform light detection and ranging (LiDAR), has garnered increasing interest from the remote sensing research community. However, a number of challenges need to be addressed before structural or 3D vegetation modeling can be accomplished. These include proper processing of complex, often off-nadir waveform signals, extraction of relevant waveform parameters that relate to vegetation structure, and from a quantitative modeling perspective, 3D rendering of a vegetation object from LiDAR waveforms. Three corresponding, broad research objectives therefore were addressed in this dissertation. Firstly, the raw incoming LiDAR waveform typically exhibits a stretched, misaligned, and relatively distorted character. A robust signal preprocessing chain for LiDAR waveform calibration, which includes noise reduction, deconvolution, waveform registration, and angular rectification is presented. This preprocessing chain was validated using both simulated waveform data of high fidelity 3D vegetation models, which were derived via the Digital Imaging and Remote Sensing Image Generation (DIRSIG) modeling environment and real small-footprint waveform LiDAR data, collected by the Carnegie Airborne Observatory (CAO) in a savanna region of South Africa. Results showed that the preprocessing approach significantly increased our ability to recover the temporal signal resolution, and resulted in improved waveform-based vegetation biomass estimation. Secondly, a model for savanna vegetation biomass was derived using the resultant processed waveform data and by decoding the waveform in terms of feature metrics for woody and herbaceous biomass estimation. The results confirmed that small-footprint waveform LiDAR data have significant potential in the case of this application. Finally, a 3D image clustering-based waveform LiDAR inversion model was developed for 1st order (principal branch level) 3D tree reconstruction in both leaf-off and leaf-on conditions. These outputs not only contribute to the visualization of complex tree structures, but also benefit efforts related to the quantification of vegetation structure for natural resource applications from waveform LiDAR data

Fourier-based Rotation-invariant Feature Boosting: An Efficient Framework for Geospatial Object Detection

Geospatial object detection of remote sensing imagery has been attracting an increasing interest in recent years, due to the rapid development in spaceborne imaging. Most of previously proposed object detectors are very sensitive to object deformations, such as scaling and rotation. To this end, we propose a novel and efficient framework for geospatial object detection in this letter, called Fourier-based rotation-invariant feature boosting (FRIFB). A Fourier-based rotation-invariant feature is first generated in polar coordinate. Then, the extracted features can be further structurally refined using aggregate channel features. This leads to a faster feature computation and more robust feature representation, which is good fitting for the coming boosting learning. Finally, in the test phase, we achieve a fast pyramid feature extraction by estimating a scale factor instead of directly collecting all features from image pyramid. Extensive experiments are conducted on two subsets of NWPU VHR-10 dataset, demonstrating the superiority and effectiveness of the FRIFB compared to previous state-of-the-art methods

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin