Deep learning for fusion of APEX hyperspectral and full-waveform LiDAR remote sensing data for tree species mapping

Deep learning has been widely used to fuse multi-sensor data for classification. However, current deep learning architecture for multi-sensor data fusion might not always perform better than single data source, especially for the fusion of hyperspectral and light detection and ranging (LiDAR) remote sensing data for tree species mapping in complex, closed forest canopies. In this paper, we propose a new deep fusion framework to integrate the complementary information from hyperspectral and LiDAR data for tree species mapping. We also investigate the fusion of either “single-band” or multi-band (i.e., full-waveform) LiDAR with hyperspectral data for tree species mapping. Additionally, we provide a solution to estimate the crown size of tree species by the fusion of multi-sensor data. Experimental results on fusing real APEX hyperspectral and LiDAR data demonstrate the effectiveness of the proposed deep fusion framework. Compared to using only single data source or current deep fusion architecture, our proposed method yields improvements in overall and average classification accuracies ranging from 82.21% to 87.10% and 76.71% to 83.45%, respectively

Exploring the Potential of Feature Selection Methods in the Classification of Urban Trees Using Field Spectroscopy Data

Mapping of vegetation at the species level using hyperspectral satellite data can be effective and accurate because of its high spectral and spatial resolutions that can detect detailed information of a target object. Its wide application, however, not only is restricted by its high cost and large data storage requirements, but its processing is also complicated by challenges of what is known as the Hughes effect. The Hughes effect is where classification accuracy decreases once the number of features or wavelengths passes a certain limit. This study aimed to explore the potential of feature selection methods in the classification of urban trees using field hyperspectral data. We identified the best feature selection method of key wavelengths that respond to the target urban tree species for effective and accurate classification. The study compared the effectiveness of Principal Component Analysis Discriminant Analysis (PCA-DA), Partial Least Squares Discriminant Analysis (PLS-DA) and Guided Regularized Random Forest (GRRF) in feature selection of the key wavelengths for classification of urban trees. The classification performance of Random Forest (RF) and Support Vector Machines (SVM) algorithms were also compared to determine the importance of the key wavelengths selected for the detection of the target urban trees. The feature selection methods managed to reduce the high dimensionality of the hyperspectral data. Both the PCA-DA and PLS-DA selected 10 wavelengths and the GRRF algorithm selected 13 wavelengths from the entire dataset (n = 1523). Most of the key wavelengths were from the short-wave infrared region (1300-2500 nm). SVM outperformed RF in classifying the key wavelengths selected by the feature selection methods. The SVM classifier produced overall accuracy values of 95.3%, 93.3% and 86% using the GRRF, PLS-DA and PCA-DA techniques, respectively, whereas those for the RF classifier were 88.7%, 72% and 56.8%, respectively

Tree species identification within an extensive forest area with diverse management regimes using airborne hyperspectral data

Information on tree species composition is crucial in forest management and can be obtained using remote sensing. While the topic has been addressed frequently over the last years, the remote sensing-based identification of tree species across wide and complex forest areas is still sparse in the literature. Our study presents a tree species classification of a large fraction of the Białowieża Forest in Poland covering 62 000 ha and being subject to diverse management regimes. Key objectives were to obtain an accurate tree species map and to examine if the prevalent management strategy influences the classification results. Tree species classification was conducted based on airborne hyperspectral HySpex data. We applied an iterative Support Vector Machine classification and obtained a thematic map of 7 individual tree species (birch, oak, hornbeam, lime, alder, pine, spruce) and an additional class containing other broadleaves. Generally, the more heterogeneous the area was, the more errors we observed in the classification results. Managed forests were classified more accurately than reserves. Our findings indicate that mapping dominant tree species with airborne hyperspectral data can be accomplished also over large areas and that forest management and its effects on forest structure has an influence on classification accuracies and should be actively considered when progressing towards operational mapping of tree species composition

Robust dynamic classifier selection for remote sensing image classification

Dynamic classifier selection (DCS) is a classification technique that, for each new sample to be classified, selects and uses the most competent classifier among a set of available ones. We here propose a novel DCS model (R-DCS) based on the robustness of its prediction: the extent to which the classifier can be altered without changing its prediction. In order to define and compute this robustness, we adopt methods from the theory of imprecise probabilities. Additionally, two selection strategies for R-DCS model are presented and are applied on remote sensing images. The experiment results demonstrate that our model successfully incorporates uncertainty with respect to the model parameters without losing the performance

Hyperspectral and multispectral image fusion via tensor sparsity regularization

Hyperspectral image (HSI) super-resolution scheme based on HSI and multispectral image (MSI) fusion has been a prevalent research theme in remote sensing. However, most of the existing HSI-MSI fusion (HMF) methods adopt the sparsity prior across spatial or spectral domains via vectorizing hyperspectral cubes along a certain dimension, which results in the spatial or spectral informations distortion. Moreover, the current HMF works rarely pay attention to leveraging the nonlocal similar structure over spatial domain of the HSI. In this paper, we propose a new HSI-MSI fusion approach via tensor sparsity regularization which can encode essential spatial and spectral sparsity of an HSI. Specifically, we study how to utilize reasonably the sparsity of tensor to describe the spatialspectral correlation hidden in an HSI. Then, we resort to an efficient optimization strategy based on the alternative direction multiplier method (ADMM) for solving the resulting minimization problem. Experimental results on Pavia University data verify the merits of the proposed HMF algorithm

Individual tree-based vs pixel-based approaches to mapping forest functional traits and diversity by remote sensing

Plant ecology and biodiversity research have increasingly incorporated trait-based approaches and remote sensing. Compared with traditional field survey (which typically samples individual trees), remote sensing enables quantifying functional traits over large contiguous areas, but assigning trait values to biological units such as species and individuals is difficult with pixel-based approaches. We used a subtropical forest landscape in China to compare an approach based on airborne LiDAR-delineated individual tree crowns (ITCs) with a pixel-based approach for assessing functional traits from remote sensing data. We compared trait distributions, trait–trait relationships and functional diversity metrics obtained by the ITC- and pixel-based approaches at changing pixel size and extent. We found that morphological traits derived from airborne laser scanning showed more differences between ITC- and pixel-based approaches than physiological traits estimated by airborne Pushbroom Hyperspectral Imager-3 (PHI-3) hyperspectral data. Pixel sizes approximating average tree crowns yielded similar results as ITCs, but 95th quantile height and foliage height diversity tended to be overestimated and leaf area index underestimated relative to ITC-based values. With increasing pixel size, the differences to ITC-based trait values became larger and less trait variance was captured, indicating information loss. The consistency of ITC- and pixel-based functional richness also decreased with increasing pixel size, and changed with the observed extent for functional diversity monitoring. We conclude that whereas ITC-based approaches in principle allow partitioning of variation between individuals, genotypes and species, high-resolution pixel-based approaches come close to this and can be suitable for assessing ecosystem-scale trait variation by weighting individuals and species according to coverage

Remote Sensing of Plant Biodiversity

This Open Access volume aims to methodologically improve our understanding of biodiversity by linking disciplines that incorporate remote sensing, and uniting data and perspectives in the fields of biology, landscape ecology, and geography. The book provides a framework for how biodiversity can be detected and evaluated—focusing particularly on plants—using proximal and remotely sensed hyperspectral data and other tools such as LiDAR. The volume, whose chapters bring together a large cross-section of the biodiversity community engaged in these methods, attempts to establish a common language across disciplines for understanding and implementing remote sensing of biodiversity across scales. The first part of the book offers a potential basis for remote detection of biodiversity. An overview of the nature of biodiversity is described, along with ways for determining traits of plant biodiversity through spectral analyses across spatial scales and linking spectral data to the tree of life. The second part details what can be detected spectrally and remotely. Specific instrumentation and technologies are described, as well as the technical challenges of detection and data synthesis, collection and processing. The third part discusses spatial resolution and integration across scales and ends with a vision for developing a global biodiversity monitoring system. Topics include spectral and functional variation across habitats and biomes, biodiversity variables for global scale assessment, and the prospects and pitfalls in remote sensing of biodiversity at the global scale

Remote Sensing of Plant Biodiversity

At last, here it is. For some time now, the world has needed a text providing both a new theoretical foundation and practical guidance on how to approach the challenge of biodiversity decline in the Anthropocene. This is a global challenge demanding global approaches to understand its scope and implications. Until recently, we have simply lacked the tools to do so. We are now entering an era in which we can realistically begin to understand and monitor the multidimensional phenomenon of biodiversity at a planetary scale. This era builds upon three centuries of scientific research on biodiversity at site to landscape levels, augmented over the past two decades by airborne research platforms carrying spectrometers, lidars, and radars for larger-scale observations. Emerging international networks of fine-grain in-situ biodiversity observations complemented by space-based sensors offering coarser-grain imagery—but global coverage—of ecosystem composition, function, and structure together provide the information necessary to monitor and track change in biodiversity globally. This book is a road map on how to observe and interpret terrestrial biodiversity across scales through plants—primary producers and the foundation of the trophic pyramid. It honors the fact that biodiversity exists across different dimensions, including both phylogenetic and functional. Then, it relates these aspects of biodiversity to another dimension, the spectral diversity captured by remote sensing instruments operating at scales from leaf to canopy to biome. The biodiversity community has needed a Rosetta Stone to translate between the language of satellite remote sensing and its resulting spectral diversity and the languages of those exploring the phylogenetic diversity and functional trait diversity of life on Earth. By assembling the vital translation, this volume has globalized our ability to track biodiversity state and change. Thus, a global problem meets a key component of the global solution. The editors have cleverly built the book in three parts. Part 1 addresses the theory behind the remote sensing of terrestrial plant biodiversity: why spectral diversity relates to plant functional traits and phylogenetic diversity. Starting with first principles, it connects plant biochemistry, physiology, and macroecology to remotely sensed spectra and explores the processes behind the patterns we observe. Examples from the field demonstrate the rising synthesis of multiple disciplines to create a new cross-spatial and spectral science of biodiversity. Part 2 discusses how to implement this evolving science. It focuses on the plethora of novel in-situ, airborne, and spaceborne Earth observation tools currently and soon to be available while also incorporating the ways of actually making biodiversity measurements with these tools. It includes instructions for organizing and conducting a field campaign. Throughout, there is a focus on the burgeoning field of imaging spectroscopy, which is revolutionizing our ability to characterize life remotely. Part 3 takes on an overarching issue for any effort to globalize biodiversity observations, the issue of scale. It addresses scale from two perspectives. The first is that of combining observations across varying spatial, temporal, and spectral resolutions for better understanding—that is, what scales and how. This is an area of ongoing research driven by a confluence of innovations in observation systems and rising computational capacity. The second is the organizational side of the scaling challenge. It explores existing frameworks for integrating multi-scale observations within global networks. The focus here is on what practical steps can be taken to organize multi-scale data and what is already happening in this regard. These frameworks include essential biodiversity variables and the Group on Earth Observations Biodiversity Observation Network (GEO BON). This book constitutes an end-to-end guide uniting the latest in research and techniques to cover the theory and practice of the remote sensing of plant biodiversity. In putting it together, the editors and their coauthors, all preeminent in their fields, have done a great service for those seeking to understand and conserve life on Earth—just when we need it most. For if the world is ever to construct a coordinated response to the planetwide crisis of biodiversity loss, it must first assemble adequate—and global—measures of what we are losing

Benchmarking airborne laser scanning tree segmentation algorithms in broadleaf forests shows high accuracy only for canopy trees

Individual tree segmentation from airborne laser scanning data is a longstanding and important challenge in forest remote sensing. Tree segmentation algorithms are widely available, but robust intercomparison studies are rare due to the difficulty of obtaining reliable reference data. Here we provide a benchmark data set for temperate and tropical broadleaf forests generated from labelled terrestrial laser scanning data. We compared the performance of four widely used tree segmentation algorithms against this benchmark data set. All algorithms performed reasonably well on the canopy trees. The point cloud-based algorithm AMS3D (Adaptive Mean Shift 3D) had the highest overall accuracy, closely followed by the 2D raster based region growing algorithm Dalponte2016 +. However, all algorithms failed to accurately segment the understory trees. This result was consistent across both forest types. This study emphasises the need to assess tree segmentation algorithms directly using benchmark data, rather than comparing with forest indices such as biomass or the number and size distribution of trees. We provide the first openly available benchmark data set for tropical forests and we hope future studies will extend this work to other regions