284 research outputs found
Spectral unmixing of Multispectral Lidar signals
In this paper, we present a Bayesian approach for spectral unmixing of
multispectral Lidar (MSL) data associated with surface reflection from targeted
surfaces composed of several known materials. The problem addressed is the
estimation of the positions and area distribution of each material. In the
Bayesian framework, appropriate prior distributions are assigned to the unknown
model parameters and a Markov chain Monte Carlo method is used to sample the
resulting posterior distribution. The performance of the proposed algorithm is
evaluated using synthetic MSL signals, for which single and multi-layered
models are derived. To evaluate the expected estimation performance associated
with MSL signal analysis, a Cramer-Rao lower bound associated with model
considered is also derived, and compared with the experimental data. Both the
theoretical lower bound and the experimental analysis will be of primary
assistance in future instrument design
Non-convex regularization in remote sensing
In this paper, we study the effect of different regularizers and their
implications in high dimensional image classification and sparse linear
unmixing. Although kernelization or sparse methods are globally accepted
solutions for processing data in high dimensions, we present here a study on
the impact of the form of regularization used and its parametrization. We
consider regularization via traditional squared (2) and sparsity-promoting (1)
norms, as well as more unconventional nonconvex regularizers (p and Log Sum
Penalty). We compare their properties and advantages on several classification
and linear unmixing tasks and provide advices on the choice of the best
regularizer for the problem at hand. Finally, we also provide a fully
functional toolbox for the community.Comment: 11 pages, 11 figure
A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community
In recent years, deep learning (DL), a re-branding of neural networks (NNs),
has risen to the top in numerous areas, namely computer vision (CV), speech
recognition, natural language processing, etc. Whereas remote sensing (RS)
possesses a number of unique challenges, primarily related to sensors and
applications, inevitably RS draws from many of the same theories as CV; e.g.,
statistics, fusion, and machine learning, to name a few. This means that the RS
community should be aware of, if not at the leading edge of, of advancements
like DL. Herein, we provide the most comprehensive survey of state-of-the-art
RS DL research. We also review recent new developments in the DL field that can
be used in DL for RS. Namely, we focus on theories, tools and challenges for
the RS community. Specifically, we focus on unsolved challenges and
opportunities as it relates to (i) inadequate data sets, (ii)
human-understandable solutions for modelling physical phenomena, (iii) Big
Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and
learning algorithms for spectral, spatial and temporal data, (vi) transfer
learning, (vii) an improved theoretical understanding of DL systems, (viii)
high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote
Sensin
A Few Photons Among Many: Unmixing Signal and Noise for Photon-Efficient Active Imaging
Conventional LIDAR systems require hundreds or thousands of photon detections
to form accurate depth and reflectivity images. Recent photon-efficient
computational imaging methods are remarkably effective with only 1.0 to 3.0
detected photons per pixel, but they are not demonstrated at
signal-to-background ratio (SBR) below 1.0 because their imaging accuracies
degrade significantly in the presence of high background noise. We introduce a
new approach to depth and reflectivity estimation that focuses on unmixing
contributions from signal and noise sources. At each pixel in an image,
short-duration range gates are adaptively determined and applied to remove
detections likely to be due to noise. For pixels with too few detections to
perform this censoring accurately, we borrow data from neighboring pixels to
improve depth estimates, where the neighborhood formation is also adaptive to
scene content. Algorithm performance is demonstrated on experimental data at
varying levels of noise. Results show improved performance of both reflectivity
and depth estimates over state-of-the-art methods, especially at low
signal-to-background ratios. In particular, accurate imaging is demonstrated
with SBR as low as 0.04. This validation of a photon-efficient, noise-tolerant
method demonstrates the viability of rapid, long-range, and low-power LIDAR
imaging
Regional scale dryland vegetation classification with an integrated lidar-hyperspectral approach
The sparse canopy cover and large contribution of bright background soil, along with the heterogeneous vegetation types in close proximity, are common challenges for mapping dryland vegetation with remote sensing. Consequently, the results of a single classification algorithm or one type of sensor to characterize dryland vegetation typically show low accuracy and lack robustness. In our study, we improved classification accuracy in a semi-arid ecosystem based on the use of vegetation optical (hyperspectral) and structural (lidar) information combined with the environmental characteristics of the landscape. To accomplish this goal, we used both spectral angle mapper (SAM) and multiple endmember spectral mixture analysis (MESMA) for optical vegetation classification. Lidar-derived maximum vegetation height and delineated riparian zones were then used to modify the optical classification. Incorporating the lidar information into the classification scheme increased the overall accuracy from 60% to 89%. Canopy structure can have a strong influence on spectral variability and the lidar provided complementary information for SAM’s sensitivity to shape but not magnitude of the spectra. Similar approaches to map large regions of drylands with low uncertainty may be readily implemented with unmixing algorithms applied to upcoming space-based imaging spectroscopy and lidar. This study advances our understanding of the nuances associated with mapping xeric and mesic regions, and highlights the importance of incorporating complementary algorithms and sensors to accurately characterize the heterogeneity of dryland ecosystems
Context dependent spectral unmixing.
A hyperspectral unmixing algorithm that finds multiple sets of endmembers is proposed. The algorithm, called Context Dependent Spectral Unmixing (CDSU), is a local approach that adapts the unmixing to different regions of the spectral space. It is based on a novel function that combines context identification and unmixing. This joint objective function models contexts as compact clusters and uses the linear mixing model as the basis for unmixing. Several variations of the CDSU, that provide additional desirable features, are also proposed. First, the Context Dependent Spectral unmixing using the Mahalanobis Distance (CDSUM) offers the advantage of identifying non-spherical clusters in the high dimensional spectral space. Second, the Cluster and Proportion Constrained Multi-Model Unmixing (CC-MMU and PC-MMU) algorithms use partial supervision information, in the form of cluster or proportion constraints, to guide the search process and narrow the space of possible solutions. The supervision information could be provided by an expert, generated by analyzing the consensus of multiple unmixing algorithms, or extracted from co-located data from a different sensor. Third, the Robust Context Dependent Spectral Unmixing (RCDSU) introduces possibilistic memberships into the objective function to reduce the effect of noise and outliers in the data. Finally, the Unsupervised Robust Context Dependent Spectral Unmixing (U-RCDSU) algorithm learns the optimal number of contexts in an unsupervised way. The performance of each algorithm is evaluated using synthetic and real data. We show that the proposed methods can identify meaningful and coherent contexts, and appropriate endmembers within each context. The second main contribution of this thesis is consensus unmixing. This approach exploits the diversity and similarity of the large number of existing unmixing algorithms to identify an accurate and consistent set of endmembers in the data. We run multiple unmixing algorithms using different parameters, and combine the resulting unmixing ensemble using consensus analysis. The extracted endmembers will be the ones that have a consensus among the multiple runs. The third main contribution consists of developing subpixel target detectors that rely on the proposed CDSU algorithms to adapt target detection algorithms to different contexts. A local detection statistic is computed for each context and then all scores are combined to yield a final detection score. The context dependent unmixing provides a better background description and limits target leakage, which are two essential properties for target detection algorithms
Regional Scale Dryland Vegetation Classification with an Integrated Lidar-Hyperspectral Approach
The sparse canopy cover and large contribution of bright background soil, along with the heterogeneous vegetation types in close proximity, are common challenges for mapping dryland vegetation with remote sensing. Consequently, the results of a single classification algorithm or one type of sensor to characterize dryland vegetation typically show low accuracy and lack robustness. In our study, we improved classification accuracy in a semi-arid ecosystem based on the use of vegetation optical (hyperspectral) and structural (lidar) information combined with the environmental characteristics of the landscape. To accomplish this goal, we used both spectral angle mapper (SAM) and multiple endmember spectral mixture analysis (MESMA) for optical vegetation classification. Lidar-derived maximum vegetation height and delineated riparian zones were then used to modify the optical classification. Incorporating the lidar information into the classification scheme increased the overall accuracy from 60% to 89%. Canopy structure can have a strong influence on spectral variability and the lidar provided complementary information for SAM’s sensitivity to shape but not magnitude of the spectra. Similar approaches to map large regions of drylands with low uncertainty may be readily implemented with unmixing algorithms applied to upcoming space-based imaging spectroscopy and lidar. This study advances our understanding of the nuances associated with mapping xeric and mesic regions, and highlights the importance of incorporating complementary algorithms and sensors to accurately characterize the heterogeneity of dryland ecosystems
Spectral Superresolution of Multispectral Imagery with Joint Sparse and Low-Rank Learning
Extensive attention has been widely paid to enhance the spatial resolution of
hyperspectral (HS) images with the aid of multispectral (MS) images in remote
sensing. However, the ability in the fusion of HS and MS images remains to be
improved, particularly in large-scale scenes, due to the limited acquisition of
HS images. Alternatively, we super-resolve MS images in the spectral domain by
the means of partially overlapped HS images, yielding a novel and promising
topic: spectral superresolution (SSR) of MS imagery. This is challenging and
less investigated task due to its high ill-posedness in inverse imaging. To
this end, we develop a simple but effective method, called joint sparse and
low-rank learning (J-SLoL), to spectrally enhance MS images by jointly learning
low-rank HS-MS dictionary pairs from overlapped regions. J-SLoL infers and
recovers the unknown hyperspectral signals over a larger coverage by sparse
coding on the learned dictionary pair. Furthermore, we validate the SSR
performance on three HS-MS datasets (two for classification and one for
unmixing) in terms of reconstruction, classification, and unmixing by comparing
with several existing state-of-the-art baselines, showing the effectiveness and
superiority of the proposed J-SLoL algorithm. Furthermore, the codes and
datasets will be available at:
https://github.com/danfenghong/IEEE\_TGRS\_J-SLoL, contributing to the RS
community
- …