High-resolution optical and SAR image fusion for building database updating

This paper addresses the issue of cartographic database (DB) creation or updating using high-resolution synthetic aperture radar and optical images. In cartographic applications, objects of interest are mainly buildings and roads. This paper proposes a processing chain to create or update building DBs. The approach is composed of two steps. First, if a DB is available, the presence of each DB object is checked in the images. Then, we verify if objects coming from an image segmentation should be included in the DB. To do those two steps, relevant features are extracted from images in the neighborhood of the considered object. The object removal/inclusion in the DB is based on a score obtained by the fusion of features in the framework of Dempster–Shafer evidence theory

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Vegetation Dynamics in Ecuador

Global forest cover has suffered a dramatic reduction during recent decades, especially in tropical regions, which is mainly due to human activities caused by enhanced population pressures. Nevertheless, forest ecosystems, especially tropical forests, play an important role in the carbon cycle functioning as carbon stocks and sinks, which is why conservation strategies are of utmost importance respective to ongoing global warming. In South America the highest deforestation rates are observed in Ecuador, but an operational surveillance system for continuous forest monitoring, along with the determination of deforestation rates and the estimation of actual carbon socks is still missing. Therefore, the present investigation provides a functional tool based on remote sensing data to monitor forest stands at local, regional and national scales. To evaluate forest cover and deforestation rates at country level satellite data was used, whereas LiDAR data was utilized to accurately estimate the Above Ground Biomass (AGB; carbon stocks) at catchment level. Furthermore, to provide a cost-effective tool for continuous forest monitoring of the most vulnerable parts, an Unmanned Aerial Vehicle (UAV) was deployed and equipped with various sensors (RBG and multispectral camera). The results showed that in Ecuador total forest cover was reduced by about 24% during the last three decades. Moreover, deforestation rates have increased with the beginning of the new century, especially in the Andean Highland and the Amazon Basin, due to enhanced population pressures and the government supported oil and mining industries, besides illegal timber extractions. The AGB stock estimations at catchment level indicated that most of the carbon is stored in natural ecosystems (forest and páramo; AGB ~98%), whereas areas affected by anthropogenic land use changes (mostly pastureland) lost nearly all their storage capacities (AGB ~2%). Furthermore, the LiDAR data permitted the detection of the forest structure, and therefore the identification of the most vulnerable parts. To monitor these areas, it could be shown that UAVs are useful, particularly when equipped with an RGB camera (AGB correlation: R² > 0.9), because multispectral images suffer saturation of the spectral bands over dense natural forest stands, which results in high overestimations. In summary, the developed operational surveillance systems respective to forest cover at different spatial scales can be implemented in Ecuador to promote conservation/ restoration strategies and to reduce the high deforestation rates. This may also mitigate future greenhouse gas emissions and guarantee functional ecosystem services for local and regional populations

Unsupervised Sparse Dirichlet-Net for Hyperspectral Image Super-Resolution

In many computer vision applications, obtaining images of high resolution in both the spatial and spectral domains are equally important. However, due to hardware limitations, one can only expect to acquire images of high resolution in either the spatial or spectral domains. This paper focuses on hyperspectral image super-resolution (HSI-SR), where a hyperspectral image (HSI) with low spatial resolution (LR) but high spectral resolution is fused with a multispectral image (MSI) with high spatial resolution (HR) but low spectral resolution to obtain HR HSI. Existing deep learning-based solutions are all supervised that would need a large training set and the availability of HR HSI, which is unrealistic. Here, we make the first attempt to solving the HSI-SR problem using an unsupervised encoder-decoder architecture that carries the following uniquenesses. First, it is composed of two encoder-decoder networks, coupled through a shared decoder, in order to preserve the rich spectral information from the HSI network. Second, the network encourages the representations from both modalities to follow a sparse Dirichlet distribution which naturally incorporates the two physical constraints of HSI and MSI. Third, the angular difference between representations are minimized in order to reduce the spectral distortion. We refer to the proposed architecture as unsupervised Sparse Dirichlet-Net, or uSDN. Extensive experimental results demonstrate the superior performance of uSDN as compared to the state-of-the-art.Comment: Accepted by The IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018, Spotlight