Multisource and Multitemporal Data Fusion in Remote Sensing

The sharp and recent increase in the availability of data captured by different sensors combined with their considerably heterogeneous natures poses a serious challenge for the effective and efficient processing of remotely sensed data. Such an increase in remote sensing and ancillary datasets, however, opens up the possibility of utilizing multimodal datasets in a joint manner to further improve the performance of the processing approaches with respect to the application at hand. Multisource data fusion has, therefore, received enormous attention from researchers worldwide for a wide variety of applications. Moreover, thanks to the revisit capability of several spaceborne sensors, the integration of the temporal information with the spatial and/or spectral/backscattering information of the remotely sensed data is possible and helps to move from a representation of 2D/3D data to 4D data structures, where the time variable adds new information as well as challenges for the information extraction algorithms. There are a huge number of research works dedicated to multisource and multitemporal data fusion, but the methods for the fusion of different modalities have expanded in different paths according to each research community. This paper brings together the advances of multisource and multitemporal data fusion approaches with respect to different research communities and provides a thorough and discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to conduct novel investigations on this challenging topic by supplying sufficient detail and references

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Change Detection in Multi-temporal Images Using Multistage Clustering for Disaster Recovery Planning

Change detection analysis on multi-temporal images using various methods have been developed by many researchers in the field of spatial data analysis and image processing. Change detection analysis has many benefit for real world applications such as medical image analysis, valuable material detector, satellite image analysis, disaster recovery planning, and many others. Indonesia is one of the most country that encounter natural disaster. The most memorable disaster was happened in December 26, 2004. Change detection is one of the important part management planning for natural disaster recovery. This article present the fast and accurate result of change detection on multi-temporal images using multistage clustering. There are three main step for change detection in this article, the first step is to find the image difference of two multi-temporal images between the time before disaster and after disaster using operation log ratio between those images. The second step is clustering the difference image using Fuzzy C means divided into three classes. Change, unchanged, and intermediate change region. Afterword the last step is cluster the change map from fuzzy C means clustering using k means clustering, divided into two classes. Change and unchanged region. Both clustering\u27s based on Euclidian distance

Multitemporal Feature-Level Fusion on Hyperspectral and LiDAR Data in the Urban Environment

publishedVersio

CHANGE DETECTION IN MULTI-TEMPORAL IMAGES USING MULTISTAGE CLUSTERING FOR DISASTER RECOVERY PLANNING

Change detection analysis on multi-temporal images using various methods have been developed by many researchers in the field of spatial data analysis and image processing. Change detection analysis has many benefit for real world applications such as medical image analysis, valuable material detector, satellite image analysis, disaster recovery planning, and many others. Indonesia is one of the most country that encounter natural disaster. The most memorable disaster was happened in December 26, 2004. Change detection is one of the important part management planning for natural disaster recovery. This article present the fast and accurate result of change detection on multi-temporal images using multistage clustering. There are three main step for change detection in this article, the first step is to find the image difference of two multi-temporal images between the time before disaster and after disaster using operation log ratio between those images. The second step is clustering the difference image using Fuzzy C means divided into three classes. Change, unchanged, and intermediate change region. Afterword the last step is cluster the change map from fuzzy C means clustering using k means clustering, divided into two classes. Change and unchanged region. Both clustering’s based on Euclidian distance

Robust unsupervised small area change detection from SAR imagery using deep learning

Small area change detection using synthetic aperture radar (SAR) imagery is a highly challenging task, due to speckle noise and imbalance between classes (changed and unchanged). In this paper, a robust unsupervised approach is proposed for small area change detection using deep learning techniques. First, a multi-scale superpixel reconstruction method is developed to generate a difference image (DI), which can suppress the speckle noise effectively and enhance edges by exploiting local, spatially homogeneous information. Second, a two-stage centre-constrained fuzzy c-means clustering algorithm is proposed to divide the pixels of the DI into changed, unchanged and intermediate classes with a parallel clustering strategy. Image patches belonging to the first two classes are then constructed as pseudo-label training samples, and image patches of the intermediate class are treated as testing samples. Finally, a convolutional wavelet neural network (CWNN) is designed and trained to classify testing samples into changed or unchanged classes, coupled with a deep convolutional generative adversarial network (DCGAN) to increase the number of changed class within the pseudo-label training samples. Numerical experiments on four real SAR datasets demonstrate the validity and robustness of the proposed approach, achieving up to 99.61% accuracy for small area change detection