Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery

Change detection is one of the central problems in earth observation and was extensively investigated over recent decades. In this paper, we propose a novel recurrent convolutional neural network (ReCNN) architecture, which is trained to learn a joint spectral-spatial-temporal feature representation in a unified framework for change detection in multispectral images. To this end, we bring together a convolutional neural network (CNN) and a recurrent neural network (RNN) into one end-to-end network. The former is able to generate rich spectral-spatial feature representations, while the latter effectively analyzes temporal dependency in bi-temporal images. In comparison with previous approaches to change detection, the proposed network architecture possesses three distinctive properties: 1) It is end-to-end trainable, in contrast to most existing methods whose components are separately trained or computed; 2) it naturally harnesses spatial information that has been proven to be beneficial to change detection task; 3) it is capable of adaptively learning the temporal dependency between multitemporal images, unlike most of algorithms that use fairly simple operation like image differencing or stacking. As far as we know, this is the first time that a recurrent convolutional network architecture has been proposed for multitemporal remote sensing image analysis. The proposed network is validated on real multispectral data sets. Both visual and quantitative analysis of experimental results demonstrates competitive performance in the proposed mode

Mapping Chestnut Stands Using Bi-Temporal VHR Data

This study analyzes the potential of very high resolution (VHR) remote sensing images and extended morphological profiles for mapping Chestnut stands on Tenerife Island (Canary Islands, Spain). Regarding their relevance for ecosystem services in the region (cultural and provisioning services) the public sector demand up-to-date information on chestnut and a simple straight-forward approach is presented in this study. We used two VHR WorldView images (March and May 2015) to cover different phenological phases. Moreover, we included spatial information in the classification process by extended morphological profiles (EMPs). Random forest is used for the classification process and we analyzed the impact of the bi-temporal information as well as of the spatial information on the classification accuracies. The detailed accuracy assessment clearly reveals the benefit of bi-temporal VHR WorldView images and spatial information, derived by EMPs, in terms of the mapping accuracy. The bi-temporal classification outperforms or at least performs equally well when compared to the classification accuracies achieved by the mono-temporal data. The inclusion of spatial information by EMPs further increases the classification accuracy by 5% and reduces the quantity and allocation disagreements on the final map. Overall the new proposed classification strategy proves useful for mapping chestnut stands in a heterogeneous and complex landscape, such as the municipality of La Orotava, Tenerife

Deep learning in remote sensing: a review

Standing at the paradigm shift towards data-intensive science, machine learning techniques are becoming increasingly important. In particular, as a major breakthrough in the field, deep learning has proven as an extremely powerful tool in many fields. Shall we embrace deep learning as the key to all? Or, should we resist a 'black-box' solution? There are controversial opinions in the remote sensing community. In this article, we analyze the challenges of using deep learning for remote sensing data analysis, review the recent advances, and provide resources to make deep learning in remote sensing ridiculously simple to start with. More importantly, we advocate remote sensing scientists to bring their expertise into deep learning, and use it as an implicit general model to tackle unprecedented large-scale influential challenges, such as climate change and urbanization.Comment: Accepted for publication IEEE Geoscience and Remote Sensing Magazin

Land Use And Land Cover Classification And Change Detection Using Naip Imagery From 2009 To 2014: Table Rock Lake Region, Missouri

Land use and land cover (LULC) of Table Rock Lake (TRL) region has changed over the last half century after the construction of Table Rock Dam in 1959. This study uses one meter spatial resolution imagery to classify and detect the change of LULC of three typical waterside TRL regions. The main objectives are to provide an efficient and reliable classification workflow for regional level NAIP aerial imagery and identify the dynamic patterns for study areas. Seven class types are extracted by optimal classification results from year 2009, 2010, 2012 and 2014 of Table Rock Village, Kimberling City and Indian Point. Pixel-based post-classification comparison generated from-to” confusion matrices showing the detailed change patterns. I conclude that object-based random trees achieve the highest overall accuracy and kappa value, compared with the other six classification approaches, and is efficient to make a LULC classification map. Major change patterns are that vegetation, including trees and grass, increased during the last five years period while residential extension and urbanization process is not obvious to indicate high economic development in the TRL region. By adding auxiliary spatial information and object-based post-classification techniques, an improved classification procedure can be utilized for LULC change detection projects at the region level

Automated spatiotemporal landslide mapping over large areas using RapidEye time series data

In the past, different approaches for automated landslide identification based on multispectral satellite remote sensing were developed to focus on the analysis of the spatial distribution of landslide occurrences related to distinct triggering events. However, many regions, including southern Kyrgyzstan, experience ongoing process activity requiring continual multi-temporal analysis. For this purpose, an automated object-oriented landslide mapping approach has been developed based on RapidEye time series data complemented by relief information. The approach builds on analyzing temporal NDVI-trajectories for the separation between landslide-related surface changes and other land cover changes. To accommodate the variety of landslide phenomena occurring in the 7500 km2 study area, a combination of pixel-based multiple thresholds and object-oriented analysis has been implemented including the discrimination of uncertainty-related landslide likelihood classes. Applying the approach to the whole study area for the time period between 2009 and 2013 has resulted in the multi-temporal identification of 471 landslide objects. A quantitative accuracy assessment for two independent validation sites has revealed overall high mapping accuracy (Quality Percentage: 80%), proving the suitability of the developed approach for efficient spatiotemporal landslide mapping over large areas, representing an important prerequisite for objective landslide hazard and risk assessment at the regional scale

Detection of land cover changes in El Rawashda forest, Sudan: A systematic comparison: Detection of land cover changes in El Rawashda forest, Sudan: A systematic comparison

The primary objective of this research was to evaluate the potential for monitoring forest change using Landsat ETM and Aster data. This was accomplished by performing eight change detection algorithms: pixel post-classification comparison (PCC), image differencing Normalized Difference Vegetation Index (NDVI), Soil-Adjusted Vegetation Index (SAVI), Transformed Difference Vegetation Index (TDVI), principal component analysis (PCA), multivariate alteration detection (MAD), change vector analysis (CVA) and tasseled cap analysis (TCA). Methods, Post-Classification Comparison and vegetation indices are straightforward techniques and easy to apply. In this study the simplified classification with only 4 forest classes namely close forest, open forest, bare land and grass land was used The overall classification accuracy obtained were 88.4%, 91.9% and 92.1% for the years 2000, 2003 and 2006 respectively. The Tasseled Cap green layer (GTC) composite of the three images was proposed to detect the change in vegetation of the study area. We found that the RBG-TCG worked better than RGBNDVI. For instance, the RBG-TCG detected some areas of changes that RGB-NDVI failed to detect them, moreover RBG-TCG displayed different changed areas with more strong colours. Change vector analysis (CVA) based on Tasseled Cap transformation (TCT) was also applied for detecting and characterizing land cover change. The results support the CVA approach to change detection. The calculated date to date change vectors contained useful information, both in their magnitude and their direction. A powerful tool for time series analysis is the principal components analysis (PCA). This method was tested for change detection in the study area by two ways: Multitemporal PCA and Selective PCA. Both methods found to offer the potential for monitoring forest change detection. A recently proposed approach, the multivariate alteration detection (MAD), in combination with a posterior maximum autocorrelation factor transformation (MAF) was used to demonstrate visualization of vegetation changes in the study area. The MAD transformation provides a way of combining different data types that found to be useful in change detection. Accuracy assessment is an important final step addressed in the study to evaluate the different change detection techniques. A quantitative accuracy assessment at level of change/no change pixels was performed to determine the threshold value with the highest accuracy. Among the various accuracy assessment methods presented the highest accuracy was obtained using the post-classification comparison based on supervised classification of each two time periods (2000 -2003 and 2003-2006), which were 90.6% and 87% consequently

Detection of land cover changes in El Rawashda forest, Sudan: A systematic comparison: Detection of land cover changes in El Rawashda forest, Sudan: A systematic comparison

The primary objective of this research was to evaluate the potential for monitoring forest change using Landsat ETM and Aster data. This was accomplished by performing eight change detection algorithms: pixel post-classification comparison (PCC), image differencing Normalized Difference Vegetation Index (NDVI), Soil-Adjusted Vegetation Index (SAVI), Transformed Difference Vegetation Index (TDVI), principal component analysis (PCA), multivariate alteration detection (MAD), change vector analysis (CVA) and tasseled cap analysis (TCA). Methods, Post-Classification Comparison and vegetation indices are straightforward techniques and easy to apply. In this study the simplified classification with only 4 forest classes namely close forest, open forest, bare land and grass land was used The overall classification accuracy obtained were 88.4%, 91.9% and 92.1% for the years 2000, 2003 and 2006 respectively. The Tasseled Cap green layer (GTC) composite of the three images was proposed to detect the change in vegetation of the study area. We found that the RBG-TCG worked better than RGBNDVI. For instance, the RBG-TCG detected some areas of changes that RGB-NDVI failed to detect them, moreover RBG-TCG displayed different changed areas with more strong colours. Change vector analysis (CVA) based on Tasseled Cap transformation (TCT) was also applied for detecting and characterizing land cover change. The results support the CVA approach to change detection. The calculated date to date change vectors contained useful information, both in their magnitude and their direction. A powerful tool for time series analysis is the principal components analysis (PCA). This method was tested for change detection in the study area by two ways: Multitemporal PCA and Selective PCA. Both methods found to offer the potential for monitoring forest change detection. A recently proposed approach, the multivariate alteration detection (MAD), in combination with a posterior maximum autocorrelation factor transformation (MAF) was used to demonstrate visualization of vegetation changes in the study area. The MAD transformation provides a way of combining different data types that found to be useful in change detection. Accuracy assessment is an important final step addressed in the study to evaluate the different change detection techniques. A quantitative accuracy assessment at level of change/no change pixels was performed to determine the threshold value with the highest accuracy. Among the various accuracy assessment methods presented the highest accuracy was obtained using the post-classification comparison based on supervised classification of each two time periods (2000 -2003 and 2003-2006), which were 90.6% and 87% consequently