Super-resolution mapping

Super-resolution mapping is becoming an increasing important technique in remote sensing for land cover mapping at a sub-pixel scale from coarse spatial resolution imagery. The potential of this technique could increase the value of the low cost coarse spatial resolution imagery. Among many types of land cover patches that can be represented by the super-resolution mapping, the prediction of patches smaller than an image pixel is one of the most difficult. This is because of the lack of information on the existence and spatial extend of the small land cover patches. Another difficult problem is to represent the location of small patches accurately. This thesis focuses on the potential of super-resolution mapping for accurate land cover mapping, with particular emphasis on the mapping of small patches. Popular super-resolution mapping techniques such as pixel swapping and the Hopfield neural network are used as well as a new method proposed. Using a Hopfield neural network (HNN) for super-resolution mapping, the best parameters and configuration to represent land cover patches of different sizes, shapes and mosaics are investigated. In addition, it also shown how a fusion of time series coarse spatial resolution imagery, such as daily MODIS 250 m images, can aid the determination of small land cover patch locations, thus reducing the spatial variability of the representation of such patches. Results of the improved HNN using a time series images are evaluated in a series of assessments, and demonstrated to be superior in terms of mapping accuracy than that of the standard techniques. A novel super-resolution mapping technique based on halftoning concept is presented as an alternative solution for the super-resolution mapping. This new technique is able to represent more land cover patches than the standard techniques

Super-resolution mapping

Super-resolution mapping is becoming an increasing important technique in remote sensing for land cover mapping at a sub-pixel scale from coarse spatial resolution imagery. The potential of this technique could increase the value of the low cost coarse spatial resolution imagery. Among many types of land cover patches that can be represented by the super-resolution mapping, the prediction of patches smaller than an image pixel is one of the most difficult. This is because of the lack of information on the existence and spatial extend of the small land cover patches. Another difficult problem is to represent the location of small patches accurately. This thesis focuses on the potential of super-resolution mapping for accurate land cover mapping, with particular emphasis on the mapping of small patches. Popular super-resolution mapping techniques such as pixel swapping and the Hopfield neural network are used as well as a new method proposed. Using a Hopfield neural network (HNN) for super-resolution mapping, the best parameters and configuration to represent land cover patches of different sizes, shapes and mosaics are investigated. In addition, it also shown how a fusion of time series coarse spatial resolution imagery, such as daily MODIS 250 m images, can aid the determination of small land cover patch locations, thus reducing the spatial variability of the representation of such patches. Results of the improved HNN using a time series images are evaluated in a series of assessments, and demonstrated to be superior in terms of mapping accuracy than that of the standard techniques. A novel super-resolution mapping technique based on halftoning concept is presented as an alternative solution for the super-resolution mapping. This new technique is able to represent more land cover patches than the standard techniques

An iterative interpolation deconvolution algorithm for superresolution land cover mapping

Super-resolution mapping (SRM) is a method to produce a fine spatial resolution land cover map from coarse spatial resolution remotely sensed imagery. A popular approach for SRM is a two-step algorithm, which first increases the spatial resolution of coarse fraction images by interpolation, and then determines class labels of fine resolution pixels using the maximum a posteriori (MAP) principle. By constructing a new image formation process that establishes the relationship between observed coarse resolution fraction images and the latent fine resolution land cover map, it is found that the MAP principle only matches with area-to-point interpolation algorithms, and should be replaced by de-convolution if an area-to-area interpolation algorithm is to be applied. A novel iterative interpolation de-convolution (IID) SRM algorithm is proposed. The IID algorithm first interpolates coarse resolution fraction images with an area-to-area interpolation algorithm, and produces an initial fine resolution land cover map by de-convolution. The fine spatial resolution land cover map is then updated by re-convolution, back-projection and de-convolution iteratively until the final result is produced. The IID algorithm was evaluated with simulated shapes, simulated multi-spectral images, and degraded Landsat images, including comparison against three widely used SRM algorithms: pixel swapping, bilinear interpolation, and Hopfield neural network. Results show that the IID algorithm can reduce the impact of fraction errors, and can preserve the patch continuity and the patch boundary smoothness, simultaneously. Moreover, the IID algorithm produced fine resolution land cover maps with higher accuracies than those produced by other SRM algorithms

Foreword to the special issue on pattern recognition in remote sensing

Cataloged from PDF version of article.The nine papers in this special issue focus on covering different aspects of remote sensing image analysis. © 2012 IEE

Super-resolution land cover mapping by deep learning

Super-resolution mapping (SRM) is a technique to estimate a fine spatial resolution land cover map from coarse spatial resolution fractional proportion images. SRM is often based explicitly on the use of a spatial pattern model that represents the land cover mosaic at the fine spatial resolution. Recently developed deep learning methods have considerable potential as an alternative approach for SRM, based on learning the spatial pattern of land cover from existing fine resolution data such as land cover maps. This letter proposes a deep learning-based SRM algorithm (DeepSRM). A deep convolutional neural network was first trained to estimate a fine resolution indicator image for each class from the coarse resolution fractional image, and all indicator maps were then combined to create the final fine resolution land cover map based on the maximal value strategy. The results of an experiment undertaken with simulated images show that DeepSRM was superior to conventional hard classification and a suite of popular SRM algorithms, yielding the most accurate land cover representation. Consequently, methods such as DeepSRM may help exploit the potential of remote sensing as a source of accurate land cover information

Learning-based superresolution land cover mapping

Super-resolution mapping (SRM) is a technique for generating a fine spatial resolution land cover map from coarse spatial resolution fraction images estimated by soft classification. The prior model used to describe the fine spatial resolution land cover pattern is a key issue in SRM. Here, a novel learning based SRM algorithm, whose prior model is learned from other available fine spatial resolution land cover maps, is proposed. The approach is based on the assumption that the spatial arrangement of the land cover components for mixed pixel patches with similar fractions is often similar. The proposed SRM algorithm produces a learning database that includes a large number of patch pairs for which there is a fine and coarse spatial resolution representation for the same area. From the learning database, patch pairs that have similar coarse spatial resolution patches as those in input fraction images are selected. Fine spatial resolution patches in these selected patch pairs are then used to estimate the latent fine spatial resolution land cover map, by solving an optimization problem. The approach is illustrated by comparison against state-of-the-art SRM methods using land cover map subsets generated from the USA’s National Land Cover Database. Results show that the proposed SRM algorithm better maintains the spatial pattern of land covers for a range of different landscapes. The proposed SRM algorithm has the highest overall accuracy and Kappa values in all these SRM algorithms, by using the entire maps in the accuracy assessment

Valuing map validation: the need for rigorous land cover map accuracy assessment in economic valuations of ecosystem services

Valuations of ecosystem services often use data on land cover class areal extent. Area estimates from land cover maps may be biased by misclassification error resulting in flawed assessments and inaccurate valuations. Adjustment for misclassification error is possible for maps subjected to a rigorous validation program including an accuracy assessment. Unfortunately, validation is rare and/or poorly undertaken as often not regarded as a high priority. The benefit of map validation and hence its value is indicated with two maps. The International Geosphere Biosphere Programme’s DISCover map was used to estimate wetland value globally. The latter changed from US$1.92 trillion yr-1 to US$2.79 trillion yr-1 when adjusted for misclassification bias. For the conterminous USA, ecosystem services value based on six land cover classes from the National Land Cover Database (2006) changed from US$1118 billion yr-1 to US$600 billion yr-1 after adjustment for misclassification bias. The effect of error-adjustment on the valuations indicates the value of map validation to rigorous evidence-based science and policy work in relation to aspects of natural capital. The benefit arising from validation was orders of magnitude larger than mapping costs and it is argued that validation should be a high priority in mapping programs and inform valuations

Foreword to the special issue on pattern recognition in remote sensing

[No abstract available

The effect of the point spread function on sub-pixel mapping

Abstract Sub-pixel mapping (SPM) is a process for predicting spatially the land cover classes within mixed pixels. In existing SPM methods, the effect of point spread function (PSF) has seldom been considered. In this paper, a generic SPM method is developed to consider the PSF effect in SPM and, thereby, to increase prediction accuracy. We first demonstrate that the spectral unmixing predictions (i.e., coarse land cover proportions used as input for SPM) are a convolution of not only sub-pixels within the coarse pixel, but also sub-pixels from neighboring coarse pixels. Based on this finding, a new SPM method based on optimization is developed which recognizes the optimal solution as the one that when convolved with the PSF, is the same as the input coarse land cover proportion. Experimental results on three separate datasets show that the SPM accuracy can be increased by considering the PSF effect