Enhancing the spatial resolution of satellite-derived land surface temperature mapping for urban areas

Land surface temperature (LST) is an important environmental variable for urban studies such as those focused on the urban heat island (UHI). Though satellite-derived LST could be a useful complement to traditional LST data sources, the spatial resolution of the thermal sensors limits the utility of remotely sensed thermal data. Here, a thermal sharpening technique is proposed which could enhance the spatial resolution of satellite-derived LST based on super-resolution mapping (SRM) and super-resolution reconstruction (SRR). This method overcomes the limitation of traditional thermal image sharpeners that require fine spatial resolution images for resolution enhancement. Furthermore, environmental studies such as UHI modelling typically use statistical methods which require the input variables to be independent, which means the input LST and other indices should be uncorrelated. The proposed Super-Resolution Thermal Sharpener (SRTS) does not rely on any surface index, ensuring the independence of the derived LST to be as independent as possible from the other variables that UHI modelling often requires. To validate the SRTS, its performance is compared against that of four popular thermal sharpeners: the thermal sharpening algorithm (TsHARP), adjusted stratified stepwise regression method (Stepwise), pixel block intensity modulation (PBIM), and emissivity modulation (EM). The privilege of using the combination of SRR and SRM was also verified by comparing the accuracy of SRTS with sharpening process only based on SRM or SRR. The results show that the SRTS can enhance the spatial resolution of LST with a magnitude of accuracy that is equal or even superior to other thermal sharpeners, even without requiring fine spatial resolution input. This shows the potential of SRTS for application in conditions where only limited meteorological data sources are available yet where fine spatial resolution LST is desirable

Computational enhancement of large scale environmental imagery: aggregation of robust numerical regularization, neural computing and digital dynamic filtering

We address a new efficient robust optimisation approach to large-scale environmental image reconstruction/enhancement as required for remote sensing imaging with multi-spectral array sensors/SAR. First, the problem-oriented robustification of the previously proposed Fused Bayesian-Regularization (FBR) enhanced imaging method is performed to alleviate its ill-poseness due to system-level and model-model uncertainties. Second, the modification of the Hopfield-type Maximum Entropy Neural Network (MENN) is proposed that enables such MENN to perform numerically the robustified FBR technique via computationally efficient iterative scheme. The efficiency of the aggregated robust regularised MENN technique is verified through simulation studies of enhancement of the real-world environmental images.CINVESTA

Graph-based Data Modeling and Analysis for Data Fusion in Remote Sensing

Hyperspectral imaging provides the capability of increased sensitivity and discrimination over traditional imaging methods by combining standard digital imaging with spectroscopic methods. For each individual pixel in a hyperspectral image (HSI), a continuous spectrum is sampled as the spectral reflectance/radiance signature to facilitate identification of ground cover and surface material. The abundant spectrum knowledge allows all available information from the data to be mined. The superior qualities within hyperspectral imaging allow wide applications such as mineral exploration, agriculture monitoring, and ecological surveillance, etc. The processing of massive high-dimensional HSI datasets is a challenge since many data processing techniques have a computational complexity that grows exponentially with the dimension. Besides, a HSI dataset may contain a limited number of degrees of freedom due to the high correlations between data points and among the spectra. On the other hand, merely taking advantage of the sampled spectrum of individual HSI data point may produce inaccurate results due to the mixed nature of raw HSI data, such as mixed pixels, optical interferences and etc. Fusion strategies are widely adopted in data processing to achieve better performance, especially in the field of classification and clustering. There are mainly three types of fusion strategies, namely low-level data fusion, intermediate-level feature fusion, and high-level decision fusion. Low-level data fusion combines multi-source data that is expected to be complementary or cooperative. Intermediate-level feature fusion aims at selection and combination of features to remove redundant information. Decision level fusion exploits a set of classifiers to provide more accurate results. The fusion strategies have wide applications including HSI data processing. With the fast development of multiple remote sensing modalities, e.g. Very High Resolution (VHR) optical sensors, LiDAR, etc., fusion of multi-source data can in principal produce more detailed information than each single source. On the other hand, besides the abundant spectral information contained in HSI data, features such as texture and shape may be employed to represent data points from a spatial perspective. Furthermore, feature fusion also includes the strategy of removing redundant and noisy features in the dataset. One of the major problems in machine learning and pattern recognition is to develop appropriate representations for complex nonlinear data. In HSI processing, a particular data point is usually described as a vector with coordinates corresponding to the intensities measured in the spectral bands. This vector representation permits the application of linear and nonlinear transformations with linear algebra to find an alternative representation of the data. More generally, HSI is multi-dimensional in nature and the vector representation may lose the contextual correlations. Tensor representation provides a more sophisticated modeling technique and a higher-order generalization to linear subspace analysis. In graph theory, data points can be generalized as nodes with connectivities measured from the proximity of a local neighborhood. The graph-based framework efficiently characterizes the relationships among the data and allows for convenient mathematical manipulation in many applications, such as data clustering, feature extraction, feature selection and data alignment. In this thesis, graph-based approaches applied in the field of multi-source feature and data fusion in remote sensing area are explored. We will mainly investigate the fusion of spatial, spectral and LiDAR information with linear and multilinear algebra under graph-based framework for data clustering and classification problems

Super Resolution of Remote Sensing Images Using Edge-Directed Radial Basis Functions

Edge-Directed Radial Basis Functions (EDRBF) are used to compute super resolution(SR) image from a given set of low resolution (LR) images differing in subpixel shifts. The algorithm is tested on remote sensing images and compared for accuracy with other well-known algorithms such as Iterative Back Projection (IBP), Maximum Likelihood (ML) algorithm, interpolation of scattered points using Nearest Neighbor (NN) and Inversed Distance Weighted (IDW) interpolation, and Radial Basis Functin(RBF) . The accuracy of SR depends on various factors besides the algorithm (i) number of subpixel shifted LR images (ii) accuracy with which the LR shifts are estimated by registration algorithms (iii) and the targeted spatial resolution of SR. In our studies, the accuracy of EDRBF is compared with other algorithms keeping these factors constant. The algorithm has two steps: i) registration of low resolution images and (ii) estimating the pixels in High Resolution (HR) grid using EDRBF. Experiments are conducted by simulating LR images from a input HR image with different sub-pixel shifts. The reconstructed SR image is compared with input HR image to measure the accuracy of the algorithm using sum of squared errors (SSE). The algorithm has outperformed all of the algorithms mentioned above. The algorithm is robust and is not overly sensitive to the registration inaccuracies

Remote Sensing Imagery and Signature Fields Reconstruction via Aggregation of Robust Regularization With Neural Computing

The robust numerical technique for high-resolution reconstructive imaging and scene analysis is developed as required for enhanced remote sensing with large scale sensor array radar/synthetic aperture radar. First, the problem-oriented modification of the previously proposed fused Bayesian- regularization (FBR) enhanced radar imaging method is performed to enable it to reconstruct remote sensing signatures (RSS) of interest alleviating problem ill-poseness due to system-level and model-level uncertainties. Second, the modification of the Hopfield-type maximum entropy neural network (NN) is proposed that enables such NN to perform numerically the robust adaptive FBR technique via efficient NN computing. Finally, we report some simulation results of hydrological RSS reconstruction from enhanced real-world environmental images indicative of the efficiency of the devel- oped method.Cinvesta

Dynamical Analysis of Hydrological Indexes Extracted from Remote Sensing Imagery: An Introductory Study

A new intelligent computational paradigm based on filtering techniques modified to enhance the quality of reconstruction of the physical characteristics of environmental electronic maps extracted from the large scale remote sensing imagery is proposed. First, the problem-oriented modification of the previously proposed fused Bayesian-regularization enhanced radar imaging method is performed to enable it to reconstruct remote sensing signatures of interest. Second, the extraction of the so-called hydrological electronic maps and the analysis of its dynamics are proposed. Finally, simulation results of hydrological remote sensing signatures reconstruction from enhanced real-world environmental images are reported to verify the efficiency of the proposed approach.CINVESTA

A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin