Spatio-temporal resolution enhancement for cloudy thermal sequences

Many applications require remotely sensed brightness temperature (BT) data acquired with high temporal and spatial resolutions. In this regard, a viable strategy to overtake the physical limitations of space-borne sensors to achieve these data relies on fusing low temporal but high spatial resolution (HSR) data with high temporal but low spatial resolution data. The most promising methods rely on the fusion of spatially interpolated high temporal resolution data with temporally interpolated HSR data. However, the unavoidable presence of cloud masses in the acquired image sequences is often neglected, compromising the functionality and/or the effectiveness of the most of these fusion algorithms. To overcome this problem, a framework combining techniques of temporal smoothing and spatial enhancement is proposed to estimate surface BTs with high spatial and high temporal resolutions even when cloud masses corrupt the scene. Numerical results using real thermal data acquired by the SEVIRI sensor show the ability of the proposed approach to reach better performance than techniques based on either only interpolation or only spatial sharpening, even dealing with missing data due to the presence of cloud masses

DESHADOWING OF HIGH SPATIAL RESOLUTION IMAGERY APPLIED TO URBAN AREA DETECTION

Different built-up structures usually lead to large regions covered by shadows, causing partial or total loss of information present in urban environments. In order to mitigate the presence of shadows while improving the urban target discrimination in multispectral images, this paper proposes an automated methodology for both detection and recovery of shadows. First, the image bands are preprocessed in order to highlight their most relevant parts. Secondly, a shadow detection procedure is performed by using morphological filtering so that a shadow mask is obtained. Finally, the reconstruction of shadow-occluded areas is accomplished by an image inpainting strategy. The experimental evaluation of our methodology was carried out in four study areas acquired from a WorldView-2 (WV-2) satellite scene over the urban area of São Paulo city. The experiments have demonstrated a high performance of the proposed shadow detection scheme, with an average overall accuracy up to 92%. Considering the results obtained by our shadow removal strategy, the pre-selected shadows were substantially recovered, as verified by visual inspections. Comparisons involving both VrNIR-BI and VgNIR-BI spectral indices computed from original and shadow-free images also attest the substantial gain in recovering anthropic targets such as streets, roofs and buildings initially damaged by shadows

Panchromatic and multispectral image fusion for remote sensing and earth observation: Concepts, taxonomy, literature review, evaluation methodologies and challenges ahead

Panchromatic and multispectral image fusion, termed pan-sharpening, is to merge the spatial and spectral information of the source images into a fused one, which has a higher spatial and spectral resolution and is more reliable for downstream tasks compared with any of the source images. It has been widely applied to image interpretation and pre-processing of various applications. A large number of methods have been proposed to achieve better fusion results by considering the spatial and spectral relationships among panchromatic and multispectral images. In recent years, the fast development of artificial intelligence (AI) and deep learning (DL) has significantly enhanced the development of pan-sharpening techniques. However, this field lacks a comprehensive overview of recent advances boosted by the rise of AI and DL. This paper provides a comprehensive review of a variety of pan-sharpening methods that adopt four different paradigms, i.e., component substitution, multiresolution analysis, degradation model, and deep neural networks. As an important aspect of pan-sharpening, the evaluation of the fused image is also outlined to present various assessment methods in terms of reduced-resolution and full-resolution quality measurement. Then, we conclude this paper by discussing the existing limitations, difficulties, and challenges of pan-sharpening techniques, datasets, and quality assessment. In addition, the survey summarizes the development trends in these areas, which provide useful methodological practices for researchers and professionals. Finally, the developments in pan-sharpening are summarized in the conclusion part. The aim of the survey is to serve as a referential starting point for newcomers and a common point of agreement around the research directions to be followed in this exciting area

The effect of the point spread function on downscaling continua

The point spread function (PSF) is ubiquitous in remote sensing. This paper investigated the effect of the PSF on the downscaling of continua. Geostatistical approaches were adopted to incorporate explicitly, and reduce the influence of, the PSF effect in downscaling. Two general cases were considered: univariate and multivariate. In the univariate case, the input coarse spatial resolution image is the only image available for downscaling. Area-to-point kriging was demonstrated to be a suitable solution in this case. For the multivariate case, a finer spatial resolution image (or images) observed under different conditions (e.g., at a different wavelength) is available as auxiliary data for downscaling. Area-to-point regression kriging was shown to be a suitable solution for this case. Moreover, a new solution was developed for estimating the PSF in image scale transformation. The experiments show that the PSF effect influences downscaling greatly and that downscaling can be enhanced obviously by considering the PSF effect through the geostatistical approaches and the PSF estimation solution proposed

Panchromatic and multispectral image fusion for remote sensing and earth observation: Concepts, taxonomy, literature review, evaluation methodologies and challenges ahead

Panchromatic and multispectral image fusion, termed pan-sharpening, is to merge the spatial and spectral information of the source images into a fused one, which has a higher spatial and spectral resolution and is more reliable for downstream tasks compared with any of the source images. It has been widely applied to image interpretation and pre-processing of various applications. A large number of methods have been proposed to achieve better fusion results by considering the spatial and spectral relationships among panchromatic and multispectral images. In recent years, the fast development of artificial intelligence (AI) and deep learning (DL) has significantly enhanced the development of pan-sharpening techniques. However, this field lacks a comprehensive overview of recent advances boosted by the rise of AI and DL. This paper provides a comprehensive review of a variety of pan-sharpening methods that adopt four different paradigms, i.e., component substitution, multiresolution analysis, degradation model, and deep neural networks. As an important aspect of pan-sharpening, the evaluation of the fused image is also outlined to present various assessment methods in terms of reduced-resolution and full-resolution quality measurement. Then, we conclude this paper by discussing the existing limitations, difficulties, and challenges of pan-sharpening techniques, datasets, and quality assessment. In addition, the survey summarizes the development trends in these areas, which provide useful methodological practices for researchers and professionals. Finally, the developments in pan-sharpening are summarized in the conclusion part. The aim of the survey is to serve as a referential starting point for newcomers and a common point of agreement around the research directions to be followed in this exciting area

Monitoring inland surface water level from Sentinel-3 data

Inland surface water bodies (e.g. lakes and rivers) are very important to the nature and human society. To monitor the water level of inland water bodies, gauge stations were built since 19th century, but the amount of the stations is declining since the 1970s because of lack of maintenance. An accurate and continuous monitoring of lakes and rivers is available because of the satellite altimetry missions launched, e.g. Jason-2 and ENVISAT. These satellites can provide water level with proper spatial and temporal resolution. In the recent past, researchers have used different satellite mission observations to generate time series of inland water level in order for monitoring the water bodies. In this thesis, we use the new designed satellite mission Sentinel-3, which carries different sensors, to generate the water level time series of Dongting Lake and Poyang Lake in China. Initially, we combine the altimetry measurements with satellite images to determine virtual station. We choose Sentinel-3 Ku band data and on-board Ocean tracker to generate the water level time series. Afterwards, we apply different waveform retracking algorithms (5β-parameter and OCOG) to compare the results with on-board tracker. We also validate the results with the other database, then investigate the waveforms of each sampling date. The comparisons show the three tracking methods we used are capable to Quasi-Specular waveforms, and OCOG shows the best result to flat patch waveforms. Furthermore, some suggestions for improvements are also discussed in the last chapter

Spectral Temporal Information for Missing Data Reconstruction (STIMDR) of Landsat Reflectance Time Series

The number of Landsat time-series applications has grown substantially because of its approximately 50-year history and relatively high spatial resolution for observing long term changes in the Earth’s surface. However, missing observations (i.e., gaps) caused by clouds and cloud shadows, orbit and sensing geometry, and sensor issues have broadly limited the development of Landsat time-series applications. Due to the large area and temporal and spatial irregularity of time-series gaps, it is difficult to find an efficient and highly precise method to fill them. The Missing Observation Prediction based on Spectral-Temporal Metrics (MOPSTM) method has been proposed and delivered good performance in filling large-area gaps of single-date Landsat images. However, it can be less practical for a time series longer than one year due to the lack of mechanics that exclude dissimilar data in time series (e.g., different phenology or changes in land cover). To solve this problem, this study proposes a new gap-filling method, Spectral Temporal Information for Missing Data Reconstruction (STIMDR), and examines its performance in Landsat reflectance time series. Two groups of experiments, including 2000 × 2000 pixel Landsat single-date images and Landsat time series acquired from four sites (Kenya, Finland, Germany, and China), were performed to test the new method. We simulated artificial gaps to evaluate predicted pixel values with real observations. Quantitative and qualitative evaluations of gap-filled images through comparisons with other state-of-the-art methods confirmed the more robust and accurate performance of the proposed method. In addition, the proposed method was also able to fill gaps contaminated by extreme cloud cover for a period (e.g., winter in high-latitude areas). A down-stream task of random forest supervised classification through both gap-filled simulated datasets and the original valid datasets verified that STIMDR-generated products are relevant to the user community for land cover applications

Permanent disappearance and seasonal fluctuation of urban lake area in Wuhan, China monitored with long time series remotely sensed images from 1987 to 2016

Lakes are important to the healthy functioning of the urban ecosystem. The urban lakes in Wuhan, China, which is known as ‘city of hundreds of lakes’, are facing substantial threats mainly due to rapid urbanization. This paper focused on detecting the spatial and temporal change of urban lakes in Wuhan, using a long time series of Landsat and HJ-1A remotely sensed data from 1987 to 2016. The permanent disappearance and seasonal fluctuation of 28 main urban lakes were analysed, and their relationships with climatic change and human activities were discussed. The results show that most lakes in Wuhan had shrunk over the past 30 years resulting in a permanent change from water to land. The shrinkage was also most apparent in the central region of the city. Seasonal fluctuations of lake area were evident for most lakes but the relative important driving variable of lake area change varied between sub-periods of time for different lakes. The explanatory power of impervious surface to five-year permanent water change is 91.75%, suggesting that urbanization – as increasing impervious surface – had led to the shrinkage of urban lakes in Wuhan. In all, 128.28 km2 five-year permanent water disappeared from 1987 to 2016