25 research outputs found
Image Restoration for Remote Sensing: Overview and Toolbox
Remote sensing provides valuable information about objects or areas from a
distance in either active (e.g., RADAR and LiDAR) or passive (e.g.,
multispectral and hyperspectral) modes. The quality of data acquired by
remotely sensed imaging sensors (both active and passive) is often degraded by
a variety of noise types and artifacts. Image restoration, which is a vibrant
field of research in the remote sensing community, is the task of recovering
the true unknown image from the degraded observed image. Each imaging sensor
induces unique noise types and artifacts into the observed image. This fact has
led to the expansion of restoration techniques in different paths according to
each sensor type. This review paper brings together the advances of image
restoration techniques with particular focuses on synthetic aperture radar and
hyperspectral images as the most active sub-fields of image restoration in the
remote sensing community. We, therefore, provide a comprehensive,
discipline-specific starting point for researchers at different levels (i.e.,
students, researchers, and senior researchers) willing to investigate the
vibrant topic of data restoration by supplying sufficient detail and
references. Additionally, this review paper accompanies a toolbox to provide a
platform to encourage interested students and researchers in the field to
further explore the restoration techniques and fast-forward the community. The
toolboxes are provided in https://github.com/ImageRestorationToolbox.Comment: This paper is under review in GRS
Column-Spatial Correction Network for Remote Sensing Image Destriping
The stripe noise in the multispectral remote sensing images, possibly resulting from the instrument instability, slit contamination, and light interference, significantly degrades the imaging quality and impairs high-level visual tasks. The local consistency of homogeneous region in striped images is damaged because of the different gains and offsets of adjacent sensors regarding the same ground object, which leads to the structural characteristics of stripe noise. This can be characterized by the increased differences between columns in the remote sensing image. Therefore, the destriping can be viewed as a process of improving the local consistency of homogeneous region and the global uniformity of whole image. In recent years, convolutional neural network (CNN)-based models have been introduced to destriping tasks, and have achieved advanced results, relying on their powerful representation ability. Therefore, to effectively leverage both CNNs and the structural characteristics of stripe noise, we propose a multi-scaled column-spatial correction network (CSCNet) for remote sensing image destriping, in which the local structural characteristic of stripe noise and the global contextual information of the image are both explored at multiple feature scales. More specifically, the column-based correction module (CCM) and spatial-based correction module (SCM) were designed to improve the local consistency and global uniformity from the perspectives of column correction and full image correction, respectively. Moreover, a feature fusion module based on the channel attention mechanism was created to obtain discriminative features derived from different modules and scales. We compared the proposed model against both traditional and deep learning methods on simulated and real remote sensing images. The promising results indicate that CSCNet effectively removes image stripes and outperforms state-of-the-art methods in terms of qualitative and quantitative assessments
Hyperspectral Image Restoration via Total Variation Regularized Low-rank Tensor Decomposition
Hyperspectral images (HSIs) are often corrupted by a mixture of several types
of noise during the acquisition process, e.g., Gaussian noise, impulse noise,
dead lines, stripes, and many others. Such complex noise could degrade the
quality of the acquired HSIs, limiting the precision of the subsequent
processing. In this paper, we present a novel tensor-based HSI restoration
approach by fully identifying the intrinsic structures of the clean HSI part
and the mixed noise part respectively. Specifically, for the clean HSI part, we
use tensor Tucker decomposition to describe the global correlation among all
bands, and an anisotropic spatial-spectral total variation (SSTV)
regularization to characterize the piecewise smooth structure in both spatial
and spectral domains. For the mixed noise part, we adopt the norm
regularization to detect the sparse noise, including stripes, impulse noise,
and dead pixels. Despite that TV regulariztion has the ability of removing
Gaussian noise, the Frobenius norm term is further used to model heavy Gaussian
noise for some real-world scenarios. Then, we develop an efficient algorithm
for solving the resulting optimization problem by using the augmented Lagrange
multiplier (ALM) method. Finally, extensive experiments on simulated and
real-world noise HSIs are carried out to demonstrate the superiority of the
proposed method over the existing state-of-the-art ones.Comment: 15 pages, 20 figure
Adaptive Regularized Low-Rank Tensor Decomposition for Hyperspectral Image Denoising and Destriping
Hyperspectral images (HSIs) are inevitably degraded by a mixture of various
types of noise, such as Gaussian noise, impulse noise, stripe noise, and dead
pixels, which greatly limits the subsequent applications. Although various
denoising methods have already been developed, accurately recovering the
spatial-spectral structure of HSIs remains a challenging problem to be
addressed. Furthermore, serious stripe noise, which is common in real HSIs, is
still not fully separated by the previous models. In this paper, we propose an
adaptive hyperLaplacian regularized low-rank tensor decomposition (LRTDAHL)
method for HSI denoising and destriping. On the one hand, the stripe noise is
separately modeled by the tensor decomposition, which can effectively encode
the spatial-spectral correlation of the stripe noise. On the other hand,
adaptive hyper-Laplacian spatial-spectral regularization is introduced to
represent the distribution structure of different HSI gradient data by
adaptively estimating the optimal hyper-Laplacian parameter, which can reduce
the spatial information loss and over-smoothing caused by the previous total
variation regularization. The proposed model is solved using the alternating
direction method of multipliers (ADMM) algorithm. Extensive simulation and
real-data experiments all demonstrate the effectiveness and superiority of the
proposed method
A General Destriping Framework for Remote Sensing Images Using Flatness Constraint
This paper proposes a general destriping framework using flatness
constraints, where we can handle various regularization functions in a unified
manner. Removing stripe noise, i.e., destriping, from remote sensing images is
an essential task in terms of visual quality and subsequent processing. Most of
the existing methods are designed by combining a particular image
regularization with a stripe noise characterization that cooperates with the
regularization, which precludes us to examine different regularizations to
adapt to various target images. To resolve this, we formulate the destriping
problem as a convex optimization problem involving a general form of image
regularization and the flatness constraints, a newly introduced stripe noise
characterization. This strong characterization enables us to consistently
capture the nature of stripe noise, regardless of the choice of image
regularization. For solving the optimization problem, we also develop an
efficient algorithm based on a diagonally preconditioned primal-dual splitting
algorithm (DP-PDS), which can automatically adjust the stepsizes. The
effectiveness of our framework is demonstrated through destriping experiments,
where we comprehensively compare combinations of image regularizations and
stripe noise characterizations using hyperspectral images (HSI) and infrared
(IR) videos.Comment: submitted to IEEE Transactions on Geoscience and Remote Sensin