Column-Spatial Correction Network for Remote Sensing Image Destriping

The stripe noise in the multispectral remote sensing images, possibly resulting from the instrument instability, slit contamination, and light interference, significantly degrades the imaging quality and impairs high-level visual tasks. The local consistency of homogeneous region in striped images is damaged because of the different gains and offsets of adjacent sensors regarding the same ground object, which leads to the structural characteristics of stripe noise. This can be characterized by the increased differences between columns in the remote sensing image. Therefore, the destriping can be viewed as a process of improving the local consistency of homogeneous region and the global uniformity of whole image. In recent years, convolutional neural network (CNN)-based models have been introduced to destriping tasks, and have achieved advanced results, relying on their powerful representation ability. Therefore, to effectively leverage both CNNs and the structural characteristics of stripe noise, we propose a multi-scaled column-spatial correction network (CSCNet) for remote sensing image destriping, in which the local structural characteristic of stripe noise and the global contextual information of the image are both explored at multiple feature scales. More specifically, the column-based correction module (CCM) and spatial-based correction module (SCM) were designed to improve the local consistency and global uniformity from the perspectives of column correction and full image correction, respectively. Moreover, a feature fusion module based on the channel attention mechanism was created to obtain discriminative features derived from different modules and scales. We compared the proposed model against both traditional and deep learning methods on simulated and real remote sensing images. The promising results indicate that CSCNet effectively removes image stripes and outperforms state-of-the-art methods in terms of qualitative and quantitative assessments

Image Restoration for Remote Sensing: Overview and Toolbox

Remote sensing provides valuable information about objects or areas from a distance in either active (e.g., RADAR and LiDAR) or passive (e.g., multispectral and hyperspectral) modes. The quality of data acquired by remotely sensed imaging sensors (both active and passive) is often degraded by a variety of noise types and artifacts. Image restoration, which is a vibrant field of research in the remote sensing community, is the task of recovering the true unknown image from the degraded observed image. Each imaging sensor induces unique noise types and artifacts into the observed image. This fact has led to the expansion of restoration techniques in different paths according to each sensor type. This review paper brings together the advances of image restoration techniques with particular focuses on synthetic aperture radar and hyperspectral images as the most active sub-fields of image restoration in the remote sensing community. We, therefore, provide a comprehensive, discipline-specific starting point for researchers at different levels (i.e., students, researchers, and senior researchers) willing to investigate the vibrant topic of data restoration by supplying sufficient detail and references. Additionally, this review paper accompanies a toolbox to provide a platform to encourage interested students and researchers in the field to further explore the restoration techniques and fast-forward the community. The toolboxes are provided in https://github.com/ImageRestorationToolbox.Comment: This paper is under review in GRS

Remote Sensing

This dual conception of remote sensing brought us to the idea of preparing two different books; in addition to the first book which displays recent advances in remote sensing applications, this book is devoted to new techniques for data processing, sensors and platforms. We do not intend this book to cover all aspects of remote sensing techniques and platforms, since it would be an impossible task for a single volume. Instead, we have collected a number of high-quality, original and representative contributions in those areas

EVALUATION OF A REMOTE SENSING BASED METHOD FOR THE ASSESSMENT OF AGRICULTURAL CROP RESIDUES ON THE SOIL SURFACE

Increased agricultural mechanization in the recent past and susceptibility of certain soils to degradation generate widespread concern among experts on the overall environmental sustainability of some of the current agricultural practices in Europe. A number of solutions could be adopted to better preserve soil resources, some of which are already supported by the Common Agricultural Policy (CAP). Researchers demonstrated that erosion and reduction in soil organic matter are among the most acute degradation issues in Europe and that the release of crop residues on the soil surface after harvesting can greatly reduce their incidence. The use of a permanent soil cover (e.g. by use of crop residues) is one of the three fundamental principles of Conservation Agriculture. Quantifying the amount of crop residues on the ground is important for soil and water protection, modelling of erosion processes and legislation enforcement purposes. However, common monitoring methods based on ground sampling are expensive and likely to be impracticable on vast surfaces. Remote sensing can offer a valid alternative for monitoring. The present research intends to contribute to the efforts towards the establishments of methods for the assessment and monitoring, through remote sensing, of the effects of conservation agriculture practices on the environment, with focus on soil resources. In this respect, the research specific objective is the evaluation of a remote sensing based method for the quantification of crop residue cover in a conservation agriculture farm in Northern Italy by use of hyperspectral satellite imagery. Results achieved show that not only crop residues percent cover is linearly related to certain remote sensing-based indices, therefore making possible to estimate how well soil is preserved from weathering, but also that spaceborne hyperspectral sensors such as Hyperion appear to have great potentiality towards monitoring of other environmental targets due to their very high spectral and spatial resolution. The research was deeply inspired by the outcomes of a European project (\u201cSustainable Agriculture and Soil Conservation through simplified cultivation techniques\u201d - SoCo) aimed at improving protection of soil resources in the European agriculture sector through a stock taking and promotion of soil-friendly agriculture practices and systems, in particular simplified cultivation techniques, within the current legislative framework

Review on Active and Passive Remote Sensing Techniques for Road Extraction

Digital maps of road networks are a vital part of digital cities and intelligent transportation. In this paper, we provide a comprehensive review on road extraction based on various remote sensing data sources, including high-resolution images, hyperspectral images, synthetic aperture radar images, and light detection and ranging. This review is divided into three parts. Part 1 provides an overview of the existing data acquisition techniques for road extraction, including data acquisition methods, typical sensors, application status, and prospects. Part 2 underlines the main road extraction methods based on four data sources. In this section, road extraction methods based on different data sources are described and analysed in detail. Part 3 presents the combined application of multisource data for road extraction. Evidently, different data acquisition techniques have unique advantages, and the combination of multiple sources can improve the accuracy of road extraction. The main aim of this review is to provide a comprehensive reference for research on existing road extraction technologies.Peer reviewe

A comprehensive approach for the efficient acquisition and processing of hyperspectral images and sequence

Programa Oficial de Doctorado en Computación. 5009P01[Abstract] Despite the scientific and technological developments achieved during the last two decades in the hyperspectral field, some methodological, operational and conceptual issues have restricted the progress, promotion and popular dissemination of this technology. These shortcomings include the specialized knowledge required for the acquisition of hyperspectral images, the shortage of publicly accessible hyperspectral image repositories with reliable ground truth images or the lack of methodologies that allow for the adaptation of algorithms to particular user or application processing needs. The work presented here has the objective of contributing to the hyperspectral field with procedures for the automatic acquisition of hyperspectral scenes, including the hardware adaptation of our own imagers and the development of methods for the calibration and correction of the hyperspectral datacubes, the creation of a publicly available hyperspectral repository of well categorized and labeled images and the design and implementation of novel computational intelligence based processing techniques that solve typical issues related to the segmentation and denoising of hyperspectral images as well as sequences of them taking into account their temporal evolution.[Resumen] A pesar de los desarrollos tecnológicos y científicos logrados en el campo hiperespectral durante las dos últimas décadas, alg\mas limitaciones de tipo metodológico, operacional y conceptual han restringido el progreso, difusión y popularización de esta tecnología, entre ellas, el conocimiento especializado requerido en la adquisición de imágenes hiperespectrales, la carencia de repositorios de imágenes hiperespectrales con etiquetados fiables y de acceso público o la falta de metodologías que posibiliten la adaptación de algoritmos a usuarios o necesidades de procesamiento concretas. Este trabajo doctoral tiene el objetivo de contribuir al campo hiperespectral con procedimientos para la adquisición automática de escenas hiperespectrales, incluyendo la adaptación hardware de cámaras hiperespectrales propias y el desarrollo de métodos para la calibración y corrección de cubos de datos hiperespectrales; la creación de un repositorio hiperespectral de acceso público con imágenes categorizadas y con verdades de terreno fiables; y el diseño e implementación de técnicas de procesamiento basadas en inteligencia computacional para la resolución de problemas típicamente relacionados con las tareas de segmentación y eliminación de ruido en imágenes estáticas y secuencias de imágenes hiperespectrales teniendo en consideración su evolución temporal.[Resumo] A pesar dos desenvolvementos tecnolóxicos e científicos logrados no campo hiperespectral durante as dúas últimas décadas, algunhas lirrútacións de tipo metodolóxico¡ operacional e conceptual restrinxiron o progreso) difusión e popularización desta tecnoloxía, entre elas, o coñecemento especializado requirido na adquisición de imaxes hiperespectrales¡ a carencia de repositorios de irnaxes hiperespectrales con etiquetaxes fiables e de acceso público ou a falta de metodoloxías que posibiliten a adaptación de algoritmos a usuarios ou necesidades de procesamento concretas. Este traballo doutoral ten o obxectívo de contribuir ao campo hiperespectral con procedementos para a adquisición automática de eicenas hiperespectrais, incluíndo a adaptación hardware de cámaras hiperespectrales propias e o desenvolvemento de métodos para a calibración e corrección de cubos de datos hiperespectrais; a creación dun repositorio hiperespectral de acceso público con imaxes categorizadas e con verdades de terreo fiables; e o deseño e implementación de técnicas de procesamento baseadas en intelixencia computacional para a resolución de problemas tipicamente relacionado~ coas tarefas de segmentación e eliminación de ruído en imaxes estáticas e secuencias de imaxes hiperespectrai~ tendo en consideración a súa evolución temporal

Development of Research Infrastructure in Nevada for the Exploitation of Hyperspectral Image Data to Address Proliferation and Detection of Chemical and Biological Materials.

This research was to exploit hyperspectral reflectance imaging technology for the detection and mapping variability (clutter) of the natural background against which gases in the atmosphere are imaged. The natural background consists of landscape surface cover composed of consolidated rocks, unconsolidated rock weathering products, soils, coatings on rock materials, vegetation, water, materials constructed by humans, and mixtures of the above. Human made gases in the atmosphere may indicate industrial processes important to detecting non-nuclear chemical and biological proliferation. Our research was to exploit the Visible and Near-Infrared (NIR) and the Short-wave Infrared (SWIR) portions of the electromagnetic spectrum to determine the properties of solid materials on the earth’s surface that could influence the detection of gases in the Long-Wave Infrared (LWIR). We used some new experimental hyperspectral imaging technologies to collect data over the Non-Proliferation Test and Evaluation Center (NPTEC) located on the Nevada Test Site (NTS). The SpecTIR HyperSpecTIR (HST) and Specim Dual hyperspectral sensors were used to understand the variability in the imaged background (clutter), that detected, measured, identified and mapped with operational commercial hyperspectral techniques. The HST sensors were determined to be more experimental than operational because of problems with radiometric and atmospheric data correction. However the SpecTIR Dual system, developed by Specim in Finland, eventually was found to provide cost-effective hyperspectral image data collection and it was possible to correct the Dual system’s data for specific areas. Batch processing of long flightlines was still complex, and if comparison to laboratory spectra was desired, the Dual system data still had to be processed using the empirical line method. This research determined that 5-meter spatial resolution was adequate for mapping natural background variations. Furthermore, this research determined that spectral resolution of 10um was adequate, but a signal to noise above 300:1 was desirable for hyperspectral sensors with this spectral resolution. Finally, we acquired a hyperspectral thermal dataset (SEBASS) at 3m spatial resolution over our study area in Beatty, Nevada that can be co-registered with the hyperspectral reflectance, LIDAR and digital Orthophoto data sets. This data set will enable us to quantify how measurements in the reflected infrared can be used to make inferences about the response of materials in the thermal infrared, the topic of our follow-on NA-22 investigation ending in 2008. These data provide the basis for our investigations proposed for the NA-22 2008 Broad Area Announcement. Beginning in June 2008, SpecTIR Corporation and Aerospace Corporation plan to fly the SpecTIR Dual and SEBASS in a stabilized mount in a twin Otter aircraft. This research provides the foundation for using reflected and emitted hyperspectral measurements together for mapping geologic and soil materials in arid to semi-arid regions

Earth Observation: Data, Processing and Applications. Volume 2C: Processing — Image Transformations

[Edited by] Harrison, B.A., Jupp, D.L.B., Lewis, M.M., Sparks, T., Mueller, N., Byrne,

An Integrated physics-based approach to demonstrate the potential of the Landsat Data Continuity Mission (LDCM) for monitoring coastal/inland waters

Monitoring coastal or inland waters, recognized as case II waters, using the existing Landsat technology is somewhat restricted because of its low Signal-to-Noise ratio (SNR) as well as its relatively poor radiometric resolution. As a primary task, we introduce a novel technique, which integrates the Landsat-7 data as a surrogate for LDCM with a 3D hydrodynamic model to monitor the dynamics of coastal waters near river discharges as well as in a small lake environment. The proposed approach leverages both the thermal and the reflective Landsat-7 imagery to calibrate the model and to retrieve the concentrations of optically active components of the water. To do so, the model is first calibrated by optimizing its thermal outputs with the surface temperature maps derived from the Landsat-7 data. The constituent retrieval is conducted in the second phase where multiple simulated concentration maps are provided to an in-water radiative transfer code (Hydrolight) to generate modeled surface reflectance maps. Prior to any remote sensing task, one has to ensure that a dataset comes from a well-calibrated imaging system. Although the calibration status of Landsat-7 has been regularly monitored over multiple desert sites, it was desired to evaluate its performance over dark waters relative to a well-calibrated instrument designed specifically for water studies. In the light of this, several Landsat- 7 images were cross-calibrated against the Terra-MODIS data over deep, dark waters whose optical properties remain relatively stable. This study is intended to lay the groundwork and provide a reference point for similar studies planned for the new Landsat. In an independent case study, the potential of the new Landsat sensor was examined using an EO-1 dataset and applying a spectral optimization approach over case II waters. The water constituent maps generated from the EO-1 imagery were compared against those derived from Landsat-7 to fully analyze the improvement levels pertaining to the new Landsat\u27s enhanced features in a water constituent retrieval framework

Earth Observation Data, Processing and Applications. Volume 2A. Processing - Basic Image Operations

Eds. Harrison, B.A., Jupp, D.L.B., Lewis, M.M, Sparks, T., Phinn, S.F., Mueller, N., Byrne, G