Image fusion techniqes for remote sensing applications

Image fusion refers to the acquisition, processing and synergistic combination of information provided by various sensors or by the same sensor in many measuring contexts. The aim of this survey paper is to describe three typical applications of data fusion in remote sensing. The first study case considers the problem of the Synthetic Aperture Radar (SAR) Interferometry, where a pair of antennas are used to obtain an elevation map of the observed scene; the second one refers to the fusion of multisensor and multitemporal (Landsat Thematic Mapper and SAR) images of the same site acquired at different times, by using neural networks; the third one presents a processor to fuse multifrequency, multipolarization and mutiresolution SAR images, based on wavelet transform and multiscale Kalman filter. Each study case presents also results achieved by the proposed techniques applied to real data

Satellite image retrieval with pattern spectra descriptors

International audienceThe increasing volume of Earth Observation data calls for appropriate solutions in satellite image retrieval. We address this problem by considering morphological descrip-tors called pattern spectra. Such descriptors are histogram-like structures that contain the information on the distribution of predefined properties (attributes) of image components. They can be computed both at the local and global scale, and are computationally attractive. We demonstrate how they can be embedded in an image retrieval framework and report their promising performances when dealing with a standard satellite image dataset

An Automated Approach for Sub-Pixel Registration of Landsat-8 Operational Land Imager (OLI) and Sentinel-2 Multi Spectral Instrument (MSI) Imagery

Moderate spatial resolution satellite data from the Landsat-8 OLI and Sentinel-2A MSI sensors together offer 10 m to 30 m multi-spectral reflective wavelength global coverage, providing the opportunity for improved combined sensor mapping and monitoring of the Earth’s surface. However, the standard geolocated Landsat-8 OLI L1T and Sentinel-2A MSI L1C data products are currently found to be misaligned. An approach for automated registration of Landsat-8 OLI L1T and Sentinel-2A MSI L1C data is presented and demonstrated using contemporaneous sensor data. The approach is computationally efficient because it implements feature point detection across four image pyramid levels to identify a sparse set of tie-points. Area-based least squares matching around the feature points with mismatch detection across the image pyramid levels is undertaken to provide reliable tie-points. The approach was assessed by examination of extracted tie-point spatial distributions and tie-point mapping transformations (translation, affine and second order polynomial), dense-matching prediction-error assessment, and by visual registration assessment. Two test sites over Cape Town and Limpopo province in South Africa that contained cloud and shadows were selected. A Landsat-8 L1T image and two Sentinel-2A L1C images sensed 16 and 26 days later were registered (Cape Town) to examine the robustness of the algorithm to surface, atmosphere and cloud changes, in addition to the registration of a Landsat-8 L1T and Sentinel-2A L1C image pair sensed 4 days apart (Limpopo province). The automatically extracted tie-points revealed sensor misregistration greater than one 30 m Landsat-8 pixel dimension for the two Cape Town image pairs, and greater than one 10 m Sentinel-2A pixel dimension for the Limpopo image pair. Transformation fitting assessments showed that the misregistration can be effectively characterized by an affine transformation. Hundreds of automatically located tie-points were extracted and had affine-transformation root-mean-square error fits of approximately 0.3 pixels at 10 m resolution and dense-matching prediction errors of similar magnitude. These results and visual assessment of the affine transformed data indicate that the methodology provides sub-pixel registration performance required for meaningful Landsat-8 OLI and Sentinel-2A MSI data comparison and combined data applications

Broadband coated lens solutions for FIR-mm-wave instruments

This paper presents recent results of ongoing European Space Agency funded program of work aimed at developing large dielectric lenses suitable for future satellite missions, with a particular focus on requirements for CMB polarimetry. Two lens solutions are being investigated: (i) polymer lenses with broadband multi-layer antireflection coatings; (ii) silicon lenses with surface-structured anti-reflection coating represented by directly machined pyramidal features. For each solution, base materials with and without coatings have been optically characterized over a range of temperatures down to ∼10 K. Full lens solutions are under manufacture and will be tested in a bespoke large cryo-optical facility

Progressive Refinement Imaging

This paper presents a novel technique for progressive online integration of uncalibrated image sequences with substantial geometric and/or photometric discrepancies into a single, geometrically and photometrically consistent image. Our approach can handle large sets of images, acquired from a nearly planar or infinitely distant scene at different resolutions in object domain and under variable local or global illumination conditions. It allows for efficient user guidance as its progressive nature provides a valid and consistent reconstruction at any moment during the online refinement process. // Our approach avoids global optimization techniques, as commonly used in the field of image refinement, and progressively incorporates new imagery into a dynamically extendable and memory‐efficient Laplacian pyramid. Our image registration process includes a coarse homography and a local refinement stage using optical flow. Photometric consistency is achieved by retaining the photometric intensities given in a reference image, while it is being refined. Globally blurred imagery and local geometric inconsistencies due to, e.g. motion are detected and removed prior to image fusion. // We demonstrate the quality and robustness of our approach using several image and video sequences, including handheld acquisition with mobile phones and zooming sequences with consumer cameras

Efficient Schemes for Computing α-tree Representations

International audienceHierarchical image representations have been addressed by various models by the past, the max-tree being probably its best representative within the scope of Mathematical Morphology. However, the max-tree model requires to impose an ordering relation between pixels, from the lowest values (root) to the highest (leaves). Recently, the α-tree model has been introduced to avoid such an ordering. Indeed, it relies on image quasi-flat zones, and as such focuses on local dissimilarities. It has led to successful attempts in remote sensing and video segmentation. In this paper, we deal with the problem of α-tree computation, and propose several efficient schemes which help to ensure real-time (or near-real time) morphological image processing