Research Issues in Image Registration for Remote Sensing

Image registration is an important element in data processing for remote sensing with many applications and a wide range of solutions. Despite considerable investigation the field has not settled on a definitive solution for most applications and a number of questions remain open. This article looks at selected research issues by surveying the experience of operational satellite teams, application-specific requirements for Earth science, and our experiments in the evaluation of image registration algorithms with emphasis on the comparison of algorithms for subpixel accuracy. We conclude that remote sensing applications put particular demands on image registration algorithms to take into account domain-specific knowledge of geometric transformations and image content

Multimodal Remote Sensing Image Registration Based on Adaptive Multi-scale PIIFD

In recent years, due to the wide application of multi-sensor vision systems, multimodal image acquisition technology has continued to develop, and the registration problem based on multimodal images has gradually emerged. Most of the existing multimodal image registration methods are only suitable for two modalities, and cannot uniformly register multiple modal image data. Therefore, this paper proposes a multimodal remote sensing image registration method based on adaptive multi-scale PIIFD(AM-PIIFD). This method extracts KAZE features, which can effectively retain edge feature information while filtering noise. Then adaptive multi-scale PIIFD is calculated for matching. Finally, the mismatch is removed through the consistency of the feature main direction, and the image alignment transformation is realized. The qualitative and quantitative comparisons with other three advanced methods shows that our method can achieve excellent performance in multimodal remote sensing image registration

Impact of intraband misregistration on image classification

Remote sensing data acquired from spaceborne platforms in multispectral channels with moderate to high spatial resolution has been extensively used for numerous applications. Registration between images as well as multispectral bands significantly affects the classification accuracy. Data acquired in multiple channels needs accurate intraband registration to minimise classification errors. Availability of very high spatial resolution data such as from SPOT, IRS-P6, IKONOS, and Quickbird demands very accurate intraband registration. Ability to provide accurate intraband registration requires proper knowledge of satellite attitude, Earth rotation correction, sensor geometry etc. While every effort is made to minimise the intraband misregistration at product generation level, it is difficult to remove it all together. In view of this and its significance on remote sensing image classification, an attempt was made to evaluate the impact of intraband misregistration on classification of remote sensing image with high spatial resolution data. Study carried using a prototype image and IRS-P6 LISS-IV image reveals that image data with intraband misregistration greater than 20% significantly reduce image sharpness and leads to misclassification. Though misregistration of NIR band has major impact on classification it was also seen that misregistration among all bands would lead to even greater error in classification and increased edge blurring

Deformable Image Registration for Hyperspectral Images

Image registration is one of the basic image processing operations in remote sensing. A hyperspectral image has two spatial dimensions and one spectral dimension. There are many hyperspectral sensors used in remote sensing. Traditional intensity-based registration methods may fail for hyperspectral images because of the different spectral sensitivities for different sensors. In addition, not all spectral bands are required to achieve accurate registration. This thesis develops a modification of the large deformation diffeomorphic metric mappings (LDDMM) algorithm in order to deal with the challenges when applied to hyperspectral images. The transformation generated by our method that deforms one image to match the other is differentiable, isomorphic and invertible. We also propose a mutual information based band selection algorithm to reduce the data redundancy of the hyperspectral images. The approach is applied to two hyperspectral images from OMEGA instrument, with a better matching result than original LDDMM method with respect to mutual information

HSI-MSER: Hyperspectral Image Registration Algorithm based on MSER and SIFT

Image alignment is an essential task in many applications of hyperspectral remote sensing images. Before any processing, the images must be registered. The Maximally Stable Extremal Regions (MSER) is a feature detection algorithm which extracts regions by thresholding the image at different grey levels. These extremal regions are invariant to image transformations making them ideal for registration. The Scale-Invariant Feature Transform (SIFT) is a well-known keypoint detector and descriptor based on the construction of a Gaussian scale-space. This article presents a hyperspectral remote sensing image registration method based on MSER for feature detection and SIFT for feature description. It efficiently exploits the information contained in the different spectral bands to improve the image alignment. The experimental results over nine hyperspectral images show that the proposed method achieves a higher number of correct registration cases using less computational resources than other hyperspectral registration methods. Results are evaluated in terms of accuracy of the registration and also in terms of execution timeMinisterio de Ciencia e Innovación, Government of Spain PID2019-104834GB-I00; Consellería de Cultura, Educación e Universidade (Grant Number: ED431C 2018/19 and 2019-2022 ED431G-2019/04); Junta de Castilla y León under Project VA226P20; 10.13039/501100008530-European Regional Development Fund; Ministerio de Universidades, Government of Spain (Grant Number: FPU16/03537)S

Image Registration for Remote Sensing

No abstract availabl