Image Fusion: A Review

At the present time, image fusion is considered as one of the types of integrated technology information, it has played a significant role in several domains and production of high-quality images. The goal of image fusion is blending information from several images, also it is fusing and keeping all the significant visual information that exists in the original images. Image fusion is one of the methods of field image processing. Image fusion is the process of merging information from a set of images to consist one image that is more informative and suitable for human and machine perception. It increases and enhances the quality of images for visual interpretation in different applications. This paper offers the outline of image fusion methods, the modern tendencies of image fusion and image fusion applications. Image fusion can be performed in the spatial and frequency domains. In the spatial domain is applied directly on the original images by merging the pixel values of the two or more images for purpose forming a fused image, while in the frequency domain the original images will decompose into multilevel coefficient and synthesized by using inverse transform to compose the fused image. Also, this paper presents a various techniques for image fusion in spatial and frequency domains such as averaging, minimum/maximum, HIS, PCA and transform-based techniques, etc.. Different quality measures have been explained in this paper to perform a comparison of these methods

Toward reduction of artifacts in fused images

Most fusion satellite image methodologies at pixel-level introduce false spatial details, i.e.artifacts, in the resulting fusedimages. In many cases, these artifacts appears because image fusion methods do not consider the differences in roughness or textural characteristics between different land covers. They only consider the digital values associated with single pixels. This effect increases as the spatial resolution image increases. To minimize this problem, we propose a new paradigm based on local measurements of the fractal dimension (FD). Fractal dimension maps (FDMs) are generated for each of the source images (panchromatic and each band of the multi-spectral images) with the box-counting algorithm and by applying a windowing process. The average of source image FDMs, previously indexed between 0 and 1, has been used for discrimination of different land covers present in satellite images. This paradigm has been applied through the fusion methodology based on the discrete wavelet transform (DWT), using the à trous algorithm (WAT). Two different scenes registered by optical sensors on board FORMOSAT-2 and IKONOS satellites were used to study the behaviour of the proposed methodology. The implementation of this approach, using the WAT method, allows adapting the fusion process to the roughness and shape of the regions present in the image to be fused. This improves the quality of the fusedimages and their classification results when compared with the original WAT metho

PAN SHARPENING USING RELATIVE SPECTRAL RESPONSE OF SENSOR FOR CARTOSAT-1 PAN AND RESOURCESAT LISS-4 MX DATA

Most of the Indian remote sensing systems, provide sensors with one high spatial resolution panchromatic (PAN) and several multispectral (MS) bands. An increasing number of applications, such as feature detection, change monitoring, and land cover classification, often demand the use of images with both high spatial and high spectral resolution. Image fusion or pan sharpening, is a technique to enhance the spatial resolution. The most significant problem in the traditional fusion methods is spectral distortion of fused images. The main reason for this being, the physical spectral characteristic of the sensors are not considered during the fusion process, resulting in undesirable effects such as modified spectral signatures resulting in classification errors and resolution over injection. For most earth resource satellites which provide both PAN and MS bands, in ideal condition, all MS bands would be well separated and would cover exactly the same wavelengths as the PAN band. Theoretically, the measured energy in the PAN band can be obtained with the summation of corresponding MS bands. As the measured energy in an individual channel is the sum of incoming radiation and relative spectral response: Lk&thinsp;=&thinsp;L(&lambda;)&thinsp;Rk(&lambda;); where &lambda; is the wavelength, the in-band radiance, L(&lambda;) at aperture spectral radiance and Rk(&lambda;) the peak-normalized spectral response. Therefore, the energy in PAN band can be estimated by defining weights as follows: Pan&thinsp;=&thinsp;wR&thinsp;R&thinsp;+&thinsp;wG&thinsp;G&thinsp;+&thinsp;wNIR NIR&thinsp;+ other; where Pan, G, R, NIR represent the radiance of individual spectral bands wG, wR, wNIR are the weights of corresponding MS bands and other for the influence of the spectral range which is missing from MS bands but still covered with the PAN band. In this paper, a novel spectral preservation fusion method for remotely sensed images using Cartosat-1 PAN and Resourcesat-Liss4 Mx data is presented by considering the physical characteristics of the sensors. It is based on the curvelet transform using relative spectral response (RSR) values of the sensor, improved in two parts: 1) the construction of PAN image using RSR values and the curvelet components, 2) the injection method of detail information. The performance and efficiency of the proposed method is compared with traditional IHS, wavelet based methods both visually and quantitatively. The results show that the proposed method preserves spatial details and minimize spectral distortion.</p

Satellite Image Fusion in Various Domains

In order to find out the fusion algorithm which is best suited for the panchromatic and multispectral images, fusion algorithms, such as PCA and wavelet algorithms have been employed and analyzed. In this paper, performance evaluation criteria are also used for quantitative assessment of the fusion performance. The spectral quality of fused images is evaluated by the ERGAS and Q4. The analysis indicates that the DWT fusion scheme has the best definition as well as spectral fidelity, and has better performance with regard to the high textural information absorption. Therefore, as the study area is concerned, it is most suited for the panchromatic and multispectral image fusion. an image fusion algorithm based on wavelet transform is proposed for Multispectral and panchromatic satellite image by using fusion in spatial and transform domains. In the proposed scheme, the images to be processed are decomposed into sub-images with the same resolution at same levels and different resolution at different levels and then the information fusion is performed using high-frequency sub-images under the Multi-resolution image fusion scheme based on wavelets produces better fused image than that by the MS or WA schemes

Pan-sharpening Using Spatial-frequency Method

Over the years, researchers have formulated various techniques for pan sharpening that attempt to minimize the spectral distortion, i.e., retain the maximum spectral fidelity of the MS images. On the other hand, if the use of the PAN-sharpened image is just to produce maps for better visual interpretation, then the spectral distortion is not of much concern, as the goal is to produce images with high contrast. To solve the color distortion problem, methods based on spatial frequency domain have been introduced and have demonstrated superior performance in terms of producing high spectral fidelity pan-sharpened images over spatial-scale methods

Survey on Different Image Fusion Techniques

Abstract: In medical imaging and remote sensing, image fusion technique is a useful tool used to fuse high spatial resolution panchromatic images (PAN) with lower spatial resolution multispectral images (MS) to create a high spatial resolution multispectral of image fusion while preserving the spectral information in the multispectral image (M

Registration and Fusion of Multi-Spectral Images Using a Novel Edge Descriptor

In this paper we introduce a fully end-to-end approach for multi-spectral image registration and fusion. Our method for fusion combines images from different spectral channels into a single fused image by different approaches for low and high frequency signals. A prerequisite of fusion is a stage of geometric alignment between the spectral bands, commonly referred to as registration. Unfortunately, common methods for image registration of a single spectral channel do not yield reasonable results on images from different modalities. For that end, we introduce a new algorithm for multi-spectral image registration, based on a novel edge descriptor of feature points. Our method achieves an accurate alignment of a level that allows us to further fuse the images. As our experiments show, we produce a high quality of multi-spectral image registration and fusion under many challenging scenarios

Panchromatic and multispectral image fusion for remote sensing and earth observation: Concepts, taxonomy, literature review, evaluation methodologies and challenges ahead

Panchromatic and multispectral image fusion, termed pan-sharpening, is to merge the spatial and spectral information of the source images into a fused one, which has a higher spatial and spectral resolution and is more reliable for downstream tasks compared with any of the source images. It has been widely applied to image interpretation and pre-processing of various applications. A large number of methods have been proposed to achieve better fusion results by considering the spatial and spectral relationships among panchromatic and multispectral images. In recent years, the fast development of artificial intelligence (AI) and deep learning (DL) has significantly enhanced the development of pan-sharpening techniques. However, this field lacks a comprehensive overview of recent advances boosted by the rise of AI and DL. This paper provides a comprehensive review of a variety of pan-sharpening methods that adopt four different paradigms, i.e., component substitution, multiresolution analysis, degradation model, and deep neural networks. As an important aspect of pan-sharpening, the evaluation of the fused image is also outlined to present various assessment methods in terms of reduced-resolution and full-resolution quality measurement. Then, we conclude this paper by discussing the existing limitations, difficulties, and challenges of pan-sharpening techniques, datasets, and quality assessment. In addition, the survey summarizes the development trends in these areas, which provide useful methodological practices for researchers and professionals. Finally, the developments in pan-sharpening are summarized in the conclusion part. The aim of the survey is to serve as a referential starting point for newcomers and a common point of agreement around the research directions to be followed in this exciting area