Image sequence restoration by median filtering

Median filters are non-linear filters that fit in the generic category of order-statistic filters. Median filters are widely used for reducing random defects, commonly characterized by impulse or salt and pepper noise in a single image. Motion estimation is the process of estimating the displacement vector between like pixels in the current frame and the reference frame. When dealing with a motion sequence, the motion vectors are the key for operating on corresponding pixels in several frames. This work explores the use of various motion estimation algorithms in combination with various median filter algorithms to provide noise suppression. The results are compared using two sets of metrics: performance-based and objective image quality-based. These results are used to determine the best motion estimation / median filter combination for image sequence restoration. The primary goals of this work are to implement a motion estimation and median filter algorithm in hardware and develop and benchmark a flexible software alternative restoration process. There are two unique median filter algorithms to this work. The first filter is a modification to a single frame adaptive median filter. The modification applied motion compensation and temporal concepts. The other is an adaptive extension to the multi-level (ML3D) filter, called adaptive multi-level (AML3D) filter. The extension provides adaptable filter window sizes to the multiple filter sets that comprise the ML3D filter. The adaptive median filter is capable of filtering an image in 26.88 seconds per frame and results in a PSNR improvement of 5.452dB. The AML3D is capable of filtering an image in 14.73 seconds per frame and results in a PSNR improvement of 6.273dB. The AML3D is a suitable alternative to the other median filters

Some novel digital image filters for suppression of impulsive noise

In digital imaging, quality of image degrades due to contamination of various types of noise during the process of acquisition, transmission and storage. Especially impulse noise appears during image acquisition and transmission, which severely degrades the image quality and cause a great loss of information details in an image. Various filtering technique are found in literature for removal of impulse noise. Nonlinear filter such as standard median, weight median filter, center weight median and switching based median filter out perform the linear filters. This thesis investigates the performance analysis of different nonlinear filtering schemes. The performance of these filters can be improved by incorporating the mechanism of noise detection and then applying switching based adaptive filtering approach. Three novel filtering approaches that incorporate the above principles are proposed. It is found that all three approaches give noticeable performance improvement of over many filters reported in literature

Novel Restoration Techniques for Images Corrupted with High Density Impulsive Noise

Impulse noise is a most common noise which affects the image quality during acquisition or transmission, reception or storage and retrieval process. Impulse noise comes under two categories: (1) fixed-valued impulse noise, also known as salt-and-pepper noise (SPN) due to its appearance, where the noise value may be either the minimum or maximum value of the dynamic gray-scale range of image and (2) random-valued impulse noise (RVIN), where the noisy pixel value is bounded by the range of the dynamic gray-scale of the image. In literature, many efficient filters are proposed to suppress the impulse noise. But their performance is not good under moderate and high noise conditions. Hence, there is sufficient scope to explore and develop efficient filters for suppressing the impulse noise at high noise densities. In the present research work, efforts are made to propose efficient filters that suppress the impulse noise and preserve the edges and fine details of an image in wide range of noise densities. It is clear from the literature that detection followed by filtering achieves better performance than filtering without detection. Hence, the proposed filters in this thesis are based on detection followed by filtering techniques. The filters which are proposed to suppress the SPN in this thesis are: Adaptive Noise Detection and Suppression (ANDS) Filter Robust Estimator based Impulse-Noise Reduction (REIR) Algorithm Impulse Denoising Using Improved Progressive Switching Median Filter (IDPSM) Impulse-Noise Removal by Impulse Classification (IRIC) A Novel Adaptive Switching Filter-I (ASF-I) for Suppression of High Density SPN A Novel Adaptive Switching Filter-II (ASF-II) for Suppression of High Density SPN Impulse Denoising Using Iterative Adaptive Switching Filter (IASF) In the first method, ANDS, neighborhood difference is employed for pixel classification. Controlled by binary image, the noise is filtered by estimating the value of a pixel with an adaptive switching based median filter applied exclusively to neighborhood pixels that are labeled noise-free. The proposed filter performs better in retaining edges and fine details of an image at low-to-medium densities of fixed-valued impulse noise.The REIR method is based on robust statistic technique, where adaptive window is used for pixel classification. The noisy pixel is replaced with Lorentzian estimator or average of the previously processed pixels. Because of adaptive windowing technique, the filter is able to suppress the noise at a density as high as 90%. In the proposed method, IDPSM, the noisy pixel is replaced with median of uncorrupted pixels in an adaptive filtering window. The iterative nature of the filter makes it more efficient in noise detection and adaptive filtering window technique makes it robust enough to preserve edges and fine details of an image in wide range of noise densities. The forth proposed method is IRIC. The noisy pixel is replaced with median of processed pixels in the filtering window. At high noise densities, the median filtering may not be able to reject outliers always. Under such circumstances, the processed left neighboring pixel is considered as the estimated output. The computational complexity of this method is equivalent to that of a median filter having a 3×3 window. The proposed algorithm requires simple physical realization structures. Therefore, this algorithm may be quite useful for online and real-time applications. Two different adaptive switching filters: ASF-I and ASF-II are developed for suppressing SPN at high noise density. The noisy pixel is replaced with alpha-trimmed mean value of uncorrupted pixels in the adaptive filtering window. Depending on noise estimation, a small filtering window size is initially selected and then the scheme adaptively changes the window size based on the number of noise-free pixels. Therefore, the proposed method removes the noise much more effectively even at noise density as high as 90% and yields high image quality. In the proposed method IASF, noisy pixel is replaced with alpha-trimmed mean value of uncorrupted pixels in the adaptive filtering window. Due to its iterative structure, the performance of this filter is better than existing order-statistic filters. Further, the adaptive filtering window makes it robust enough to preserve the edges and fine details of an image. Novel Restoration Techniques for Images Corrupted with High Density Impulsive Noise x The filters which are proposed for suppressing random-valued impulse noise (RVIN) are: Adaptive Window based Pixel-Wise MAD (AW-PWMAD) Algorithm Adaptive Local Thresholding with MAD (ALT-MAD) Algorithm The proposed method, Adaptive Window based Pixel-Wise MAD (AW-PWMAD) Algorithm is a modified MAD (Median of the Absolute Deviations from the median) scheme alongwith a threshold employed for pixel-classification. The noisy pixel is replaced with median of uncorrupted pixels in adaptive filtering window. Another proposed method for denoising the random-valued and fixed-valued impulse noise is ALT-MAD. A modified MAD based algorithm alongwith a local adaptive threshold is utilized for pixel-classification. The noisy pixel is replaced with median of uncorrupted pixels in the filtering window of adaptively varied size. Three threshold functions are suggested and employed in this algorithm. Thus, three different versions, namely, ALT-MAD-1, ALT-MAD-2 and ALT-MAD-3 are developed. They are observed to be quite efficient in noise detection and filtering. In the last part of the thesis, some efforts are made to develop filters for color image denoising. The filters which perform better in denoising gray-scale images are developed for suppression of impulsive noise from color images. Since the performance of denoising filters degrades in other color spaces, efforts are made to develop color image denoising filters in RGB color space only in this research work. The developed filters are: Multi-Channel Robust Estimator based Impulse-Noise Reduction (MC-REIR) Algorithm Multi-Channel Impulse-Noise Removal by Impulse Classification (MC-IRIC) Multi-Channel Iterative Adaptive Switching Filter (MC-IASF) Multi-Channel Adaptive Local Thresholding with MAD (MC-ALT-MAD) Algorithm It is observed from the simulation results that the proposed filters perform better than the existing methods. The proposed methods: ASF-1 and IASF exhibit quite superior performance in suppressing SPN in high noise densities compared to other methods. Similarly ALT-MAD-3 exhibits much better performance in suppressing RVIN of low to medium noise densities.The REIR method is based on robust statistic technique, where adaptive window is used for pixel classification. The noisy pixel is replaced with Lorentzian estimator or average of the previously processed pixels. Because of adaptive windowing technique, the filter is able to suppress the noise at a density as high as 90%. In the proposed method, IDPSM, the noisy pixel is replaced with median of uncorrupted pixels in an adaptive filtering window. The iterative nature of the filter makes it more efficient in noise detection and adaptive filtering window technique makes it robust enough to preserve edges and fine details of an image in wide range of noise densities. The forth proposed method is IRIC. The noisy pixel is replaced with median of processed pixels in the filtering window. At high noise densities, the median filtering may not be able to reject outliers always. Under such circumstances, the processed left neighboring pixel is considered as the estimated output. The computational complexity of this method is equivalent to that of a median filter having a 3×3 window. The proposed algorithm requires simple physical realization structures. Therefore, this algorithm may be quite useful for online and real-time applications. Two different adaptive switching filters: ASF-I and ASF-II are developed for suppressing SPN at high noise density. The noisy pixel is replaced with alpha-trimmed mean value of uncorrupted pixels in the adaptive filtering window. Depending on noise estimation, a small filtering window size is initially selected and then the scheme adaptively changes the window size based on the number of noise-free pixels. Therefore, the proposed method removes the noise much more effectively even at noise density as high as 90% and yields high image quality. In the proposed method IASF, noisy pixel is replaced with alpha-trimmed mean value of uncorrupted pixels in the adaptive filtering window. Due to its iterative structure, the performance of this filter is better than existing order-statistic filters. Further, the adaptive filtering window makes it robust enough to preserve the edges and fine details of an image. Novel Restoration Techniques for Images Corrupted with High Density Impulsive Noise x The filters which are proposed for suppressing random-valued impulse noise (RVIN) are: Adaptive Window based Pixel-Wise MAD (AW-PWMAD) Algorithm Adaptive Local Thresholding with MAD (ALT-MAD) Algorithm The proposed method, Adaptive Window based Pixel-Wise MAD (AW-PWMAD) Algorithm is a modified MAD (Median of the Absolute Deviations from the median) scheme alongwith a threshold employed for pixel-classification. The noisy pixel is replaced with median of uncorrupted pixels in adaptive filtering window. Another proposed method for denoising the random-valued and fixed-valued impulse noise is ALT-MAD. A modified MAD based algorithm alongwith a local adaptive threshold is utilized for pixel-classification. The noisy pixel is replaced with median of uncorrupted pixels in the filtering window of adaptively varied size. Three threshold functions are suggested and employed in this algorithm. Thus, three different versions, namely, ALT-MAD-1, ALT-MAD-2 and ALT-MAD-3 are developed. They are observed to be quite efficient in noise detection and filtering. In the last part of the thesis, some efforts are made to develop filters for color image denoising. The filters which perform better in denoising gray-scale images are developed for suppression of impulsive noise from color images. Since the performance of denoising filters degrades in other color spaces, efforts are made to develop color image denoising filters in RGB color space only in this research work. The developed filters are: Multi-Channel Robust Estimator based Impulse-Noise Reduction (MC-REIR) Algorithm Multi-Channel Impulse-Noise Removal by Impulse Classification (MC-IRIC) Multi-Channel Iterative Adaptive Switching Filter (MC-IASF) Multi-Channel Adaptive Local Thresholding with MAD (MC-ALT-MAD) Algorithm It is observed from the simulation results that the proposed filters perform better than the existing methods. The proposed methods: ASF-1 and IASF exhibit quite superior performance in suppressing SPN in high noise densities compared to other methods. Similarly ALT-MAD-3 exhibits much better performance in suppressing RVIN of low to medium noise densities.The REIR method is based on robust statistic technique, where adaptive window is used for pixel classification. The noisy pixel is replaced with Lorentzian estimator or average of the previously processed pixels. Because of adaptive windowing technique, the filter is able to suppress the noise at a density as high as 90%. In the proposed method, IDPSM, the noisy pixel is replaced with median of uncorrupted pixels in an adaptive filtering window. The iterative nature of the filter makes it more efficient in noise detection and adaptive filtering window technique makes it robust enough to preserve edges and fine details of an image in wide range of noise densities. The forth proposed method is IRIC. The noisy pixel is replaced with median of processed pixels in the filtering window. At high noise densities, the median filtering may not be able to reject outliers always. Under such circumstances, the processed left neighboring pixel is considered as the estimated output. The computational complexity of this method is equivalent to that of a median filter having a 3×3 window. The proposed algorithm requires simple physical realization structures. Therefore, this algorithm may be quite useful for online and real-time applications. Two different adaptive switching filters: ASF-I and ASF-II are developed for suppressing SPN at high noise density. The noisy pixel is replaced with alpha-trimmed mean value of uncorrupted pixels in the adaptive filtering window. Depending on noise estimation, a small filtering window size is initially selected and then the scheme adaptively changes the window size based on the number of noise-free pixels. Therefore, the proposed method removes the noise much more effectively even at noise density as high as 90% and yields high image quality. In the proposed method IASF, noisy pixel is replaced with alpha-trimmed mean value of uncorrupted pixels in the adaptive filtering window. Due to its iterative structure, the performance of this filter is better than existing order-statistic filters. Further, the adaptive filtering window makes it robust enough to preserve the edges and fine details of an image. Novel Restoration Techniques for Images Corrupted with High Density Impulsive Noise x The filters which are proposed for suppressing random-valued impulse noise (RVIN) are: Adaptive Window based Pixel-Wise MAD (AW-PWMAD) Algorithm Adaptive Local Thresholding with MAD (ALT-MAD) Algorithm The proposed method, Adaptive Window based Pixel-Wise MAD (AW-PWMAD) Algorithm is a modified MAD (Median of the Absolute Deviations from the median) scheme alongwith a threshold employed for pixel-classification. The noisy pixel is replaced with median of uncorrupted pixels in adaptive filtering window. Another proposed method for denoising the random-valued and fixed-valued impulse noise is ALT-MAD. A modified MAD based algorithm alongwith a local adaptive threshold is utilized for pixel-classification. The noisy pixel is replaced with median of uncorrupted pixels in the filtering window of adaptively varied size. Three threshold functions are suggested and employed in this algorithm. Thus, three different versions, namely, ALT-MAD-1, ALT-MAD-2 and ALT-MAD-3 are developed. They are observed to be quite efficient in noise detection and filtering. In the last part of the thesis, some efforts are made to develop filters for color image denoising. The filters which perform better in denoising gray-scale images are developed for suppression of impulsive noise from color images. Since the performance of denoising filters degrades in other color spaces, efforts are made to develop color image denoising filters in RGB color space only in this research work. The developed filters are: Multi-Channel Robust Estimator based Impulse-Noise Reduction (MC-REIR) Algorithm Multi-Channel Impulse-Noise Removal by Impulse Classification (MC-IRIC) Multi-Channel Iterative Adaptive Switching Filter (MC-IASF) Multi-Channel Adaptive Local Thresholding with MAD (MC-ALT-MAD) Algorithm It is observed from the simulation results that the proposed filters perform better than the existing methods. The proposed methods: ASF-1 and IASF exhibit quite superior performance in suppressing SPN in high noise densities compared to other methods. Similarly ALT-MAD-3 exhibits much better performance in suppressing RVIN of low to medium noise densities

Speckle Noise Reduction via Homomorphic Elliptical Threshold Rotations in the Complex Wavelet Domain

Many clinicians regard speckle noise as an undesirable artifact in ultrasound images masking the underlying pathology within a patient. Speckle noise is a random interference pattern formed by coherent radiation in a medium containing many sub-resolution scatterers. Speckle has a negative impact on ultrasound images as the texture does not reflect the local echogenicity of the underlying scatterers. Studies have shown that the presence of speckle noise can reduce a physician's ability to detect lesions by a factor of eight. Without speckle, small high-contrast targets, low contrast objects, and image texture can be deduced quite readily. Speckle filtering of medical ultrasound images represents a critical pre-processing step, providing clinicians with enhanced diagnostic ability. Efficient speckle noise removal algorithms may also find applications in real time surgical guidance assemblies. However, it is vital that regions of interests are not compromised during speckle removal. This research pertains to the reduction of speckle noise in ultrasound images while attempting to retain clinical regions of interest. Recently, the advance of wavelet theory has lead to many applications in noise reduction and compression. Upon investigation of these two divergent fields, it was found that the speckle noise tends to rotate an image's homomorphic complex-wavelet coefficients. This work proposes a new speckle reduction filter involving a counter-rotation of these complex-wavelet coefficients to mitigate the presence of speckle noise. Simulations suggest the proposed denoising technique offers superior visual quality, though its signal-to-mean-square-error ratio (S/MSE) is numerically comparable to adaptive frost and kuan filtering. This research improves the quality of ultrasound medical images, leading to improved diagnosis for one of the most popular and cost effective imaging modalities used in clinical medicine

Colour morphological sieves for scale-space image processing

EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Study of Target Enhancement Algorithms to Counter the Hostile Nuclear Environment

A necessary requirement of strategic defense is the detection of incoming nuclear warheads in an environment that may include nuclear detonations of undetected or missed target warheads. A computer model is described which simulates incoming warheads as distant endoatmospheric targets. A model of the expected electromagnetic noise present in a nuclear environment is developed using estimates of the probability distributions. Predicted atmospheric effects are also included. Various image enhancement algorithms, both linear and nonlinear, are discussed concerning their anticipated ability to suppress the noise and atmospheric effects of the nuclear environment. These algorithms are then tested, using the combined target and noise models, and evaluated in terms of the stated figures of merit

Sparse modelling of natural images and compressive sensing

This thesis concerns the study of the statistics of natural images and compressive sensing for two main objectives: 1) to extend our understanding of the regularities exhibited by natural images of the visual world we regularly view around us, and 2) to incorporate this knowledge into image processing applications. Previous work on image statistics has uncovered remarkable behavior of the dis tributions obtained from filtering natural images. Typically we observe high kurtosis, non-Gaussian distributions with sharp central cusps, which are called sparse in the literature. These results have become an accepted fact through empirical findings us ing zero mean filters on many different databases of natural scenes. The observations have played an important role in computational and biological applications, where re searchers have sought to understand visual processes through studying the statistical properties of the objects that are being observed. Interestingly, such results on sparse distributions also share elements with the emerging field of compressive sensing. This is a novel sampling protocol where one seeks to measure a signal in already com pressed format through randomised projections, while the recovery algorithm consists of searching for a constrained solution with the sparsest transformed coefficients. In view of prior art, we extend our knowledge of image statistics from the monochrome domain into the colour domain. We study sparse response distributions of filters constructed on colour channels and observe the regularity of the distributions across diverse datasets of natural images. Several solutions to image processing problems emerge from the incorporation of colour statistics as prior information. We give a Bayesian treatment to the problem of colorizing natural gray images, and formulate image compression schemes using elements of compressive sensing and sparsity. We also propose a denoising algorithm that utilises the sparse filter responses as a regular- isation function for the effective attenuation of Gaussian and impulse noise in images. The results emanating from this body of work illustrate how the statistics of natural images, when incorporated with Bayesian inference and sparse recovery, can have deep implications for image processing applications