Gradient-adaptive Nonlinear Sharpening for Dental Radiographs

Unsharp Masking is a popular image processing technique used for improving the sharpness of structures on dental radiographs. However, it produces overshoot artefact and intolerably amplifies noise. On radiographs, the overshoot artefact often resembles the indications of prosthesis misfit, pathosis, and pathological features associated with restorations. A noise- robust alternative to the Unsharp Masking algorithm, termed Gradient-adaptive Nonlinear Sharpening (GNS) which is free from overshoot and discontinuity artefacts, is proposed in this paper. In GNS, the product of the arbitrary scalar termed as ‘scale’ and the difference between the output of the Adaptive Edge Smoothing Filter (AESF) and the input image, weighted by the normalized gradient magnitude is added to the input image. AESF is a locally-adaptive 2D Gaussian smoothing kernel whose variance is directly proportional to the local value of the gradient magnitude. The dataset employed in this paper is downloaded from the Mendeley data repository having annotated panoramic dental radiographs of 116 patients. On 116 dental radiographs, the values of Saturation Evaluation Index (SEI), Sharpness of Ridges (SOR), Edge Model Based Contrast Metric (EMBCM), and Visual Information Fidelity (VIF) exhibited by the Unsharp Masking are 0.0048 ± 0.0021, 4.4 × 1013 ± 3.8 × 1013, 0.2634 ± 0.2732 and 0.9898 ± 0.0122. The values of these quality metrics corresponding to the GNS are 0.0042 ± 0.0017, 2.2 × 1013 ± 1.8 × 1013, 0.5224 ± 0.1825, and 1.0094 ± 0.0094. GNS exhibited lower values of SEI and SOR and higher values of EMBCM and VIF, compared to the Unsharp Masking. Lower values of SEI and SOR, respectively indicate that GNS is free from overshoot artefact and saturation and the quality of edges in the output images of GNS is less affected by noise. Higher values of EMBCM and VIF, respectively confirm that GNS is free from haloes as it produces thin and sharp edges and the sharpened images are of good information fidelity

Development of Impulsive Noise Detection Schemes for Selective Filtering in Images

Image Noise Suppression is a highly demanded approach in digital imaging systems design. Impulsive noise is one such noise, which is frequently encountered problem in acquistion, transmission and processing of images. In the area of image restoration, many state-of-the art filters consist of two main processes, classification (detection) and reconstruction (filtering). Classification is used to separate uncorrupted pixels from corrupted pixels. Reconstruction involves replacing the corrupted pixels by certain approximation technique. In this thesis such schemes of impulsive noise detection and filtering thereof are proposed. Impulsive noise can be Salt & Pepper Noise (SPN) or Random Valued Impulsive Noise (RVIN). Only RVIN model is considered in this thesis because of its realistic presence. In the RVIN model a corrupted pixel can take any value in the valid range. Adaptive threshold selection is emphasized for all the four proposed noise detection schemes. Incorporation of adaptive threshold into the noise detection process led to more reliable and more efficient detection of noise. Based on the noisy image characteristics and their statistics, threshold values are selected. To validate the efficacy of proposed noise filtering schemes, an application to image sharpening has been investigated under the noise conditions. It has been observed, if the noisy image passes through the sharpening scheme, the noise gets amplified and as a result the restored results are distorted. However, the prefiltering operations using the proposed schemes enhances the result to a greater extent. Extensive simulations and comparisons are done with competent schemes. It is observed, in general, that the proposed schemes are better in suppressing impulsive noise at different noise ratios than their counterparts

Super resolution and dynamic range enhancement of image sequences

Camera producers try to increase the spatial resolution of a camera by reducing size of sites on sensor array. However, shot noise causes the signal to noise ratio drop as sensor sites get smaller. This fact motivates resolution enhancement to be performed through software. Super resolution (SR) image reconstruction aims to combine degraded images of a scene in order to form an image which has higher resolution than all observations. There is a demand for high resolution images in biomedical imaging, surveillance, aerial/satellite imaging and high-definition TV (HDTV) technology. Although extensive research has been conducted in SR, attention has not been given to increase the resolution of images under illumination changes. In this study, a unique framework is proposed to increase the spatial resolution and dynamic range of a video sequence using Bayesian and Projection onto Convex Sets (POCS) methods. Incorporating camera response function estimation into image reconstruction allows dynamic range enhancement along with spatial resolution improvement. Photometrically varying input images complicate process of projecting observations onto common grid by violating brightness constancy. A contrast invariant feature transform is proposed in this thesis to register input images with high illumination variation. Proposed algorithm increases the repeatability rate of detected features among frames of a video. Repeatability rate is increased by computing the autocorrelation matrix using the gradients of contrast stretched input images. Presented contrast invariant feature detection improves repeatability rate of Harris corner detector around %25 on average. Joint multi-frame demosaicking and resolution enhancement is also investigated in this thesis. Color constancy constraint set is devised and incorporated into POCS framework for increasing resolution of color-filter array sampled images. Proposed method provides fewer demosaicking artifacts compared to existing POCS method and a higher visual quality in final image

Adaptive Edge-guided Block-matching and 3D filtering (BM3D) Image Denoising Algorithm

Image denoising is a well studied field, yet reducing noise from images is still a valid challenge. Recently proposed Block-matching and 3D filtering (BM3D) is the current state of the art algorithm for denoising images corrupted by Additive White Gaussian noise (AWGN). Though BM3D outperforms all existing methods for AWGN denoising, still its performance decreases as the noise level increases in images, since it is harder to find proper match for reference blocks in the presence of highly corrupted pixel values. It also blurs sharp edges and textures. To overcome these problems we proposed an edge guided BM3D with selective pixel restoration. For higher noise levels it is possible to detect noisy pixels form its neighborhoods gray level statistics. We exploited this property to reduce noise as much as possible by applying a pre-filter. We also introduced an edge guided pixel restoration process in the hard-thresholding step of BM3D to restore the sharpness of edges and textures. Experimental results confirm that our proposed method is competitive and outperforms the state of the art BM3D in all considered subjective and objective quality measurements, particularly in preserving edges, textures and image contrast

Advanced Image Acquisition, Processing Techniques and Applications

"Advanced Image Acquisition, Processing Techniques and Applications" is the first book of a series that provides image processing principles and practical software implementation on a broad range of applications. The book integrates material from leading researchers on Applied Digital Image Acquisition and Processing. An important feature of the book is its emphasis on software tools and scientific computing in order to enhance results and arrive at problem solution

Development of Some Spatial-domain Preprocessing and Post-processing Algorithms for Better 2-D Up-scaling

Image super-resolution is an area of great interest in recent years and is extensively used in applications like video streaming, multimedia, internet technologies, consumer electronics, display and printing industries. Image super-resolution is a process of increasing the resolution of a given image without losing its integrity. Its most common application is to provide better visual effect after resizing a digital image for display or printing. One of the methods of improving the image resolution is through the employment of a 2-D interpolation. An up-scaled image should retain all the image details with very less degree of blurring meant for better visual quality. In literature, many efficient 2-D interpolation schemes are found that well preserve the image details in the up-scaled images; particularly at the regions with edges and fine details. Nevertheless, these existing interpolation schemes too give blurring effect in the up-scaled images due to the high frequency (HF) degradation during the up-sampling process. Hence, there is a scope to further improve their performance through the incorporation of various spatial domain pre-processing, post-processing and composite algorithms. Therefore, it is felt that there is sufficient scope to develop various efficient but simple pre-processing, post-processing and composite schemes to effectively restore the HF contents in the up-scaled images for various online and off-line applications. An efficient and widely used Lanczos-3 interpolation is taken for further performance improvement through the incorporation of various proposed algorithms. The various pre-processing algorithms developed in this thesis are summarized here. The term pre-processing refers to processing the low-resolution input image prior to image up-scaling. The various pre-processing algorithms proposed in this thesis are: Laplacian of Laplacian based global pre-processing (LLGP) scheme; Hybrid global pre-processing (HGP); Iterative Laplacian of Laplacian based global pre-processing (ILLGP); Unsharp masking based pre-processing (UMP); Iterative unsharp masking (IUM); Error based up-sampling(EU) scheme. The proposed algorithms: LLGP, HGP and ILLGP are three spatial domain preprocessing algorithms which are based on 4th, 6th and 8th order derivatives to alleviate nonuniform blurring in up-scaled images. These algorithms are used to obtain the high frequency (HF) extracts from an image by employing higher order derivatives and perform precise sharpening on a low resolution image to alleviate the blurring in its 2-D up-sampled counterpart. In case of unsharp masking based pre-processing (UMP) scheme, the blurred version of a low resolution image is used for HF extraction from the original version through image subtraction. The weighted version of the HF extracts are superimposed with the original image to produce a sharpened image prior to image up-scaling to counter blurring effectively. IUM makes use of many iterations to generate an unsharp mask which contains very high frequency (VHF) components. The VHF extract is the result of signal decomposition in terms of sub-bands using the concept of analysis filter bank. Since the degradation of VHF components is maximum, restoration of such components would produce much better restoration performance. EU is another pre-processing scheme in which the HF degradation due to image upscaling is extracted and is called prediction error. The prediction error contains the lost high frequency components. When this error is superimposed on the low resolution image prior to image up-sampling, blurring is considerably reduced in the up-scaled images. Various post-processing algorithms developed in this thesis are summarized in following. The term post-processing refers to processing the high resolution up-scaled image. The various post-processing algorithms proposed in this thesis are: Local adaptive Laplacian (LAL); Fuzzy weighted Laplacian (FWL); Legendre functional link artificial neural network(LFLANN). LAL is a non-fuzzy, local based scheme. The local regions of an up-scaled image with high variance are sharpened more than the region with moderate or low variance by employing a local adaptive Laplacian kernel. The weights of the LAL kernel are varied as per the normalized local variance so as to provide more degree of HF enhancement to high variance regions than the low variance counterpart to effectively counter the non-uniform blurring. Furthermore, FWL post-processing scheme with a higher degree of non-linearity is proposed to further improve the performance of LAL. FWL, being a fuzzy based mapping scheme, is highly nonlinear to resolve the blurring problem more effectively than LAL which employs a linear mapping. Another LFLANN based post-processing scheme is proposed here to minimize the cost function so as to reduce the blurring in a 2-D up-scaled image. Legendre polynomials are used for functional expansion of the input pattern-vector and provide high degree of nonlinearity. Therefore, the requirement of multiple layers can be replaced by single layer LFLANN architecture so as to reduce the cost function effectively for better restoration performance. With single layer architecture, it has reduced the computational complexity and hence is suitable for various real-time applications. There is a scope of further improvement of the stand-alone pre-processing and postprocessing schemes by combining them through composite schemes. Here, two spatial domain composite schemes, CS-I and CS-II are proposed to tackle non-uniform blurring in an up-scaled image. CS-I is developed by combining global iterative Laplacian (GIL) preprocessing scheme with LAL post-processing scheme. Another highly nonlinear composite scheme, CS-II is proposed which combines ILLGP scheme with a fuzzy weighted Laplacian post-processing scheme for more improved performance than the stand-alone schemes. Finally, it is observed that the proposed algorithms: ILLGP, IUM, FWL, LFLANN and CS-II are better algorithms in their respective categories for effectively reducing blurring in the up-scaled images

Optimization Considerations for Adaptive Optics Digital Imagery Systems

This dissertation had three objectives. The first objective was to develop image quality metrics that characterize Adaptive Optics System (AOS) performance. The second objective was to delineate control settings that maximize AOS performance. The third objective was to identify and characterize trade-offs between fully and partially compensated adaptive. For the first objective, three candidate image quality metrics were considered: the Strehl ratio, a novel metric that modifies the Strehl ratio by integrating the modulus of the average system optical transfer function to a \u27noise-effective-cutoff\u27 frequency at which some specified image spectrum signal-to-noise-ratio level is attained, and the noise-effective-cutoff frequency. It was shown that these metrics are correlated with the root-mean-square error between the detected image and the associated diffraction limited image and that they have traits that make them desirable for AOS performance metrics. For the second objective, optimum closed loop bandwidth settings were determined as a function of target object light levels and atmospheric seeing conditions. A strategy for selecting the closed loop bandwidth to provide robust system performance was also developed. For the third research objective, a qualitative assessment of trade-offs between fully compensated and partially compensated adaptive optics systems was provided

Maximum likelihood parameter estimation of mixture models and its application to image segmentation and restoration

Thesis (M.S.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1997.Includes bibliographical references (leaves 79-82).by Mohammed Saeed.M.S