Removal Of Blocking Artifacts From JPEG-Compressed Images Using An Adaptive Filtering Algorithm

The aim of this research was to develop an algorithm that will produce a considerable improvement in the quality of JPEG images, by removing blocking and ringing artifacts, irrespective of the level of compression present in the image. We review multiple published related works, and finally present a computationally efficient algorithm for reducing the blocky and Gibbs oscillation artifacts commonly present in JPEG compressed images. The algorithm alpha-blends a smoothed version of the image with the original image; however, the blending is controlled by a limit factor that considers the amount of compression present and any local edge information derived from the application of a Prewitt filter. In addition, the actual value of the blending coefficient (α) is derived from the local Mean Structural Similarity Index Measure (MSSIM) which is also adjusted by a factor that also considers the amount of compression present. We also present our results as well as the results for a variety of other papers whose authors used other post compression filtering methods

Microarray missing data imputation based on a set theoretic framework and biological knowledge

Gene expressions measured using microarrays usually suffer from the missing value problem. However, in many data analysis methods, a complete data matrix is required. Although existing missing value imputation algorithms have shown good performance to deal with missing values, they also have their limitations. For example, some algorithms have good performance only when strong local correlation exists in data while some provide the best estimate when data is dominated by global structure. In addition, these algorithms do not take into account any biological constraint in their imputation. In this paper, we propose a set theoretic framework based on projection onto convex sets (POCS) for missing data imputation. POCS allows us to incorporate different types of a priori knowledge about missing values into the estimation process. The main idea of POCS is to formulate every piece of prior knowledge into a corresponding convex set and then use a convergence-guaranteed iterative procedure to obtain a solution in the intersection of all these sets. In this work, we design several convex sets, taking into consideration the biological characteristic of the data: the first set mainly exploit the local correlation structure among genes in microarray data, while the second set captures the global correlation structure among arrays. The third set (actually a series of sets) exploits the biological phenomenon of synchronization loss in microarray experiments. In cyclic systems, synchronization loss is a common phenomenon and we construct a series of sets based on this phenomenon for our POCS imputation algorithm. Experiments show that our algorithm can achieve a significant reduction of error compared to the KNNimpute, SVDimpute and LSimpute methods

A learning-by-example method for reducing BDCT compression artifacts in high-contrast images.

Wang, Guangyu.Thesis submitted in: December 2003.Thesis (M.Phil.)--Chinese University of Hong Kong, 2004.Includes bibliographical references (leaves 70-75).Abstracts in English and Chinese.Chapter 1 --- Introduction --- p.1Chapter 1.1 --- BDCT Compression Artifacts --- p.1Chapter 1.2 --- Previous Artifact Removal Methods --- p.3Chapter 1.3 --- Our Method --- p.4Chapter 1.4 --- Structure of the Thesis --- p.4Chapter 2 --- Related Work --- p.6Chapter 2.1 --- Image Compression --- p.6Chapter 2.2 --- A Typical BDCT Compression: Baseline JPEG --- p.7Chapter 2.3 --- Existing Artifact Removal Methods --- p.10Chapter 2.3.1 --- Post-Filtering --- p.10Chapter 2.3.2 --- Projection onto Convex Sets --- p.12Chapter 2.3.3 --- Learning by Examples --- p.13Chapter 2.4 --- Other Related Work --- p.14Chapter 3 --- Contamination as Markov Random Field --- p.17Chapter 3.1 --- Markov Random Field --- p.17Chapter 3.2 --- Contamination as MRF --- p.18Chapter 4 --- Training Set Preparation --- p.22Chapter 4.1 --- Training Images Selection --- p.22Chapter 4.2 --- Bit Rate --- p.23Chapter 5 --- Artifact Vectors --- p.26Chapter 5.1 --- Formation of Artifact Vectors --- p.26Chapter 5.2 --- Luminance Remapping --- p.29Chapter 5.3 --- Dominant Implication --- p.29Chapter 6 --- Tree-Structured Vector Quantization --- p.32Chapter 6.1 --- Background --- p.32Chapter 6.1.1 --- Vector Quantization --- p.32Chapter 6.1.2 --- Tree-Structured Vector Quantization --- p.33Chapter 6.1.3 --- K-Means Clustering --- p.34Chapter 6.2 --- TSVQ in Artifact Removal --- p.35Chapter 7 --- Synthesis --- p.39Chapter 7.1 --- Color Processing --- p.39Chapter 7.2 --- Artifact Removal --- p.40Chapter 7.3 --- Selective Rejection of Synthesized Values --- p.42Chapter 8 --- Experimental Results --- p.48Chapter 8.1 --- Image Quality Assessments --- p.48Chapter 8.1.1 --- Peak Signal-Noise Ratio --- p.48Chapter 8.1.2 --- Mean Structural SIMilarity --- p.49Chapter 8.2 --- Performance --- p.50Chapter 8.3 --- How Size of Training Set Affects the Performance --- p.52Chapter 8.4 --- How Bit Rates Affect the Performance --- p.54Chapter 8.5 --- Comparisons --- p.56Chapter 9 --- Conclusion --- p.61Chapter A --- Color Transformation --- p.63Chapter B --- Image Quality --- p.64Chapter B.1 --- Image Quality vs. Quantization Table --- p.64Chapter B.2 --- Image Quality vs. Bit Rate --- p.66Chapter C --- Arti User's Manual --- p.68Bibliography --- p.7

Doctor of Philosophy

dissertationDynamic contrast enhanced magnetic resonance imaging (DCE-MRI) is a powerful tool to detect cardiac diseases and tumors, and both spatial resolution and temporal resolution are important for disease detection. Sampling less in each time frame and applying sophisticated reconstruction methods to overcome image degradations is a common strategy in the literature. In this thesis, temporal TV constrained reconstruction that was successfully applied to DCE myocardial perfusion imaging by our group was extended to three-dimensional (3D) DCE breast and 3D myocardial perfusion imaging, and the extension includes different forms of constraint terms and various sampling patterns. We also explored some other popular reconstruction algorithms from a theoretical level and showed that they can be included in a unified framework. Current 3D Cartesian DCE breast tumor imaging is limited in spatiotemporal resolution as high temporal resolution is desired to track the contrast enhancement curves, and high spatial resolution is desired to discern tumor morphology. Here temporal TV constrained reconstruction was extended and different forms of temporal TV constraints were compared on 3D Cartesian DCE breast tumor data with simulated undersampling. Kinetic parameters analysis was used to validate the methods

Super resolution and dynamic range enhancement of image sequences

Camera producers try to increase the spatial resolution of a camera by reducing size of sites on sensor array. However, shot noise causes the signal to noise ratio drop as sensor sites get smaller. This fact motivates resolution enhancement to be performed through software. Super resolution (SR) image reconstruction aims to combine degraded images of a scene in order to form an image which has higher resolution than all observations. There is a demand for high resolution images in biomedical imaging, surveillance, aerial/satellite imaging and high-definition TV (HDTV) technology. Although extensive research has been conducted in SR, attention has not been given to increase the resolution of images under illumination changes. In this study, a unique framework is proposed to increase the spatial resolution and dynamic range of a video sequence using Bayesian and Projection onto Convex Sets (POCS) methods. Incorporating camera response function estimation into image reconstruction allows dynamic range enhancement along with spatial resolution improvement. Photometrically varying input images complicate process of projecting observations onto common grid by violating brightness constancy. A contrast invariant feature transform is proposed in this thesis to register input images with high illumination variation. Proposed algorithm increases the repeatability rate of detected features among frames of a video. Repeatability rate is increased by computing the autocorrelation matrix using the gradients of contrast stretched input images. Presented contrast invariant feature detection improves repeatability rate of Harris corner detector around %25 on average. Joint multi-frame demosaicking and resolution enhancement is also investigated in this thesis. Color constancy constraint set is devised and incorporated into POCS framework for increasing resolution of color-filter array sampled images. Proposed method provides fewer demosaicking artifacts compared to existing POCS method and a higher visual quality in final image

Bilateral filter in image processing

The bilateral filter is a nonlinear filter that does spatial averaging without smoothing edges. It has shown to be an effective image denoising technique. It also can be applied to the blocking artifacts reduction. An important issue with the application of the bilateral filter is the selection of the filter parameters, which affect the results significantly. Another research interest of bilateral filter is acceleration of the computation speed. There are three main contributions of this thesis. The first contribution is an empirical study of the optimal bilateral filter parameter selection in image denoising. I propose an extension of the bilateral filter: multi resolution bilateral filter, where bilateral filtering is applied to the low-frequency sub-bands of a signal decomposed using a wavelet filter bank. The multi resolution bilateral filter is combined with wavelet thresholding to form a new image denoising framework, which turns out to be very effective in eliminating noise in real noisy images. The second contribution is that I present a spatially adaptive method to reduce compression artifacts. To avoid over-smoothing texture regions and to effectively eliminate blocking and ringing artifacts, in this paper, texture regions and block boundary discontinuities are first detected; these are then used to control/adapt the spatial and intensity parameters of the bilateral filter. The test results prove that the adaptive method can improve the quality of restored images significantly better than the standard bilateral filter. The third contribution is the improvement of the fast bilateral filter, in which I use a combination of multi windows to approximate the Gaussian filter more precisely

Limited Angle Ultrasound Tomography of the Compressed Breast

X-ray mammography is widely accepted as the clinical standard for breast cancer screening and diagnosis. However, reflection mode ultrasound has been known to outperform x-ray in screening performance in dense breasts. With newer modes of ultrasound, acoustic properties of breast tissue, such as the speed of sound and attenuation coefficient distributions, can be extracted from captured ultrasound signals and used to characterize breast tissue types and contribute to detection and diagnosis of malignancy. The same is possibly true for optical absorption via photoacoustic imaging. Recently, we have developed a dual-sided ultrasound scanner that can be integrated with existing x-ray mammographic systems and acquire images in the mammographic view and compression. Transmission imaging for speed of sound and attenuation coefficient in this geometry is termed limited angle tomography, as the beams at frequencies yielding high resolution cannot transit the long axis of the compressed breast. This approach, ideally, should facilitate the co-registration and comparisons between images from three modalities discussed here (x-ray, ultrasound and photoacoustic) and increase diagnostic detection confidence. However, potential limitations inherent in limited angle tomography have received minimal exploration up to this study, and existing imaging techniques developed for this approach are based on overly optimistic assumptions that hinder achievement of the desired image quality. This investigation of these problems should contribute valuable information to the validation and translation of the mammographically-configured, dual-sided ultrasound, or ultrasound and photoacoustic, scanner to the clinic. This dissertation first aims to extensively identify possible sources of error resulting from imaging in the limited angle tomography approach. Simulation findings mapping parametric conditions reveal that image artifacts arising in reflection mode (B-mode) can be modulated or mitigated by ultrasound gels with adequate acoustic properties. In addition, sound speed imaging was performed determining the level of significance for several key sources of error. Results suggest that imaging in transmission mode is the most sensitive to transducer misplacement in the signal propagation direction. This misplacement, however, could be minimized easily by routinely calibrating transducer positions. Next, this dissertation aims to advance speed of sound, attenuation, and photoacoustic image reconstruction algorithms for the limited angle tomography approach. This was done by utilizing both structural information of the imaged objects/tissues by means of the corresponding reflection mode images taken from the same imaging location, and a full acoustic modeling framework to account for complex acoustic interactions within the field of view. We have shown through simulations that both a priori information from reflection mode images and full acoustic modeling contribute to a noticeable improvement in the reconstructed images. Work done throughout the course of this dissertation should provide a foundation and insight necessary for improvements upon the existing dual-sided ultrasound scanner towards breast imaging in the clinic.PHDBiomedical EngineeringUniversity of Michigan, Horace H. Rackham School of Graduate Studieshttps://deepblue.lib.umich.edu/bitstream/2027.42/143944/1/rungroj_1.pd