Noise-Enhanced and Human Visual System-Driven Image Processing: Algorithms and Performance Limits

This dissertation investigates the problem of image processing based on stochastic resonance (SR) noise and human visual system (HVS) properties, where several novel frameworks and algorithms for object detection in images, image enhancement and image segmentation as well as the method to estimate the performance limit of image segmentation algorithms are developed. Object detection in images is a fundamental problem whose goal is to make a decision if the object of interest is present or absent in a given image. We develop a framework and algorithm to enhance the detection performance of suboptimal detectors using SR noise, where we add a suitable dose of noise into the original image data and obtain the performance improvement. Micro-calcification detection is employed in this dissertation as an illustrative example. The comparative experiments with a large number of images verify the efficiency of the presented approach. Image enhancement plays an important role and is widely used in various vision tasks. We develop two image enhancement approaches. One is based on SR noise, HVS-driven image quality evaluation metrics and the constrained multi-objective optimization (MOO) technique, which aims at refining the existing suboptimal image enhancement methods. Another is based on the selective enhancement framework, under which we develop several image enhancement algorithms. The two approaches are applied to many low quality images, and they outperform many existing enhancement algorithms. Image segmentation is critical to image analysis. We present two segmentation algorithms driven by HVS properties, where we incorporate the human visual perception factors into the segmentation procedure and encode the prior expectation on the segmentation results into the objective functions through Markov random fields (MRF). Our experimental results show that the presented algorithms achieve higher segmentation accuracy than many representative segmentation and clustering algorithms available in the literature. Performance limit, or performance bound, is very useful to evaluate different image segmentation algorithms and to analyze the segmentability of the given image content. We formulate image segmentation as a parameter estimation problem and derive a lower bound on the segmentation error, i.e., the mean square error (MSE) of the pixel labels considered in our work, using a modified Cramér-Rao bound (CRB). The derivation is based on the biased estimator assumption, whose reasonability is verified in this dissertation. Experimental results demonstrate the validity of the derived bound

Computer aided detection in mammography

Tese de mestrado integrado. Engenharia Electrotécnica e de Computadores. Faculdade de Engenharia. Universidade do Porto. 201

Visibility recovery on images acquired in attenuating media. Application to underwater, fog, and mammographic imaging

136 p.When acquired in attenuating media, digital images of ten suffer from a particularly complex degradation that reduces their visual quality, hindering their suitability for further computational applications, or simply decreasing the visual pleasan tness for the user. In these cases, mathematical image processing reveals it self as an ideal tool to recover some of the information lost during the degradation process. In this dissertation,we deal with three of such practical scenarios in which this problematic is specially relevant, namely, underwater image enhancement, fogremoval and mammographic image processing. In the case of digital mammograms,X-ray beams traverse human tissue, and electronic detectorscapture them as they reach the other side. However, the superposition on a bidimensional image of three-dimensional structures produces low contraste dimages in which structures of interest suffer from a diminished visibility, obstructing diagnosis tasks. Regarding fog removal, the loss of contrast is produced by the atmospheric conditions, and white colour takes over the scene uniformly as distance increases, also reducing visibility.For underwater images, there is an added difficulty, since colour is not lost uniformly; instead, red colours decay the fastest, and green and blue colours typically dominate the acquired images. To address all these challenges,in this dissertation we develop new methodologies that rely on: a)physical models of the observed degradation, and b) the calculus of variations.Equipped with this powerful machinery, we design novel theoreticaland computational tools, including image-dependent functional energies that capture the particularities of each degradation model. These energie sare composed of different integral terms that are simultaneous lyminimized by means of efficient numerical schemes, producing a clean,visually-pleasant and use ful output image, with better contrast and increased visibility. In every considered application, we provide comprehensive qualitative (visual) and quantitative experimental results to validateour methods, confirming that the developed techniques out perform other existing approaches in the literature

Hierarchical Cluster Analysis to Aid Diagnostic Image Data Visualization of MS and Other Medical Imaging Modalities

Perceiving abnormal regions in the images of different medical modalities plays a crucial role in diagnosis and subsequent treatment planning. In medical images to visually perceive abnormalities’ extent and boundaries requires substantial experience. Consequently, manually drawn region of interest (ROI) to outline boundaries of abnormalities suffers from limitations of human perception leading to inter-observer variability. As an alternative to human drawn ROI, it is proposed the use of a computer-based segmenta- tion algorithm to segment digital medical image data. Hierarchical Clustering-based Segmentation (HCS) process is a generic unsupervised segmentation process that can be used to segment dissimilar regions in digital images. HCS process generates a hierarchy of segmented images by partitioning an image into its constituent regions at hierarchical levels of allowable dissimilarity between its different regions. The hierarchy represents the continuous merging of similar, spatially adjacent, and/or disjoint regions as the allowable threshold value of dissimilarity between regions, for merging, is gradually increased. This chapter discusses in detail first the implementation of the HCS process, second the implementa- tion details of how the HCS process is used for the presentation of multi-modal imaging data (MALDI and MRI) of a biological sample, third the implementation details of how the process is used as a perception aid for X-ray mammogram readers, and finally the implementation details of how it is used as an interpreta- tion aid for the interpretation of Multi-parametric Magnetic Resonance Imaging (mpMRI) of the Prostate

Hierarchical Cluster Analysis to Aid Diagnostic Image Data Visualization of MS and Other Medical Imaging Modalities

Perceiving abnormal regions in the images of different medical modalities plays a crucial role in diagnosis and subsequent treatment planning. In medical images to visually perceive abnormalities’ extent and boundaries requires substantial experience. Consequently, manually drawn region of interest (ROI) to outline boundaries of abnormalities suffers from limitations of human perception leading to inter-observer variability. As an alternative to human drawn ROI, it is proposed the use of a computer-based segmenta- tion algorithm to segment digital medical image data. Hierarchical Clustering-based Segmentation (HCS) process is a generic unsupervised segmentation process that can be used to segment dissimilar regions in digital images. HCS process generates a hierarchy of segmented images by partitioning an image into its constituent regions at hierarchical levels of allowable dissimilarity between its different regions. The hierarchy represents the continuous merging of similar, spatially adjacent, and/or disjoint regions as the allowable threshold value of dissimilarity between regions, for merging, is gradually increased. This chapter discusses in detail first the implementation of the HCS process, second the implementa- tion details of how the HCS process is used for the presentation of multi-modal imaging data (MALDI and MRI) of a biological sample, third the implementation details of how the process is used as a perception aid for X-ray mammogram readers, and finally the implementation details of how it is used as an interpreta- tion aid for the interpretation of Multi-parametric Magnetic Resonance Imaging (mpMRI) of the Prostate

Evaluation of a Multi-Scale Enhancement Protocol for Digital Mammography

We have carried out a receiver operating characteristics (ROC) study for the enhancement of mammographic features in digitized mammograms. The study evaluated the benefits of multi-scale enhancement methods in terms of diagnostic performance of radiologists. The enhancement protocol relied on multi-scale expansions and non-linear enhancement functions. Dyadic spline wavelet functions (first derivative of a cubic spline) were used together with a sigmoidal non-linear enhancement function. We designed a computer interface on a softcopy display and performed an ROC study with three radiologists, who specialized in mammography. Clinical cases were obtained from a national mammography database of digitized radiographs prepared by the University of South Florida (USF) and Harvard Medical School. Our study focused on dense mammograms, i.e. mammograms of density 3 and 4 on the American College of Radiology (ACR) breast density rating, which are the most difficult cases in screening, were selected. To compare the performance of radiologists with and without using multi-scale enhancement, two groups of 30 cases each were diagnosed. Each group contained 15 cases of cancerous and 15 cases of normal mammograms. Conventional ROC analysis was applied, and the resulting ROC curves indicated improved diagnostic performance when radiologists used multi-scale non-linear enhancement

Detecting microcalcification clusters in digital mammograms: Study for inclusion into computer aided diagnostic prompting system

Among signs of breast cancer encountered in digital mammograms radiologists point to microcalcification clusters (MCCs). Their detection is a challenging problem from both medical and image processing point of views. This work presents two concurrent methods for MCC detection, and studies their possible inclusion to a computer aided diagnostic prompting system. One considers Wavelet Domain Hidden Markov Tree (WHMT) for modeling microcalcification edges. The model is used for differentiation between MC and non-MC edges based on the weighted maximum likelihood (WML) values. The classification of objects is carried out using spatial filters. The second method employs SUSAN edge detector in the spatial domain for mammogram segmentation. Classification of objects as calcifications is carried out using another set of spatial filters and Feedforward Neural Network (NN). A same distance filter is employed in both methods to find true clusters. The analysis of two methods is performed on 54 image regions from the mammograms selected randomly from DDSM database, including benign and cancerous cases as well as cases which can be classified as hard cases from both radiologists and the computer perspectives. WHMT/WML is able to detect 98.15% true positive (TP) MCCs under 1.85% of false positives (FP), whereas the SUSAN/NN method achieves 94.44% of TP at the cost of 1.85% for FP. The comparison of these two methods suggests WHMT/WML for the computer aided diagnostic prompting. It also certifies the low false positive rates for both methods, meaning less biopsy tests per patient

Automated evaluation of radiodensities in a digitized mammogram database using local contrast estimation

Mammographic radiodensity is one of the strongest risk factors for developing breast cancer and there exists an urgent need to develop automated methods for predicting this marker. Previous attempts for automatically identifying and quantifying radiodense tissue in digitized mammograms have fallen short of the ideal. Many algorithms require significant heuristic parameters to be evaluated and set for predicting radiodensity. Many others have not demonstrated the efficacy of their techniques with a sufficient large and diverse patient database. This thesis has attempted to address both of these drawbacks in previous work. Novel automated digital image processing algorithms are proposed that have demonstrated the ability to rapidly sift through digitized mammogram databases for accurately estimating radiodensity. A judicious combination of point-processing, statistical, neural and contrast enhancement techniques have been employed for addressing this formidable problem. The algorithms have been developed and exercised using over 700 mammograms obtained from multiple age and ethnic groups and digitized using more than one type of X-ray digitizer. The automated algorithms developed in this thesis have been validated by comparing the estimation results using 40 of these mammograms with those predicted by a previously established manual segmentation technique. The automated algorithms developed in this thesis show considerable promise to be extremely useful in epidemiological studies when correlating other behavioral and genetic risk factors with mammographic radiodensity

Comparison of GLCM and First Order Feature Extraction Methods for Classification of Mammogram Images

Breast cancer is one of the main causes of death in women and ranks first in cancer cases in Indonesia. Therefore, an early detection and prevention of breast cancer is necessary, one of which is through mammography procedures. A machine learning classifier such as Support Vector Machines (SVM) could be used as an aid to the doctors and radiologist in diagnosing breast cancer from the mammogram images. The aim of this paper is to compare two feature extraction methods used in SVM, namely the Gray Level Co-Occurrence Matrix (GLCM) and first order with two kernels for each method, namely Gaussian and Polynomial. Classification using SVM method is carried out by testing several parameters such as the value of C, gamma, degree and varying the pixel spacing values ​​in GLCM, which usually in previous studies only used the default pixel spacing. The dataset consists of 500 mammogram images containing 250 benign and malignant images, respectively. This study is expected to find out the best method with the highest accuracy between these two texture feature extractions and and able to distinguish between benign and malignant classes correctly. The result achieved that Gray Level Co-Occurrence Matrix (GLCM) feature extraction method with both Gaussian and Polynomial kernel yields the best performance with an accuracy of 89%

Hybrid Discrete Wavelet Transform and Gabor Filter Banks Processing for Features Extraction from Biomedical Images

A new methodology for automatic feature extraction from biomedical images and subsequent classification is presented. The approach exploits the spatial orientation of high-frequency textural features of the processed image as determined by a two-step process. First, the two-dimensional discrete wavelet transform(DWT) is applied to obtain the HH high-frequency subband image. Then, a Gabor filter bank is applied to the latter at different frequencies and spatial orientations to obtain new Gabor-filtered image whose entropy and uniformity are computed. Finally, the obtained statistics are fed to a support vector machine (SVM) binary classifier. The approach was validated on mammograms, retina, and brain magnetic resonance (MR) images.The obtained classification accuracies show better performance in comparison to common approaches that use only the DWT or Gabor filter banks for feature extraction