PCTV: A biologically- and psychologically-inspired edge and line detection

A novel method for detecting edges and lines simultaneously and automatically is proposed. This method, based on phase congruency and tensor voting (hence PCTV), makes use of the properties of how edges and lines are built from the Fourier decomposition of an image, and how the primary visual cortex responds to them, instead of making assumptions on the intensity profiles of the regions near a feature. Experiments showed that the detection results were more consistent to the "ground truth" manually drawn by humans. For detecting edges, this method is superior to three commonly used detectors in that it reduces the production of false detections. © 2010 IEEE.published_or_final_versionThe 17th IEEE International Conference on Image Processing (ICIP 2010), Hong Kong, 26-29 September 2010. In Proceedings of the 17th IEEE ICIP, 2010, p. 1621-162

Semantic Assisted, Multiresolution Image Retrieval in 3D Brain MR Volumes

Content Based Image Retrieval (CBIR) is an important research area in the field of multimedia information retrieval. The application of CBIR in the medical domain has been attempted before, however the use of CBIR in medical diagnostics is a daunting task. The goal of diagnostic medical image retrieval is to provide diagnostic support by displaying relevant past cases, along with proven pathologies as ground truths. Moreover, medical image retrieval can be extremely useful as a training tool for medical students and residents, follow-up studies, and for research purposes. Despite the presence of an impressive amount of research in the area of CBIR, its acceptance for mainstream and practical applications is quite limited. The research in CBIR has mostly been conducted as an academic pursuit, rather than for providing the solution to a need. For example, many researchers proposed CBIR systems where the image database consists of images belonging to a heterogeneous mixture of man-made objects and natural scenes while ignoring the practical uses of such systems. Furthermore, the intended use of CBIR systems is important in addressing the problem of "Semantic Gap". Indeed, the requirements for the semantics in an image retrieval system for pathological applications are quite different from those intended for training and education. Moreover, many researchers have underestimated the level of accuracy required for a useful and practical image retrieval system. The human eye is extremely dexterous and efficient in visual information processing; consequently, CBIR systems should be highly precise in image retrieval so as to be useful to human users. Unsurprisingly, due to these and other reasons, most of the proposed systems have not found useful real world applications. In this dissertation, an attempt is made to address the challenging problem of developing a retrieval system for medical diagnostics applications. More specifically, a system for semantic retrieval of Magnetic Resonance (MR) images in 3D brain volumes is proposed. The proposed retrieval system has a potential to be useful for clinical experts where the human eye may fail. Previously proposed systems used imprecise segmentation and feature extraction techniques, which are not suitable for precise matching requirements of the image retrieval in this application domain. This dissertation uses multiscale representation for image retrieval, which is robust against noise and MR inhomogeneity. In order to achieve a higher degree of accuracy in the presence of misalignments, an image registration based retrieval framework is developed. Additionally, to speed-up the retrieval system, a fast discrete wavelet based feature space is proposed. Further improvement in speed is achieved by semantically classifying of the human brain into various "Semantic Regions", using an SVM based machine learning approach. A novel and fast identification system is proposed for identifying a 3D volume given a 2D image slice. To this end, we used SVM output probabilities for ranking and identification of patient volumes. The proposed retrieval systems are tested not only for noise conditions but also for healthy and abnormal cases, resulting in promising retrieval performance with respect to multi-modality, accuracy, speed and robustness. This dissertation furnishes medical practitioners with a valuable set of tools for semantic retrieval of 2D images, where the human eye may fail. Specifically, the proposed retrieval algorithms provide medical practitioners with the ability to retrieve 2D MR brain images accurately and monitor the disease progression in various lobes of the human brain, with the capability to monitor the disease progression in multiple patients simultaneously. Additionally, the proposed semantic classification scheme can be extremely useful for semantic based categorization, clustering and annotation of images in MR brain databases. This research framework may evolve in a natural progression towards developing more powerful and robust retrieval systems. It also provides a foundation to researchers in semantic based retrieval systems on how to expand existing toolsets for solving retrieval problems

Alzheimer's Disease Diagnosis Using Landmark-Based Features From Longitudinal Structural MR Images

Structural magnetic resonance imaging (MRI) has been proven to be an effective tool for Alzheimer’s disease (AD) diagnosis. While conventional MRI-based AD diagnosis typically uses images acquired at a single time point, a longitudinal study is more sensitive in detecting early pathological changes of AD, making it more favorable for accurate diagnosis. In general, there are two challenges faced in MRI-based diagnosis. First, extracting features from structural MR images requires time-consuming nonlinear registration and tissue segmentation, whereas the longitudinal study with involvement of more scans further exacerbates the computational costs. Moreover, the inconsistent longitudinal scans (i.e., different scanning time points and also the total number of scans) hinder extraction of unified feature representations in longitudinal studies. In this paper, we propose a landmark-based feature extraction method for AD diagnosis using longitudinal structural MR images, which does not require nonlinear registration or tissue segmentation in the application stage and is also robust to inconsistencies among longitudinal scans. Specifically, 1) the discriminative landmarks are first automatically discovered from the whole brain using training images, and then efficiently localized using a fast landmark detection method for testing images, without the involvement of any nonlinear registration and tissue segmentation; 2) high-level statistical spatial features and contextual longitudinal features are further extracted based on those detected landmarks, which can characterize spatial structural abnormalities and longitudinal landmark variations. Using these spatial and longitudinal features, a linear support vector machine (SVM) is finally adopted to distinguish AD subjects or mild cognitive impairment (MCI) subjects from healthy controls (HCs). Experimental results on the ADNI database demonstrate the superior performance and efficiency of the proposed method, with classification accuracies of 88.30% for AD vs. HC and 79.02% for MCI vs. HC, respectively

Alzheimer's disease early detection from sparse data using brain importance maps

Statistical methods are increasingly used in the analysis of FDG-PET images for the early diagnosis of Alzheimer's disease. We will present a method to extract information about the location of metabolic changes induced by Alzheimer's disease based on a machine learning approach that directly links features and brain areas to search for regions of interest (ROIs). This approach has the advantage over voxel-wise statistics to also consider the interactions between the features/voxels. We produce "maps" to visualize the most informative regions of the brain and compare the maps created by our approach with voxel-wise statistics. In classification experiments, using the extracted map, we achieved classification rates of up to 95.5%

Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application

Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most

Statistical shape analysis of neuroanatomical structures based on spherical wavelet transformation

Thesis (Ph. D.)--Harvard-MIT Division of Health Sciences and Technology, 2008.Includes bibliographical references.Evidence suggests that morphological changes of neuroanatomical structures may reflect abnormalities in neurodevelopment, or relate to a variety of disorders, such as schizophrenia and Alzheimer's disease (AD). Advances in high-resolution Magnetic Resonance Imaging (MRI) techniques allow us to study these alterations of brain structures in vivo. Previous work in studying the shape variations of brain structures has provided additional localized information compared with traditional volume-based study. However, challenges remain in finding an accurate shape presentation and conducting shape analysis with sound statistical principles. In this work, we develop methods for automatically extracting localized and multi-scale shape features and conducting statistical shape analysis of neuroanatomical structures obtained from MR images. We first develop a procedure to extract multi-scale shape features of brain structures using biorthogonal spherical wavelets. Using this wavelet-based shape representation, we build multi-scale shape models and study the localized cortical folding variations in a normal population using Principal Component Analysis (PCA). We then build a shape-based classification framework for detecting pathological changes of cortical surfaces using advanced classification methods, such as predictive Automatic Relevance Determination (pred-ARD), and demonstrate promising results in patient/control group comparison studies. Thirdly, we develop a nonlinear temporal model for studying the temporal order and regional difference of cortical folding development based on this shape representation. Furthermore, we develop a shape-guided segmentation method to improve the segmentation of sub-cortical structures, such as hippocampus, by using shape constraints obtained in the wavelet domain.(cont.) Finally, we improve upon the proposed wavelet-based shape representation by adopting a newly developed over-complete spherical wavelet transformation and demonstrate its utility in improving the accuracy and stability of shape representations. By using these shape representations and statistical analysis methods, we have demonstrated promising results in localizing shape changes of neuroanatomical structures related to aging, neurological diseases, and neurodevelopment at multiple spatial scales. Identification of these shape changes could potentially lead to more accurate diagnoses and improved understanding of neurodevelopment and neurological diseases.by Peng Yu.Ph.D

Cognitive abstraction approach to sketch-based image retrieval

Thesis (S.B. and M.Eng.)--Massachusetts Institute of Technology, Dept. of Electrical Engineering and Computer Science, 1999.Includes bibliographical references (leaves 151-157).This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.As digital media become more popular, corporations and individuals gather an increasingly large number of digital images. As a collection grows to more than a few hundred images, the need for search becomes crucial. This thesis is addressing the problem of retrieving from a small database a particular image previously seen by the user. This thesis combines current findings in cognitive science with the knowledge of previous image retrieval systems to present a novel approach to content based image retrieval and indexing. We focus on algorithms which abstract away information from images in the same terms that a viewer abstracts information from an image. The focus in Imagina is on the matching of regions, instead of the matching of global measures. Multiple representations, focusing on shape and color, are used for every region. The matches of individual regions are combined using a saliency metric that accounts for differences in the distributions of metrics. Region matching along with configuration determines the overall match between a query and an image.by Manolis Kamvysselis and Ovidiu Marina.S.B.and M.Eng