Improving medical image perception by hierarchical clustering based segmentation

It has been well documented that radiologists' performance is not perfect: they make both false positive and false negative decisions. For example, approximately thirty percent of early lung cancer is missed on chest radiographs when the evidence is clearly visible in retrospect. Currently computer-aided detection (CAD) uses software, designed to reduce errors by drawing radiologists' attention to possible abnormalities by placing prompts on images. Alberdi et al examined the effects of CAD prompts on performance, comparing the negative effect of no prompt on a cancer case with prompts on a normal case. They showed that no prompt on a cancer case can have a detrimental effect on reader sensitivity and that the reader performs worse than if the reader was not using CAD. This became particularly apparent when difficult cases were being read. They suggested that the readers were using CAD as a decision making tool instead of a prompting aid. They conclude that "incorrect CAD can have a detrimental effect on human decisions". The goal of this paper is to explore the possibility of using hierarchical clustering based segmentation (HSC), as a perceptual aid, to improve the performance of the reader

Medical imaging analysis with artificial neural networks

Given that neural networks have been widely reported in the research community of medical imaging, we provide a focused literature survey on recent neural network developments in computer-aided diagnosis, medical image segmentation and edge detection towards visual content analysis, and medical image registration for its pre-processing and post-processing, with the aims of increasing awareness of how neural networks can be applied to these areas and to provide a foundation for further research and practical development. Representative techniques and algorithms are explained in detail to provide inspiring examples illustrating: (i) how a known neural network with fixed structure and training procedure could be applied to resolve a medical imaging problem; (ii) how medical images could be analysed, processed, and characterised by neural networks; and (iii) how neural networks could be expanded further to resolve problems relevant to medical imaging. In the concluding section, a highlight of comparisons among many neural network applications is included to provide a global view on computational intelligence with neural networks in medical imaging

Improving medical image perception by hierarchical clustering based segmentation

It has been well documented that radiologists' performance is not perfect: they make both false positive and false negative decisions. For example, approximately thirty percent of early lung cancer is missed on chest radiographs when the evidence is clearly visible in retrospect [1]. Currently Computer-Aided Detection (CAD) uses software, designed to reduce errors by drawing radiologists' attention to possible abnormalities by placing prompts on images. Alberdi et al examined the effects of CAD prompts on performance, comparing the negative effect of no prompt on a cancer case with prompts on a normal case. They showed that no prompt on a cancer case can have a detrimental effect on reader sensitivity and that the reader performs worse than if the reader was not using CAD. This became particularly apparent when difficult cases were being read. They suggested that the readers were using CAD as a decision making tool instead of a prompting aid. They conclude that "incorrect CAD can have a detrimental effect on human decisions" [2]. The goal of this paper is to explore the possibility of using Hierarchical Clustering based Segmentation (HCS) [3], as a perceptual aid, to improve the performance of the reader

Feature-driven Volume Visualization of Medical Imaging Data

Direct volume rendering (DVR) is a volume visualization technique that has been proved to be a very powerful tool in many scientific visualization domains. Diagnostic medical imaging is one such domain in which DVR provides new capabilities for the analysis of complex cases and improves the efficiency of image interpretation workflows. However, the full potential of DVR in the medical domain has not yet been realized. A major obstacle for a better integration of DVR in the medical domain is the time-consuming process to optimize the rendering parameters that are needed to generate diagnostically relevant visualizations in which the important features that are hidden in image volumes are clearly displayed, such as shape and spatial localization of tumors, its relationship with adjacent structures, and temporal changes in the tumors. In current workflows, clinicians must manually specify the transfer function (TF), view-point (camera), clipping planes, and other visual parameters. Another obstacle for the adoption of DVR to the medical domain is the ever increasing volume of imaging data. The advancement of imaging acquisition techniques has led to a rapid expansion in the size of the data, in the forms of higher resolutions, temporal imaging acquisition to track treatment responses over time, and an increase in the number of imaging modalities that are used for a single procedure. The manual specification of the rendering parameters under these circumstances is very challenging. This thesis proposes a set of innovative methods that visualize important features in multi-dimensional and multi-modality medical images by automatically or semi-automatically optimizing the rendering parameters. Our methods enable visualizations necessary for the diagnostic procedure in which 2D slice of interest (SOI) can be augmented with 3D anatomical contextual information to provide accurate spatial localization of 2D features in the SOI; the rendering parameters are automatically computed to guarantee the visibility of 3D features; and changes in 3D features can be tracked in temporal data under the constraint of consistent contextual information. We also present a method for the efficient computation of visibility histograms (VHs) using adaptive binning, which allows our optimal DVR to be automated and visualized in real-time. We evaluated our methods by producing visualizations for a variety of clinically relevant scenarios and imaging data sets. We also examined the computational performance of our methods for these scenarios

Feature-driven Volume Visualization of Medical Imaging Data

Direct volume rendering (DVR) is a volume visualization technique that has been proved to be a very powerful tool in many scientific visualization domains. Diagnostic medical imaging is one such domain in which DVR provides new capabilities for the analysis of complex cases and improves the efficiency of image interpretation workflows. However, the full potential of DVR in the medical domain has not yet been realized. A major obstacle for a better integration of DVR in the medical domain is the time-consuming process to optimize the rendering parameters that are needed to generate diagnostically relevant visualizations in which the important features that are hidden in image volumes are clearly displayed, such as shape and spatial localization of tumors, its relationship with adjacent structures, and temporal changes in the tumors. In current workflows, clinicians must manually specify the transfer function (TF), view-point (camera), clipping planes, and other visual parameters. Another obstacle for the adoption of DVR to the medical domain is the ever increasing volume of imaging data. The advancement of imaging acquisition techniques has led to a rapid expansion in the size of the data, in the forms of higher resolutions, temporal imaging acquisition to track treatment responses over time, and an increase in the number of imaging modalities that are used for a single procedure. The manual specification of the rendering parameters under these circumstances is very challenging. This thesis proposes a set of innovative methods that visualize important features in multi-dimensional and multi-modality medical images by automatically or semi-automatically optimizing the rendering parameters. Our methods enable visualizations necessary for the diagnostic procedure in which 2D slice of interest (SOI) can be augmented with 3D anatomical contextual information to provide accurate spatial localization of 2D features in the SOI; the rendering parameters are automatically computed to guarantee the visibility of 3D features; and changes in 3D features can be tracked in temporal data under the constraint of consistent contextual information. We also present a method for the efficient computation of visibility histograms (VHs) using adaptive binning, which allows our optimal DVR to be automated and visualized in real-time. We evaluated our methods by producing visualizations for a variety of clinically relevant scenarios and imaging data sets. We also examined the computational performance of our methods for these scenarios

Techniques and software tool for 3D multimodality medical image segmentation

The era of noninvasive diagnostic radiology and image-guided radiotherapy has witnessed burgeoning interest in applying different imaging modalities to stage and localize complex diseases such as atherosclerosis or cancer. It has been observed that using complementary information from multimodality images often significantly improves the robustness and accuracy of target volume definitions in radiotherapy treatment of cancer. In this work, we present techniques and an interactive software tool to support this new framework for 3D multimodality medical image segmentation. To demonstrate this methodology, we have designed and developed a dedicated open source software tool for multimodality image analysis MIASYS. The software tool aims to provide a needed solution for 3D image segmentation by integrating automatic algorithms, manual contouring methods, image preprocessing filters, post-processing procedures, user interactive features and evaluation metrics. The presented methods and the accompanying software tool have been successfully evaluated for different radiation therapy and diagnostic radiology applications

Computer-aided classification of liver lesions from CT images based on multiple ROI

This manuscript introduces an automated Computer-Aided Classification (CAD) system to classify liver lesion into Benign or Malignant. The system consists of three stages; firstly, automatic liver segmentation and lesion’s detection. Secondly, extracting features from Multiple ROI, which is the novelty. Finally, classifying liver lesions into benign and malignant. The proposed system divides a segmented lesion into three areas, i.e. inside, outside and border areas. This is because the inside lesion, boundary, and surrounding lesion area contribute different information about the lesion. The features are extracted from the three areas and used to build a new feature vector to feed a classifier. The novelty lies in using the features from the multiple ROIs, and particularly surrounding area (outside), because the Malignant lesion affects the surrounding area differently compared to, the Benign lesion. Utilising the features from inside, border, and outside lesion area supports in better differentiation between benign and malignant lesion. The experimental results showed an enhancement in the classification accuracy (using multiple ROI technique) compared to the accuracy using a single ROI