Medical imaging analysis with artificial neural networks

Given that neural networks have been widely reported in the research community of medical imaging, we provide a focused literature survey on recent neural network developments in computer-aided diagnosis, medical image segmentation and edge detection towards visual content analysis, and medical image registration for its pre-processing and post-processing, with the aims of increasing awareness of how neural networks can be applied to these areas and to provide a foundation for further research and practical development. Representative techniques and algorithms are explained in detail to provide inspiring examples illustrating: (i) how a known neural network with fixed structure and training procedure could be applied to resolve a medical imaging problem; (ii) how medical images could be analysed, processed, and characterised by neural networks; and (iii) how neural networks could be expanded further to resolve problems relevant to medical imaging. In the concluding section, a highlight of comparisons among many neural network applications is included to provide a global view on computational intelligence with neural networks in medical imaging

Automated CT and MRI Liver Segmentation and Biometry Using a Generalized Convolutional Neural Network.

PurposeTo assess feasibility of training a convolutional neural network (CNN) to automate liver segmentation across different imaging modalities and techniques used in clinical practice and apply this to enable automation of liver biometry.MethodsWe trained a 2D U-Net CNN for liver segmentation in two stages using 330 abdominal MRI and CT exams acquired at our institution. First, we trained the neural network with non-contrast multi-echo spoiled-gradient-echo (SGPR)images with 300 MRI exams to provide multiple signal-weightings. Then, we used transfer learning to generalize the CNN with additional images from 30 contrast-enhanced MRI and CT exams.We assessed the performance of the CNN using a distinct multi-institutional data set curated from multiple sources (n = 498 subjects). Segmentation accuracy was evaluated by computing Dice scores. Utilizing these segmentations, we computed liver volume from CT and T1-weighted (T1w) MRI exams, and estimated hepatic proton- density-fat-fraction (PDFF) from multi-echo T2*w MRI exams. We compared quantitative volumetry and PDFF estimates between automated and manual segmentation using Pearson correlation and Bland-Altman statistics.ResultsDice scores were 0.94 ± 0.06 for CT (n = 230), 0.95 ± 0.03 (n = 100) for T1w MR, and 0.92 ± 0.05 for T2*w MR (n = 169). Liver volume measured by manual and automated segmentation agreed closely for CT (95% limit-of-agreement (LoA) = [-298 mL, 180 mL]) and T1w MR (LoA = [-358 mL, 180 mL]). Hepatic PDFF measured by the two segmentations also agreed closely (LoA = [-0.62%, 0.80%]).ConclusionsUtilizing a transfer-learning strategy, we have demonstrated the feasibility of a CNN to be generalized to perform liver segmentations across different imaging techniques and modalities. With further refinement and validation, CNNs may have broad applicability for multimodal liver volumetry and hepatic tissue characterization

Review on the methods of automatic liver segmentation from abdominal images

Automatic liver segmentation from abdominal images is challenging on the aspects of segmentation accuracy, automation and robustness. There exist many methods of liver segmentation and ways of categorisingthem. In this paper, we present a new way of summarizing the latest achievements in automatic liver segmentation.We categorise a segmentation method according to the image feature it works on, therefore better summarising the performance of each category and leading to finding an optimal solution for a particular segmentation task. All the methods of liver segmentation are categorized into three main classes including gray level based method, structure based method and texture based method. In each class, the latest advance is reviewed with summary comments on the advantages and drawbacks of each discussed approach. Performance comparisons among the classes are given along with the remarks on the problems existed and possible solutions. In conclusion, we point out that liver segmentation is still an open issue and the tendency is that multiple methods will be employed to-gether to achieve better segmentation performance

Liver segmentation using marker controlled watershed transform

The largest organ in the body is the liver and primarily helps in metabolism and detoxification. Liver segmentation is a crucial step in liver cancer detection in computer vision-based biomedical image analysis. Liver segmentation is a critical task and results in under-segmentation and over-segmentation due to the complex structure of abdominal computed tomography (CT) images, noise, and textural variations over the image. This paper presents liver segmentation in abdominal CT images using marker-based watershed transforms. In the pre-processing stage, a modified double stage gaussian filter (MDSGF) is used to enhance the contrast, and preserve the edge and texture information of liver CT images. Further, marker controlled watershed transform is utilized for the segmentation of liver images from the abdominal CT images. Liver segmentation using suggested MDSGF and marker-based watershed transform help to diminish the under-segmentation and over-segmentation of the liver object. The performance of the proposed system is evaluated on the LiTS dataset based on Dice score (DS), relative volume difference (RVD), volumetric overlapping error (VOE), and Jaccard index (JI). The proposed method gives (Dice score of 0.959, RVD of 0.09, VOE of 0.089, and JI of 0.921)

Medical Image Segmentation by Deep Convolutional Neural Networks

Medical image segmentation is a fundamental and critical step for medical image analysis. Due to the complexity and diversity of medical images, the segmentation of medical images continues to be a challenging problem. Recently, deep learning techniques, especially Convolution Neural Networks (CNNs) have received extensive research and achieve great success in many vision tasks. Specifically, with the advent of Fully Convolutional Networks (FCNs), automatic medical image segmentation based on FCNs is a promising research field. This thesis focuses on two medical image segmentation tasks: lung segmentation in chest X-ray images and nuclei segmentation in histopathological images. For the lung segmentation task, we investigate several FCNs that have been successful in semantic and medical image segmentation. We evaluate the performance of these different FCNs on three publicly available chest X-ray image datasets. For the nuclei segmentation task, since the challenges of this task are difficulty in segmenting the small, overlapping and touching nuclei, and limited ability of generalization to nuclei in different organs and tissue types, we propose a novel nuclei segmentation approach based on a two-stage learning framework and Deep Layer Aggregation (DLA). We convert the original binary segmentation task into a two-step task by adding nuclei-boundary prediction (3-classes) as an intermediate step. To solve our two-step task, we design a two-stage learning framework by stacking two U-Nets. The first stage estimates nuclei and their coarse boundaries while the second stage outputs the final fine-grained segmentation map. Furthermore, we also extend the U-Nets with DLA by iteratively merging features across different levels. We evaluate our proposed method on two public diverse nuclei datasets. The experimental results show that our proposed approach outperforms many standard segmentation architectures and recently proposed nuclei segmentation methods, and can be easily generalized across different cell types in various organs

Deep learning for image-based liver analysis — A comprehensive review focusing on malignant lesions

Deep learning-based methods, in particular, convolutional neural networks and fully convolutional networks are now widely used in the medical image analysis domain. The scope of this review focuses on the analysis using deep learning of focal liver lesions, with a special interest in hepatocellular carcinoma and metastatic cancer; and structures like the parenchyma or the vascular system. Here, we address several neural network architectures used for analyzing the anatomical structures and lesions in the liver from various imaging modalities such as computed tomography, magnetic resonance imaging and ultrasound. Image analysis tasks like segmentation, object detection and classification for the liver, liver vessels and liver lesions are discussed. Based on the qualitative search, 91 papers were filtered out for the survey, including journal publications and conference proceedings. The papers reviewed in this work are grouped into eight categories based on the methodologies used. By comparing the evaluation metrics, hybrid models performed better for both the liver and the lesion segmentation tasks, ensemble classifiers performed better for the vessel segmentation tasks and combined approach performed better for both the lesion classification and detection tasks. The performance was measured based on the Dice score for the segmentation, and accuracy for the classification and detection tasks, which are the most commonly used metrics.publishedVersio

Liver Segmentation and Liver Cancer Detection Based on Deep Convolutional Neural Network: A Brief Bibliometric Survey

Background: This study analyzes liver segmentation and cancer detection work, with the perspectives of machine learning and deep learning and different image processing techniques from the year 2012 to 2020. The study uses different Bibliometric analysis methods. Methods: The articles on the topic were obtained from one of the most popular databases- Scopus. The year span for the analysis is considered to be from 2012 to 2020. Scopus analyzer facilitates the analysis of the databases with different categories such as documents by source, year, and county and so on. Analysis is also done by using different units of analysis such as co-authorship, co-occurrences, citation analysis etc. For this analysis Vosviewer Version 1.6.15 is used. Results: In the study, a total of 518 articles on liver segmentation and liver cancer were obtained between the years 2012 to 2020. From the statistical analysis and network analysis it can be concluded that, the maximum articles are published in the year 2020 with China is the highest contributor followed by United States and India. Conclusions: Outcome from Scoups database is 518 articles with English language has the largest number of articles. Statistical analysis is done in terms of different parameters such as Authors, documents, country, affiliation etc. The analysis clearly indicates the potential of the topic. Network analysis of different parameters is also performed. This also indicate that there is a lot of scope for further research in terms of advanced algorithms of computer vision, deep learning and machine learning

CT liver tumor segmentation hybrid approach using neutrosophic sets, fast fuzzy c-means and adaptive watershed algorithm

Liver tumor segmentation from computed tomography (CT) images is a critical and challenging task. Due to the fuzziness in the liver pixel range, the neighboring organs of the liver with the same intensity, high noise and large variance of tumors. The segmentation process is necessary for the detection, identification, and measurement of objects in CT images. We perform an extensive review of the CT liver segmentation literature