1,872 research outputs found
Deep learning for image-based liver analysis — A comprehensive review focusing on malignant lesions
Deep learning-based methods, in particular, convolutional neural networks and fully convolutional networks are now widely used in the medical image analysis domain. The scope of this review focuses on the analysis using deep learning of focal liver lesions, with a special interest in hepatocellular carcinoma and metastatic cancer; and structures like the parenchyma or the vascular system. Here, we address several neural network architectures used for analyzing the anatomical structures and lesions in the liver from various imaging modalities such as computed tomography, magnetic resonance imaging and ultrasound. Image analysis tasks like segmentation, object detection and classification for the liver, liver vessels and liver lesions are discussed. Based on the qualitative search, 91 papers were filtered out for the survey, including journal publications and conference proceedings. The papers reviewed in this work are grouped into eight categories based on the methodologies used. By comparing the evaluation metrics, hybrid models performed better for both the liver and the lesion segmentation tasks, ensemble classifiers performed better for the vessel segmentation tasks and combined approach performed better for both the lesion classification and detection tasks. The performance was measured based on the Dice score for the segmentation, and accuracy for the classification and detection tasks, which are the most commonly used metrics.publishedVersio
Detection-aided liver lesion segmentation using deep learning
A fully automatic technique for segmenting the liver and localizing its
unhealthy tissues is a convenient tool in order to diagnose hepatic diseases
and assess the response to the according treatments. In this work we propose a
method to segment the liver and its lesions from Computed Tomography (CT) scans
using Convolutional Neural Networks (CNNs), that have proven good results in a
variety of computer vision tasks, including medical imaging. The network that
segments the lesions consists of a cascaded architecture, which first focuses
on the region of the liver in order to segment the lesions on it. Moreover, we
train a detector to localize the lesions, and mask the results of the
segmentation network with the positive detections. The segmentation
architecture is based on DRIU, a Fully Convolutional Network (FCN) with side
outputs that work on feature maps of different resolutions, to finally benefit
from the multi-scale information learned by different stages of the network.
The main contribution of this work is the use of a detector to localize the
lesions, which we show to be beneficial to remove false positives triggered by
the segmentation network. Source code and models are available at
https://imatge-upc.github.io/liverseg-2017-nipsws/ .Comment: NIPS 2017 Workshop on Machine Learning for Health (ML4H
Modeling the Intra-class Variability for Liver Lesion Detection using a Multi-class Patch-based CNN
Automatic detection of liver lesions in CT images poses a great challenge for
researchers. In this work we present a deep learning approach that models
explicitly the variability within the non-lesion class, based on prior
knowledge of the data, to support an automated lesion detection system. A
multi-class convolutional neural network (CNN) is proposed to categorize input
image patches into sub-categories of boundary and interior patches, the
decisions of which are fused to reach a binary lesion vs non-lesion decision.
For validation of our system, we use CT images of 132 livers and 498 lesions.
Our approach shows highly improved detection results that outperform the
state-of-the-art fully convolutional network. Automated computerized tools, as
shown in this work, have the potential in the future to support the
radiologists towards improved detection.Comment: To be presented at PatchMI: 3rd International Workshop on Patch-based
Techniques in Medical Imaging, MICCAI 201
3D Anisotropic Hybrid Network: Transferring Convolutional Features from 2D Images to 3D Anisotropic Volumes
While deep convolutional neural networks (CNN) have been successfully applied
for 2D image analysis, it is still challenging to apply them to 3D anisotropic
volumes, especially when the within-slice resolution is much higher than the
between-slice resolution and when the amount of 3D volumes is relatively small.
On one hand, direct learning of CNN with 3D convolution kernels suffers from
the lack of data and likely ends up with poor generalization; insufficient GPU
memory limits the model size or representational power. On the other hand,
applying 2D CNN with generalizable features to 2D slices ignores between-slice
information. Coupling 2D network with LSTM to further handle the between-slice
information is not optimal due to the difficulty in LSTM learning. To overcome
the above challenges, we propose a 3D Anisotropic Hybrid Network (AH-Net) that
transfers convolutional features learned from 2D images to 3D anisotropic
volumes. Such a transfer inherits the desired strong generalization capability
for within-slice information while naturally exploiting between-slice
information for more effective modelling. The focal loss is further utilized
for more effective end-to-end learning. We experiment with the proposed 3D
AH-Net on two different medical image analysis tasks, namely lesion detection
from a Digital Breast Tomosynthesis volume, and liver and liver tumor
segmentation from a Computed Tomography volume and obtain the state-of-the-art
results
Liver lesion segmentation informed by joint liver segmentation
We propose a model for the joint segmentation of the liver and liver lesions
in computed tomography (CT) volumes. We build the model from two fully
convolutional networks, connected in tandem and trained together end-to-end. We
evaluate our approach on the 2017 MICCAI Liver Tumour Segmentation Challenge,
attaining competitive liver and liver lesion detection and segmentation scores
across a wide range of metrics. Unlike other top performing methods, our model
output post-processing is trivial, we do not use data external to the
challenge, and we propose a simple single-stage model that is trained
end-to-end. However, our method nearly matches the top lesion segmentation
performance and achieves the second highest precision for lesion detection
while maintaining high recall.Comment: Late upload of conference version (ISBI
A Survey on Deep Learning in Medical Image Analysis
Deep learning algorithms, in particular convolutional networks, have rapidly
become a methodology of choice for analyzing medical images. This paper reviews
the major deep learning concepts pertinent to medical image analysis and
summarizes over 300 contributions to the field, most of which appeared in the
last year. We survey the use of deep learning for image classification, object
detection, segmentation, registration, and other tasks and provide concise
overviews of studies per application area. Open challenges and directions for
future research are discussed.Comment: Revised survey includes expanded discussion section and reworked
introductory section on common deep architectures. Added missed papers from
before Feb 1st 201
- …