1,489 research outputs found
Semantic Segmentation of Skin Lesions using a Small Data Set
Early detection of melanoma is difficult for the human eye but a crucial step
towards reducing its death rate. Computerized detection of these melanoma and
other skin lesions is necessary. The central research question in this paper is
"How to segment skin lesion images using a neural network with low available
data?". This question is divided into three sub questions regarding best
performing network structure, training data and training method. First theory
associated with these questions is discussed. Literature states that U-net CNN
structures have excellent performances on the segmentation task, more training
data increases network performance and utilizing transfer learning enables
networks to generalize to new data better.
To validate these findings in the literature two experiments are conducted.
The first experiment trains a network on data sets of different size. The
second experiment proposes twelve network structures and trains them on the
same data set. The experimental results support the findings in the literature.
The FCN16 and FCN32 networks perform best in the accuracy, intersection over
union and mean BF1 Score metric. Concluding from these results the skin lesion
segmentation network is a fully convolutional structure with a skip
architecture and an encoder depth of either one or two. Weights of this network
should be initialized using transfer learning from the pre trained VGG16
network. Training data should be cropped to reduce complexity and augmented
during training to reduce the likelihood of overfitting.Comment: 26 page
Automatic Lesion Boundary Segmentation in Dermoscopic Images with Ensemble Deep Learning Methods
Early detection of skin cancer, particularly melanoma, is crucial to enable
advanced treatment. Due to the rapid growth in the numbers of skin cancers,
there is a growing need of computerized analysis for skin lesions. The
state-of-the-art public available datasets for skin lesions are often
accompanied with very limited amount of segmentation ground truth labeling as
it is laborious and expensive. The lesion boundary segmentation is vital to
locate the lesion accurately in dermoscopic images and lesion diagnosis of
different skin lesion types. In this work, we propose the use of fully
automated deep learning ensemble methods for accurate lesion boundary
segmentation in dermoscopic images. We trained the Mask-RCNN and DeepLabv3+
methods on ISIC-2017 segmentation training set and evaluate the performance of
the ensemble networks on ISIC-2017 testing set. Our results showed that the
best proposed ensemble method segmented the skin lesions with Jaccard index of
79.58% for the ISIC-2017 testing set. The proposed ensemble method outperformed
FrCN, FCN, U-Net, and SegNet in Jaccard Index by 2.48%, 7.42%, 17.95%, and
9.96% respectively. Furthermore, the proposed ensemble method achieved an
accuracy of 95.6% for some representative clinically benign cases, 90.78% for
the melanoma cases, and 91.29% for the seborrheic keratosis cases on ISIC-2017
testing set, exhibiting better performance than FrCN, FCN, U-Net, and SegNet.Comment: 7 pages, 8 figures and 4 tables. arXiv admin note: text overlap with
arXiv:1711.1044
Multi-class Semantic Segmentation of Skin Lesions via Fully Convolutional Networks
Melanoma is clinically difficult to distinguish from common benign skin
lesions, particularly melanocytic naevus and seborrhoeic keratosis. The
dermoscopic appearance of these lesions has huge intra-class variations and
high inter-class visual similarities. Most current research is focusing on
single-class segmentation irrespective of classes of skin lesions. In this
work, we evaluate the performance of deep learning on multi-class segmentation
of ISIC-2017 challenge dataset, which consists of 2,750 dermoscopic images. We
propose an end-to-end solution using fully convolutional networks (FCNs) for
multi-class semantic segmentation to automatically segment the melanoma,
seborrhoeic keratosis and naevus. To improve the performance of FCNs, transfer
learning and a hybrid loss function are used. We evaluate the performance of
the deep learning segmentation methods for multi-class segmentation and lesion
diagnosis (with post-processing method) on the testing set of the ISIC-2017
challenge dataset. The results showed that the two-tier level transfer learning
FCN-8s achieved the overall best result with \textit{Dice} score of 78.5% in a
naevus category, 65.3% in melanoma, and 55.7% in seborrhoeic keratosis in
multi-class segmentation and Accuracy of 84.62% for recognition of melanoma in
lesion diagnosis.Comment: Comp2clinic workshop at Biostec 202
Less is More: Sample Selection and Label Conditioning Improve Skin Lesion Segmentation
Segmenting skin lesions images is relevant both for itself and for assisting
in lesion classification, but suffers from the challenge in obtaining annotated
data. In this work, we show that segmentation may improve with less data, by
selecting the training samples with best inter-annotator agreement, and
conditioning the ground-truth masks to remove excessive detail. We perform an
exhaustive experimental design considering several sources of variation,
including three different test sets, two different deep-learning architectures,
and several replications, for a total of 540 experimental runs. We found that
sample selection and detail removal may have impacts corresponding,
respectively, to 12% and 16% of the one obtained by picking a better
deep-learning model.Comment: Accepted to the ISIC Skin Image Analysis Workshop @ CVPR 202
Fully Convolutional Neural Networks to Detect Clinical Dermoscopic Features
The presence of certain clinical dermoscopic features within a skin lesion
may indicate melanoma, and automatically detecting these features may lead to
more quantitative and reproducible diagnoses. We reformulate the task of
classifying clinical dermoscopic features within superpixels as a segmentation
problem, and propose a fully convolutional neural network to detect clinical
dermoscopic features from dermoscopy skin lesion images. Our neural network
architecture uses interpolated feature maps from several intermediate network
layers, and addresses imbalanced labels by minimizing a negative multi-label
Dice-F score, where the score is computed across the mini-batch for each
label. Our approach ranked first place in the 2017 ISIC-ISBI Part 2:
Dermoscopic Feature Classification Task challenge over both the provided
validation and test datasets, achieving a 0.895% area under the receiver
operator characteristic curve score. We show how simple baseline models can
outrank state-of-the-art approaches when using the official metrics of the
challenge, and propose to use a fuzzy Jaccard Index that ignores the empty set
(i.e., masks devoid of positive pixels) when ranking models. Our results
suggest that (i) the classification of clinical dermoscopic features can be
effectively approached as a segmentation problem, and (ii) the current metrics
used to rank models may not well capture the efficacy of the model. We plan to
make our trained model and code publicly available.Comment: Accepted JBHI versio
Generative Adversarial Network in Medical Imaging: A Review
Generative adversarial networks have gained a lot of attention in the
computer vision community due to their capability of data generation without
explicitly modelling the probability density function. The adversarial loss
brought by the discriminator provides a clever way of incorporating unlabeled
samples into training and imposing higher order consistency. This has proven to
be useful in many cases, such as domain adaptation, data augmentation, and
image-to-image translation. These properties have attracted researchers in the
medical imaging community, and we have seen rapid adoption in many traditional
and novel applications, such as image reconstruction, segmentation, detection,
classification, and cross-modality synthesis. Based on our observations, this
trend will continue and we therefore conducted a review of recent advances in
medical imaging using the adversarial training scheme with the hope of
benefiting researchers interested in this technique.Comment: 24 pages; v4; added missing references from before Jan 1st 2019;
accepted to MedI
Segmentation of Skin Lesions and their Attributes Using Multi-Scale Convolutional Neural Networks and Domain Specific Augmentations
Computer-aided diagnosis systems for classification of different type of skin
lesions have been an active field of research in recent decades. It has been
shown that introducing lesions and their attributes masks into lesion
classification pipeline can greatly improve the performance. In this paper, we
propose a framework by incorporating transfer learning for segmenting lesions
and their attributes based on the convolutional neural networks. The proposed
framework is based on the encoder-decoder architecture which utilizes a variety
of pre-trained networks in the encoding path and generates the prediction map
by combining multi-scale information in decoding path using a pyramid pooling
manner. To address the lack of training data and increase the proposed model
generalization, an extensive set of novel domain-specific augmentation routines
have been applied to simulate the real variations in dermoscopy images.
Finally, by performing broad experiments on three different data sets obtained
from International Skin Imaging Collaboration archive (ISIC2016, ISIC2017, and
ISIC2018 challenges data sets), we show that the proposed method outperforms
other state-of-the-art approaches for ISIC2016 and ISIC2017 segmentation task
and achieved the first rank on the leader-board of ISIC2018 attribute detection
task.Comment: 18 page
Style transfer-based image synthesis as an efficient regularization technique in deep learning
These days deep learning is the fastest-growing area in the field of Machine
Learning. Convolutional Neural Networks are currently the main tool used for
image analysis and classification purposes. Although great achievements and
perspectives, deep neural networks and accompanying learning algorithms have
some relevant challenges to tackle. In this paper, we have focused on the most
frequently mentioned problem in the field of machine learning, that is
relatively poor generalization abilities. Partial remedies for this are
regularization techniques e.g. dropout, batch normalization, weight decay,
transfer learning, early stopping and data augmentation. In this paper, we have
focused on data augmentation. We propose to use a method based on a neural
style transfer, which allows generating new unlabeled images of a high
perceptual quality that combine the content of a base image with the appearance
of another one. In a proposed approach, the newly created images are described
with pseudo-labels, and then used as a training dataset. Real, labeled images
are divided into the validation and test set. We validated the proposed method
on a challenging skin lesion classification case study. Four representative
neural architectures are examined. Obtained results show the strong potential
of the proposed approach.Comment: 6 pages, 4 figures, accepted to the 24th International Conference on
Methods and Models in Automation and Robotics (MMAR 2019
A Survey on Deep Learning in Medical Image Analysis
Deep learning algorithms, in particular convolutional networks, have rapidly
become a methodology of choice for analyzing medical images. This paper reviews
the major deep learning concepts pertinent to medical image analysis and
summarizes over 300 contributions to the field, most of which appeared in the
last year. We survey the use of deep learning for image classification, object
detection, segmentation, registration, and other tasks and provide concise
overviews of studies per application area. Open challenges and directions for
future research are discussed.Comment: Revised survey includes expanded discussion section and reworked
introductory section on common deep architectures. Added missed papers from
before Feb 1st 201
Automatic Liver Lesion Detection using Cascaded Deep Residual Networks
Automatic segmentation of liver lesions is a fundamental requirement towards
the creation of computer aided diagnosis (CAD) and decision support systems
(CDS). Traditional segmentation approaches depend heavily upon hand-crafted
features and a priori knowledge of the user. As such, these methods are
difficult to adopt within a clinical environment. Recently, deep learning
methods based on fully convolutional networks (FCNs) have been successful in
many segmentation problems primarily because they leverage a large labelled
dataset to hierarchically learn the features that best correspond to the
shallow visual appearance as well as the deep semantics of the areas to be
segmented. However, FCNs based on a 16 layer VGGNet architecture have limited
capacity to add additional layers. Therefore, it is challenging to learn more
discriminative features among different classes for FCNs. In this study, we
overcome these limitations using deep residual networks (ResNet) to segment
liver lesions. ResNet contain skip connections between convolutional layers,
which solved the problem of the training degradation of training accuracy in
very deep networks and thereby enables the use of additional layers for
learning more discriminative features. In addition, we achieve more precise
boundary definitions through a novel cascaded ResNet architecture with
multi-scale fusion to gradually learn and infer the boundaries of both the
liver and the liver lesions. Our proposed method achieved 4th place in the ISBI
2017 Liver Tumor Segmentation Challenge by the submission deadline.Comment: Submission for 2017 ISBI LiTS Challeng
- …