In this paper we summarize our methods for the ISIC 2018 Competition: Skin Lesion Analysis Towards Melanoma Detection

Lu, Quoc Hung

Nguyen, Thi Thu Hang

Nguyen, Thi Thuy Nga

Nguyen, Tien Zung

Tô, Tat Dat

HAL-INSA Toulouse

Skin Lesion Analysis Towards Melanoma Detection for ISIC 2018

Dat Tô, Tat

Archive Ouverte en Sciences de l'Information et de la Communication

HAL Id: hal-01847743
https://hal.archives-ouvertes.fr/hal-01847743
Submitted on 24 Jul 2018
HAL is a multi-disciplinary open access
archive for the deposit and dissemination of sci-
entific research documents, whether they are pub-
lished or not. The documents may come from
teaching and research institutions in France or
abroad, or from public or private research centers.
L’archive ouverte pluridisciplinaire HAL, est
destinée au dépôt et à la diffusion de documents
scientifiques de niveau recherche, publiés ou non,
émanant des établissements d’enseignement et de
recherche français ou étrangers, des laboratoires
publics ou privés.
Skin Lesion Analysis Towards Melanoma Detection for
ISIC 2018
Quoc Hung Lu, Thi Thu Hang Nguyen, Thi Thuy Nga Nguyen, Tien Zung
Nguyen, Tat Dat Tô
To cite this version:
Quoc Hung Lu, Thi Thu Hang Nguyen, Thi Thuy Nga Nguyen, Tien Zung Nguyen, Tat Dat Tô.
Skin Lesion Analysis Towards Melanoma Detection for ISIC 2018. [Research Report] Rapport LAAS
n° 18250, Institut de Mathématiques de Toulouse & Institut Universitaire de France, UMR 5219,
Université de Toulouse, CNRS, UPS IMT; LAAS-CNRS. 2018. ￿hal-01847743￿
Skin Lesion Analysis Towards Melanoma Detection for ISIC 2018
Quoc Hung Lu, Hang Nguyen, Thi Thuy Nga Nguyen,
Tien Zung Nguyen∗, and Tat Dat Tô†
July 23, 2018
Abstract
In this paper we summarize our methods for the ISIC 2018 Competition: Skin Lesion
Analysis Towards Melanoma Detection.
1 Introduction
In this paper we briefly discuss our methods for addressing Task 1 (lesion segmentation), Task
2 (lesion attribute detection) and Task 3 (classification) of the ISIC 2018 Competition on skin
cancer.
For Task 1 and Task 2, we used a convolutional neuron network (CNN) model called Grass-
Net, which we developed earlier this year for another problem (satellite image segmentation),
and which is a combination of U-Net [4] and ResNet [5]. For Task 3, we use a new CNN model
that we developed called Z-Net (Z for zig-zag), and pre-process the images using Task 1.
For Task 1 and Task 2, we used only the official data of the ISIC 2018 Competition [2] and
[3]. For Task 3, due to the fact that the official dataset is very imbalanced (e.g., the number of
images in the category ”NV” is almost 60 times higher than ”DF”), we added some data that we
could find on the internet using searches by keywords, from free sources such as DermanetNZ,
to reduce this imbalance.
2 Task 1: Lesion Segmentation
2.1 Model
We designed an architecture using Keras/Tensorflow, called GrassNet, which combines the U-
Net of Ronneberger et al. [4] and the ResNet structures of He et al. [5]. More precisely, the
network contains down-sampling and up-sampling layers as in the U-Net, and residual blocks
are added to down-sampling layers as in ResNet. In addition, we concatenate down-sampling
layers to up-sampling layers in order to preserve the information. Our GrassNet has 37 million
trainable parameters.
The droupout with p = 0.5 is also added at the two last down-sampling convolution blocks
to reduce overfitting. The Batch normalization and the Selu activation are added after each
Convolution2D layer. The last activation function is Sigmoid.
The architecture operates on an input image of 256 × 256 pixels and produces a probability
map of the same dimensions.
∗Tien Zung Nguyen is the supervisor of the team; other authors’ contributions are equal.
†Contact author: tatdat.to@gmail.com
1
2.2 Preprocessing and Training
We resized each training image to 256 × 256, then trained the network using the Adam opti-
mization algorithm [1]. In order to improve the robustness of the model, we applied a set of
transformations (augmentations): rotation with a random angle, flipping, and random noise.
2 x Conv2D
MaxPooling2D
2 x Conv2D
MaxPooling2D
2 x Conv2D
MaxPooling2D
2 x Conv2D
MaxPooling2D
Input
2 x Conv2D
MaxPooling2D 2 x Conv2D Upsampling
Conv2D
2 x Conv2D
Upsampling
Conv2D
2 x Conv2D
Upsampling
Conv2D
2 x Conv2D
Upsampling
Conv2D
2 x Conv2D
Upsampling
Conv2D
3 x Conv2D Output
Add
Concatenate
Structure of GrassNet
Figure 1: GrassNet
2.3 Validation results
We obtained a Jaccard score of 0.781 on our first validation submission, after 280 epochs of
training (11 minutes per epoch), on a PC with a GTX 1070 graphic card.
3 Task 2: Lesion Attribute Detection
3.1 Model
For Task 2, we use the same architecture GrassNet as for Task 1.
2
3.2 Preprocessing
In order to improve accuracy, we first apply Task 1 to find the lesion on the image, cut down
the image to a smallest possible square which contains the lesion, and then resize that square
to 256 × 256, before feeding it to GrassNet.
3.3 Augmentation and Training
We trained each attribute separately, using the Adam optimization algorithm [1]. Data aug-
mentations similar to Task 1 (random rotations, flipping, and random noises) are used in order
to improve the robustness of the model.
We did not submit our results for validation yet, due to lack of time. (We entered this
competition late, on July 4th).
4 Task 3: Lesion Classification
4.1 Model
We designed a new network, called Z-Net (Z for zig-zag) by combining the GrassNet in Task
1 and an additional down-sampling structure. The idea is that the hidden segmentation inside
Z-Net will improve the accuracy of the classification. Our test runs on this architecture show
promising results compared to previously well-known architectures.
See Figure 2 for the schema of a version of Z-Net. A more sophisticated version also has
bagging.
4.2 Preprocessing
We pre-process in a way similar to Task 2, using the results of Task 1.
4.3 Augmentation and Training
Since the data is extremely imbalanced, we use the up-sampling technique by multiplying the
data with different ratios on different classes. Then we apply a random mix-up [6] with random
weights: for a random couple of image (img1, img2) extracted from data set, we replace it by a
new image img = α ∗ img1 + (1 − α) ∗ img2 with the same label as img1, where α is a random
number in [0.5, 1]. Standard augmentation operations are also used (random rotations, random
zooming, random noise, etc.) in the training process.
References
[1] Kingma, Diederik P. and Ba, Jimmy. Adam, A Method for Stochastic Optimization,
arXiv:1412.6980 [cs.LG], December 2014.
[2] Noel C. F. Codella, David Gutman, M. Emre Celebi, Brian Helba, Michael A. Marchetti,
Stephen W. Dusza, Aadi Kalloo, Konstantinos Liopyris, Nabin Mishra, Harald Kittler,
Allan Halpern, Skin Lesion Analysis Toward Melanoma Detection: A Challenge at the
2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the Interna-
tional Skin Imaging Collaboration (ISIC), 2017; arXiv:1710.05006.
[3] Philipp Tschandl, Cliff Rosendahl, Harald Kittler, The HAM10000 Dataset: A Large
Collection of Multi-Source Dermatoscopic Images of Common Pigmented Skin Lesions,
2018; arXiv:1803.10417.
3
[4] Olaf Ronneberger, Philipp Fischer, Thomas Brox, U-Net: Convolutional Networks for
Biomedical Image Segmentation, Medical Image Computing and Computer-Assisted
Intervention (MICCAI), Springer, LNCS, Vol.9351: 234–241, 2015, arXiv:1505.04597
[cs.CV]
[5] Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun, Deep Residual Learning for
Image Recognition, arXiv:1512.03385 [cs.CV]
[6] Hongyi Zhang, Moustapha Cisse, Yann N. Dauphin, David Lopez-Paz, mixup: Beyond
Empirical Risk Minimization, arXiv:1710.09412 [cs.LG]
2 x Conv2D
MaxPooling2D
2 x Conv2D
MaxPooling2D
2 x Conv2D
MaxPooling2D
2 x Conv2D
MaxPooling2D
Input
2 x Conv2D
MaxPooling2D 2 x Conv2D Upsampling
Conv2D
2 x Conv2D
Upsampling
Conv2D
2 x Conv2D
Upsampling
Conv2D
2 x Conv2D
Upsampling
Conv2D
2 x Conv2D
Upsampling
Conv2D
Add
Concatenate
Structure of ZNet
2 x Conv2D
MaxPooling2D
2 x Conv2D
MaxPooling2D
Output
2 x Conv2D
MaxPooling2D
2 x Conv2D
MaxPooling2D
2 x Conv2D
MaxPooling2D
2 x Conv2D
Dense, N classes
Figure 2: Z-Net
Hang Nguyen and Thi Thuy Nga Nguyen: LAAS-CNRS Laboratoire d’analyse et d’architecture
des systèmes, 7 Avenue du Colonel Roche, 31400 Toulouse
Quoc Hung Lu, Tien Zung Nguyen and Tat Dat Tô: Institut Mathématiques de Toulouse,
Université Paul Sabatier, 31062 Toulouse cedex 09, France.
4


English

Scientific Publications of the University of Toulouse II Le Mirail

https://hal.archives-ouvertes.fr/hal-01847743/document

Skin Lesion Analysis Towards Melanoma Detection for ISIC 2018

Abstract

Similar works

Full text

Available Versions

HAL-INSA Toulouse

Archive Ouverte en Sciences de l'Information et de la Communication

Scientific Publications of the University of Toulouse II Le Mirail