5,334 research outputs found
Replication study: Development and validation of deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs
Replication studies are essential for validation of new methods, and are
crucial to maintain the high standards of scientific publications, and to use
the results in practice. We have attempted to replicate the main method in
'Development and validation of a deep learning algorithm for detection of
diabetic retinopathy in retinal fundus photographs' published in JAMA 2016;
316(22). We re-implemented the method since the source code is not available,
and we used publicly available data sets. The original study used non-public
fundus images from EyePACS and three hospitals in India for training. We used a
different EyePACS data set from Kaggle. The original study used the benchmark
data set Messidor-2 to evaluate the algorithm's performance. We used the same
data set. In the original study, ophthalmologists re-graded all images for
diabetic retinopathy, macular edema, and image gradability. There was one
diabetic retinopathy grade per image for our data sets, and we assessed image
gradability ourselves. Hyper-parameter settings were not described in the
original study. But some of these were later published. We were not able to
replicate the original study. Our algorithm's area under the receiver operating
curve (AUC) of 0.94 on the Kaggle EyePACS test set and 0.80 on Messidor-2 did
not come close to the reported AUC of 0.99 in the original study. This may be
caused by the use of a single grade per image, different data, or different not
described hyper-parameter settings. This study shows the challenges of
replicating deep learning, and the need for more replication studies to
validate deep learning methods, especially for medical image analysis.
Our source code and instructions are available at:
https://github.com/mikevoets/jama16-retina-replicationComment: The third version of this paper includes results from replication
after certain hyper-parameters were published in later article. 16 pages, 6
figures, 1 table, presented at NOBIM 201
Lesion detection and Grading of Diabetic Retinopathy via Two-stages Deep Convolutional Neural Networks
We propose an automatic diabetic retinopathy (DR) analysis algorithm based on
two-stages deep convolutional neural networks (DCNN). Compared to existing
DCNN-based DR detection methods, the proposed algorithm have the following
advantages: (1) Our method can point out the location and type of lesions in
the fundus images, as well as giving the severity grades of DR. Moreover, since
retina lesions and DR severity appear with different scales in fundus images,
the integration of both local and global networks learn more complete and
specific features for DR analysis. (2) By introducing imbalanced weighting map,
more attentions will be given to lesion patches for DR grading, which
significantly improve the performance of the proposed algorithm. In this study,
we label 12,206 lesion patches and re-annotate the DR grades of 23,595 fundus
images from Kaggle competition dataset. Under the guidance of clinical
ophthalmologists, the experimental results show that our local lesion detection
net achieve comparable performance with trained human observers, and the
proposed imbalanced weighted scheme also be proved to significantly improve the
capability of our DCNN-based DR grading algorithm
Weakly-supervised localization of diabetic retinopathy lesions in retinal fundus images
Convolutional neural networks (CNNs) show impressive performance for image
classification and detection, extending heavily to the medical image domain.
Nevertheless, medical experts are sceptical in these predictions as the
nonlinear multilayer structure resulting in a classification outcome is not
directly graspable. Recently, approaches have been shown which help the user to
understand the discriminative regions within an image which are decisive for
the CNN to conclude to a certain class. Although these approaches could help to
build trust in the CNNs predictions, they are only slightly shown to work with
medical image data which often poses a challenge as the decision for a class
relies on different lesion areas scattered around the entire image. Using the
DiaretDB1 dataset, we show that on retina images different lesion areas
fundamental for diabetic retinopathy are detected on an image level with high
accuracy, comparable or exceeding supervised methods. On lesion level, we
achieve few false positives with high sensitivity, though, the network is
solely trained on image-level labels which do not include information about
existing lesions. Classifying between diseased and healthy images, we achieve
an AUC of 0.954 on the DiaretDB1.Comment: Accepted in Proc. IEEE International Conference on Image Processing
(ICIP), 201
- …