CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison

Large, labeled datasets have driven deep learning methods to achieve expert-level performance on a variety of medical imaging tasks. We present CheXpert, a large dataset that contains 224,316 chest radiographs of 65,240 patients. We design a labeler to automatically detect the presence of 14 observations in radiology reports, capturing uncertainties inherent in radiograph interpretation. We investigate different approaches to using the uncertainty labels for training convolutional neural networks that output the probability of these observations given the available frontal and lateral radiographs. On a validation set of 200 chest radiographic studies which were manually annotated by 3 board-certified radiologists, we find that different uncertainty approaches are useful for different pathologies. We then evaluate our best model on a test set composed of 500 chest radiographic studies annotated by a consensus of 5 board-certified radiologists, and compare the performance of our model to that of 3 additional radiologists in the detection of 5 selected pathologies. On Cardiomegaly, Edema, and Pleural Effusion, the model ROC and PR curves lie above all 3 radiologist operating points. We release the dataset to the public as a standard benchmark to evaluate performance of chest radiograph interpretation models. The dataset is freely available at https://stanfordmlgroup.github.io/competitions/chexpert .Comment: Published in AAAI 201

Convolutional Neural Networks with Transfer Learning for Pneumonia Detection

"Pneumonia is a type of acute respiratory infection caused by microbes, and viruses that affect the lungs. Pneumonia is the leading cause of infant mortality in the world, accounting for 81% of deaths in children under five years of age. There are approximately 1.2 million cases of pneumonia in children under five years of age and 180 000 died in 2016. Early detection of pneumonia can help reduce mortality rates. Therefore, this paper presents four convolutional neural network (CNN) models to detect pneumonia from chest X-ray images. CNNs were trained to classify X-ray images into two types: normal and pneumonia, using several convolutional layers. The four models used in this work are pre-trained: VGG16, VGG19, ResNet50, and InceptionV3. The measures that were used for the evaluation of the results are Accuracy, recall, and F1-Score. The models were trained and validated with the dataset. The results showed that the Inceptionv3 model achieved the best performance with 72.9% accuracy, recall 93.7%, and F1-Score 82%. This indicates that CNN models are suitable for detecting pneumonia with high accuracy.