Analysis of the ISIC image datasets: Usage, benchmarks and recommendations

The International Skin Imaging Collaboration (ISIC) datasets have become a leading repository for researchers in machine learning for medical image analysis, especially in the field of skin cancer detection and malignancy assessment. They contain tens of thousands of dermoscopic photographs together with gold-standard lesion diagnosis metadata. The associated yearly challenges have resulted in major contributions to the field, with papers reporting measures well in excess of human experts. Skin cancers can be divided into two major groups - melanoma and non-melanoma. Although less prevalent, melanoma is considered to be more serious as it can quickly spread to other organs if not treated at an early stage. In this paper, we summarise the usage of the ISIC dataset images and present an analysis of yearly releases over a period of 2016 - 2020. Our analysis found a significant number of duplicate images, both within and between the datasets. Additionally, we also noted duplicates spread across testing and training sets. Due to these irregularities, we propose a duplicate removal strategy and recommend a curated dataset for researchers to use when working on ISIC datasets. Given that ISIC 2020 focused on melanoma classification, we conduct experiments to provide benchmark results on the ISIC 2020 test set, with additional analysis on the smaller ISIC 2017 test set. Testing was completed following the application of our duplicate removal strategy and an additional data balancing step. As a result of removing 14,310 duplicate images from the training set, our benchmark results show good levels of melanoma prediction with an AUC of 0.80 for the best performing model. As our aim was not to maximise network performance, we did not include additional steps in our experiments. Finally, we provide recommendations for future research by highlighting irregularities that may present research challenges. A list of image files with reference to the original ISIC dataset sources for the recommended curated training set will be shared on our GitHub repository (available at www.github.com/mmu-dermatology-research/isic_duplicate_removal_strategy)

Microbiological profiles of sputum and gastric juice aspirates in Cystic Fibrosis patients.

Gastro-Oesophageal Reflux (GOR) is a key problem in Cystic Fibrosis (CF), but the relationship between lung and gastric microbiomes is not well understood. We hypothesised that CF gastric and lung microbiomes are related. Gastric and sputum cultures were obtained from fifteen CF patients receiving percutaneous endoscopic gastrostomy feeding. Non-CF gastric juice data was obtained through endoscopy from 14 patients without lung disease. Bacterial and fungal isolates were identified by culture. Molecular bacterial profiling used next generation sequencing (NGS) of the 16S rRNA gene. Cultures grew bacteria and/or fungi in all CF gastric juice and sputa and in 9/14 non-CF gastric juices. Pseudomonas aeruginosa(Pa) was present in CF sputum in 11 patients, 4 had identical Pa strains in the stomach. NGS data from non-CF gastric juice samples were significantly more diverse compared to CF samples. NGS showed CF gastric juice had markedly lower abundance of normal gut bacteria; Bacteroides and Faecalibacterium, but increased Pseudomonas compared with non-CF. Multivariate partial least squares discriminant analysis demonstrated similar bacterial profiles of CF sputum and gastric juice samples, which were distinct from non-CF gastric juice. We provide novel evidence suggesting the existence of an aerodigestive microbiome in CF, which may have clinical relevance

Microbiological profiles of sputum and gastric juice aspirates in Cystic Fibrosis patients

Gastro-Oesophageal Reflux (GOR) is a key problem in Cystic Fibrosis (CF), but the relationship between lung and gastric microbiomes is not well understood. We hypothesised that CF gastric and lung microbiomes are related. Gastric and sputum cultures were obtained from fifteen CF patients receiving percutaneous endoscopic gastrostomy feeding. Non-CF gastric juice data was obtained through endoscopy from 14 patients without lung disease. Bacterial and fungal isolates were identified by culture. Molecular bacterial profiling used next generation sequencing (NGS) of the 16S rRNA gene. Cultures grew bacteria and/or fungi in all CF gastric juice and sputa and in 9/14 non-CF gastric juices. Pseudomonas aeruginosa(Pa) was present in CF sputum in 11 patients, 4 had identical Pa strains in the stomach. NGS data from non-CF gastric juice samples were significantly more diverse compared to CF samples. NGS showed CF gastric juice had markedly lower abundance of normal gut bacteria; Bacteroides and Faecalibacterium, but increased Pseudomonas compared with non-CF. Multivariate partial least squares discriminant analysis demonstrated similar bacterial profiles of CF sputum and gastric juice samples, which were distinct from non-CF gastric juice. We provide novel evidence suggesting the existence of an aerodigestive microbiome in CF, which may have clinical relevance