A radiomics evaluation of 2D and 3D MRI texture features to classify brain metastases from lung cancer and melanoma

© 2017 IEEE. Personal use of this material is permitted. Permissíon from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertisíng or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.[EN] Brain metastases are occasionally detected before diagnosing their primary site of origin. In these cases, simple visual examination of medical images of the metastases is not enough to identify the primary cancer, so an extensive evaluation is needed. To avoid this procedure, a radiomics approach on magnetic resonance (MR) images of the metastatic lesions is proposed to classify two of the most frequent origins (lung cancer and melanoma). In this study, 50 T1-weighted MR images of brain metastases from 30 patients were analyzed: 27 of lung cancer and 23 of melanoma origin. A total of 43 statistical texture features were extracted from the segmented lesions in 2D and 3D. Five predictive models were evaluated using a nested cross-validation scheme. The best classification results were achieved using 3D texture features for all the models, obtaining an average AUC > 0.9 in all cases and an AUC = 0.947 +/- 0.067 when using the best model (naive Bayes).Research supported in part by the Spanish Ministerio de Economia y Competitividad (MINECO) and FEDER funds under Grant BFU2015-64380-C2-2-R.Ortiz-Ramón, R.; Larroza-Santacruz, A.; Arana Fernandez De Moya, E.; Moratal, D. (2017). A radiomics evaluation of 2D and 3D MRI texture features to classify brain metastases from lung cancer and melanoma. Proceedings Intenational Anual Conference of IEEE Engineering in Medicine and Biology Society. 493-496. https://doi.org/10.1109/EMBC.2017.8036869S49349

Classifying brain metastases by their primary site of origin using a radiomics approach based on texture analysis: a feasibility study

[EN] Objective To examine the capability of MRI texture analysis to differentiate the primary site of origin of brain metastases following a radiomics approach. Methods Sixty-seven untreated brain metastases (BM) were found in 3D T1-weighted MRI of 38 patients with cancer: 27 from lung cancer, 23 from melanoma and 17 from breast cancer. These lesions were segmented in 2D and 3D to compare the discriminative power of 2D and 3D texture features. The images were quantized using different number of gray-levels to test the influence of quantization. Forty-three rotation-invariant texture features were examined. Feature selection and random forest classification were implemented within a nested cross-validation structure. Classification was evaluated with the area under receiver operating characteristic curve (AUC) considering two strategies: multiclass and one-versus-one. Results In the multiclass approach, 3D texture features were more discriminative than 2D features. The best results were achieved for images quantized with 32 gray-levels (AUC = 0.873 +/- 0.064) using the top four features provided by the feature selection method based on the p-value. In the one-versus-one approach, high accuracy was obtained when differentiating lung cancer BM from breast cancer BM (four features, AUC = 0.963 +/- 0.054) and melanoma BM (eight features, AUC = 0.936 +/- 0.070) using the optimal dataset (3D features, 32 gray-levels). Classification of breast cancer and melanoma BM was unsatisfactory (AUC = 0.607 +/- 0.180). Conclusion Volumetric MRI texture features can be useful to differentiate brain metastases from different primary cancers after quantizing the images with the proper number of gray-levels.This work has been partially funded by the Spanish Ministerio de Economia y Competitividad (MINECO) and FEDER funds under Grant BFU2015-64380-C2-2-R. Rafael Ortiz-Ramon was supported by grant ACIF/2015/078 from the Conselleria d'Educacio, Investigacio, Cultura i Esport of the Valencian Community (Spain). Andres Larroza was supported by grant FPU12/01140 from the Spanish Ministerio de Educacion, Cultura y Deporte (MECD).Ortiz-Ramón, R.; Larroza-Santacruz, A.; Ruiz-España, S.; Arana Fernandez De Moya, E.; Moratal, D. (2018). Classifying brain metastases by their primary site of origin using a radiomics approach based on texture analysis: a feasibility study. European Radiology. 28(11):4514-4523. https://doi.org/10.1007/s00330-018-5463-6S451445232811Gavrilovic IT, Posner JB (2005) Brain metastases: epidemiology and pathophysiology. J Neurooncol 75:5–14Stelzer KJ (2013) Epidemiology and prognosis of brain metastases. Surg Neurol Int 4:S192–S202Soffietti R, Cornu P, Delattre JY et al (2006) EFNS Guidelines on diagnosis and treatment of brain metastases: report of an EFNS Task Force. Eur J Neurol 13:674–681Kaal ECA, Taphoorn MJB, Vecht CJ (2005) Symptomatic management and imaging of brain metastases. J Neurooncol 75:15–20Nayak L, Lee EQ, Wen PY (2012) Epidemiology of brain metastases. Curr Oncol Rep 14:48–54Bartelt S, Lutterbach J (2003) Brain metastases in patients with cancer of unknown primary. J Neurooncol 64:249–253Agazzi S, Pampallona S, Pica A et al (2004) The origin of brain metastases in patients with an undiagnosed primary tumor. Acta Neurochir (Wien) 146:153–157Pekmezci M, Perry A (2013) Neuropathology of brain metastases. Surg Neurol Int 4:245Zakaria R, Das K, Bhojak M et al (2014) The role of magnetic resonance imaging in the management of brain metastases: diagnosis to prognosis. Cancer Imaging 14:1–8Bekaert L, Emery E, Levallet G, Lechapt-Zalcman E (2017) Histopathologic diagnosis of brain metastases: current trends in management and future considerations. Brain Tumor Pathol 34:8–19Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278:563–577Lambin P, Rios-Velazquez E, Leijenaar R et al (2012) Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer 48:441–446Yip SSF, Aerts HJWL (2016) Applications and limitations of radiomics. Phys Med Biol 61:R150–R166Kumar V, Gu Y, Basu S et al (2012) Radiomics: the process and the challenges. Magn Reson Imaging 30:1234–1248Castellano G, Bonilha L, Li LM, Cendes F (2004) Texture analysis of medical images. Clin Radiol 59:1061–1069Kassner A, Thornhill RE (2010) Texture analysis: a review of neurologic MR imaging applications. AJNR Am J Neuroradiol 31:809–816Mahmoud-Ghoneim D, Toussaint G, Constans JM, De Certaines JD (2003) Three dimensional texture analysis in MRI: a preliminary evaluation in gliomas. Magn Reson Imaging 21:983–987Fetit AE, Novak J, Peet AC, Arvanitis TN (2015) Three-dimensional textural features of conventional MRI improve diagnostic classification of childhood brain tumors. NMR Biomed 28:1174–1184Zacharaki EI, Wang S, Chawla S et al (2009) Classification of brain tumor type and grade using MRI texture and shape in a machine learning scheme. Magn Reson Med 62:1609–1618Georgiadis P, Cavouras D, Kalatzis I et al (2009) Enhancing the discrimination accuracy between metastases, gliomas and meningiomas on brain MRI by volumetric textural features and ensemble pattern recognition methods. Magn Reson Imaging 27:120–130Larroza A, Moratal D, Paredes-Sánchez A et al (2015) Support vector machine classification of brain metastasis and radiation necrosis based on texture analysis in MRI. J Magn Reson Imaging 42:1362–1368Li Z, Mao Y, Li H et al (2016) Differentiating brain metastases from different pathological types of lung cancers using texture analysis of T1 postcontrast MR. Magn Reson Med 76:1410–1419Fink KR, Fink JR (2013) Imaging of brain metastases. Surg Neurol Int 4:S209–S219Larroza A, Bodí V, Moratal D (2016) Texture analysis in magnetic resonance imaging: review and considerations for future applications. In: Assessment of cellular and organ function and dysfunction using direct and derived MRI methodologies. InTech, Rijeka, Croatia, pp 75–106Leite M, Rittner L, Appenzeller S et al (2015) Etiology-based classification of brain white matter hyperintensity on magnetic resonance imaging. J Med Imaging 2:14002Mahmoud-Ghoneim D, Alkaabi MK, De Certaines JD, Goettsche F-M (2008) The impact of image dynamic range on texture classification of brain white matter. BMC Med Imaging 8:1–8Depeursinge A, Foncubierta-Rodriguez A, Van De Ville D, Müller H (2014) Three-dimensional solid texture analysis in biomedical imaging: review and opportunities. Med Image Anal 18:176–196Ellingson BM, Bendszus M, Boxerman J et al (2015) Consensus recommendations for a standardized Brain Tumor Imaging Protocol in clinical trials. Neuro Oncol 17:1188–1198Mayerhoefer ME, Breitenseher MJ, Kramer J et al (2005) Texture analysis for tissue discrimination on T1-weighted MR images of the knee joint in a multicenter study: Transferability of texture features and comparison of feature selection methods and classifiers. J Magn Reson Imaging 22:674–680Waugh SA, Lerski RA, Bidaut L, Thompson AM (2011) The influence of field strength and different clinical breast MRI protocols on the outcome of texture analysis using foam phantoms. Med Phys 38:5058–5066Chan TF, Vese LA (2001) Active contours without edges. IEEE Trans Image Process 10:266–277Collewet G, Strzelecki M, Mariette F (2004) Influence of MRI acquisition protocols and image intensity normalization methods on texture classification. Magn Reson Imaging 22:81–91Gibbs P, Turnbull LW (2003) Textural analysis of contrast-enhanced MR images of the breast. Magn Reson Med 50:92–98Vallières M, Freeman CR, Skamene SR, El Naqa I (2015) A radiomics model from joint FDG-PET and MRI texture features for the prediction of lung metastases in soft-tissue sarcomas of the extremities. Phys Med Biol 60:5471–5496Kuhn M, Johnson K (2013) Data pre-processing. In: Applied predictive modeling, 1st ed. Springer, New York, NY, pp 27–59Fernández-Delgado M, Cernadas E, Barro S et al (2014) Do we need hundreds of classifiers to solve real world classification problems? J Mach Learn Res 15:3133–3181Caruana R, Karampatziakis N, Yessenalina A (2008) An empirical evaluation of supervised learning in high dimensions. In: Proceedings of the 25th international conference on Machine learning - ICML ’08. ACM Press, Helsinki, Finland, pp 96–103Kuhn M, Johnson K (2013) Over-fitting and model tuning. In: Applied predictive modeling, 1st ed. Springer, New York, NY, pp 61–92Kuhn M, Johnson K (2013) An introduction to feature selection. In: Applied predictive modeling, 1st ed. Springer, New York, NY, pp 487–519Ambroise C, McLachlan GJ (2002) Selection bias in gene extraction on the basis of microarray gene-expression data. Proc Natl Acad Sci U S A 99:6562–6566Provost F, Domingos P (2003) Tree induction for probability-based ranking. Mach Learn 52:199–215Kuhn M (2008) Building predictive models in R using the caret package. J Stat Softw 28:1–26Ortiz-Ramon R, Larroza A, Arana E, Moratal D (2017) Identifying the primary site of origin of MRI brain metastases from lung and breast cancer following a 2D radiomics approach. In: 2017 I.E. 14th International Symposium on Biomedical Imaging (ISBI 2017). Melbourne, VIC, pp 1213–1216Ortiz-Ramon R, Larroza A, Arana E, Moratal D (2017) A radiomics evaluation of 2D and 3D MRI texture features to classify brain metastases from lung cancer and melanoma. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). Seogwipo, pp 493–496Béresová M, Larroza A, Arana E, et al (2017) 2D and 3D texture analysis to differentiate brain metastases on MR images: proceed with caution. MAGMA 1–10Ahmed A, Gibbs P, Pickles M, Turnbull L (2013) Texture analysis in assessment and prediction of chemotherapy response in breast cancer. J Magn Reson Imaging 38:89–101Chen W, Giger ML, Li H et al (2007) Volumetric texture analysis of breast lesions on contrast-enhanced magnetic resonance images. Magn Reson Med 58:562–57

Advanced Computational Methods for Oncological Image Analysis

[Cancer is the second most common cause of death worldwide and encompasses highly variable clinical and biological scenarios. Some of the current clinical challenges are (i) early diagnosis of the disease and (ii) precision medicine, which allows for treatments targeted to specific clinical cases. The ultimate goal is to optimize the clinical workflow by combining accurate diagnosis with the most suitable therapies. Toward this, large-scale machine learning research can define associations among clinical, imaging, and multi-omics studies, making it possible to provide reliable diagnostic and prognostic biomarkers for precision oncology. Such reliable computer-assisted methods (i.e., artificial intelligence) together with clinicians’ unique knowledge can be used to properly handle typical issues in evaluation/quantification procedures (i.e., operator dependence and time-consuming tasks). These technical advances can significantly improve result repeatability in disease diagnosis and guide toward appropriate cancer care. Indeed, the need to apply machine learning and computational intelligence techniques has steadily increased to effectively perform image processing operations—such as segmentation, co-registration, classification, and dimensionality reduction—and multi-omics data integration.

Advanced intra-tumoural structural characterisation of hepatocellular carcinoma utilising FDG-PET/CT : a comparative study of radiomics and metabolic features in 3D and 2D

Purpose: The aim of our work is to evaluate the correlation of two-dimensional (2D) and three-dimensional (3D) radiomics and metabolic features of hepatocellular carcinoma (HCC) with tumour diameter, staging, and metabolic tumour volume (MTV). Material and methods: Thirty-three patients with HCC were studied using 18F-fluorodeoxyglucose positron-emission tomography with computed tomography (18F [FDG] PET/CT). The tumours were segmented from the PET images after CT correction. Metabolic parameters and 35 radiomics features were compared using 2D and 3D modes. The metabolic parameters and tumour morphology were compared using 2 different types of software. Tumour heterogeneity was studied in both metabolic parameters and radiomics features. Finally, the correlation between the metabolic and radiomics features in 3D mode, as well as tumour morphology and staging according to the American Joint Committee on Cancer (AJCC) staging were studied. Results: Most of the metabolic parameters and radiomics features are statically stable through the 2D and 3D modes. Most of the 3D mode features show a correlation with metabolic parameters; the total lesion glycolysis (TLG) shows the highest correlation, with a Spearman correlation coefficient (rs) of 0.9776. Also, the grey level run length matrix/ run length non-uniformity (GLRLM_RLNU) from radiomics features exhibits a correlation with a Spearman correlation coefficient of 0.9733. Maximum tumour diameter is correlated with TLG and GLRLM_RLNU, with rs equal to 0.7461 and 0.7143, respectively. Regarding AJCC staging, some features show a medium but prognostic correlation. In the case of 2D-mode features, all metabolic and radiomics features show no significant correlation with MTV, AJCC staging, and tumour maximum diameter. Conclusions: Most of the normal metabolic parameters and radiomics features are statistically stable through the 3D and 2D modes. 3D radiomics features are significantly correlated with tumour volume, maximum diameter, and staging. Conversely, 2D features have negligible correlation with the same parameters. Therefore, 3D mode features are preferable and can accurately evaluate tumour heterogeneity

AI in Medical Imaging Informatics: Current Challenges and Future Directions

This paper reviews state-of-the-art research solutions across the spectrum of medical imaging informatics, discusses clinical translation, and provides future directions for advancing clinical practice. More specifically, it summarizes advances in medical imaging acquisition technologies for different modalities, highlighting the necessity for efficient medical data management strategies in the context of AI in big healthcare data analytics. It then provides a synopsis of contemporary and emerging algorithmic methods for disease classification and organ/ tissue segmentation, focusing on AI and deep learning architectures that have already become the de facto approach. The clinical benefits of in-silico modelling advances linked with evolving 3D reconstruction and visualization applications are further documented. Concluding, integrative analytics approaches driven by associate research branches highlighted in this study promise to revolutionize imaging informatics as known today across the healthcare continuum for both radiology and digital pathology applications. The latter, is projected to enable informed, more accurate diagnosis, timely prognosis, and effective treatment planning, underpinning precision medicine

Machine Learning and Quantitative Imaging for the Management of Brain Metastasis

Significantly affecting patients’ clinical course and quality of life, a growing number of cancer cases are diagnosed with brain metastasis annually. Although a considerable percentage of cancer patients survive for several years if the disease is discovered at an early stage while it is still localized, when the tumour is metastasized to the brain, the median survival decreases considerably. Early detection followed by precise and effective treatment of brain metastasis may lead to improved patient survival and quality of life. A main challenge to prescribe an effective treatment regimen is the variability of tumour response to treatments, e.g., radiotherapy as a main treatment option for brain metastasis, despite similar cancer therapy, due to many patient-related factors. Stratifying patients based on their predicted response and consequently assessing their response to therapy are challenging yet crucial tasks. While risk assessment models with standard clinical attributes have been proposed for patient stratification, the imaging data acquired for these patients as a part of the standard-of-care are not computationally analyzed or directly incorporated in these models. Further, therapy response monitoring and assessment is a cumbersome task for patients with brain metastasis that requires longitudinal tumour delineation on MRI volumes before and at multiple follow-up sessions after treatment. This is aggravated by the time-sensitive nature of the disease. In an effort to address these challenges, a number of machine learning frameworks and computational techniques in areas of automatic tumour segmentation, radiotherapy outcome assessment, and therapy outcome prediction have been introduced and investigated in this dissertation. Powered by advanced machine learning algorithms, a complex attention-guided segmentation framework is introduced and investigated for segmenting brain tumours on serial MRI. The experimental results demonstrate that the proposed framework can achieve a dice score of 91.5% and 84.1% to 87.4% on the baseline and follow-up scans, respectively. This framework is then applied in a proposed system that follows standard clinical criteria based on changes in tumour size at post-treatment to assess tumour response to radiotherapy automatically. The system demonstrates a very good agreement with expert clinicians in detecting local response, with an accuracy of over 90%. Next, innovative machine-learning-based solutions are proposed and investigated for radiotherapy outcome prediction before or early after therapy, using MRI radiomic models and novel deep learning architectures that analyze treatment-planning MRI with and without standard clinical attributes. The developed models demonstrate an accuracy of up to 82.5% in predicting radiotherapy outcome before the treatment initiation. The ground-breaking machine learning platforms presented in this dissertation along with the promising results obtained in the conducted experiments are steps forward towards realizing important decision support tools for oncologists and radiologists and, can eventually, pave the way towards the personalized therapeutics paradigm for cancer patient

Radiomics and artificial intelligence in prostate cancer: new tools for molecular hybrid imaging and theragnostics

In prostate cancer (PCa), the use of new radiopharmaceuticals has improved the accuracy of diagnosis and staging, refined surveillance strategies, and introduced specific and personalized radioreceptor therapies. Nuclear medicine, therefore, holds great promise for improving the quality of life of PCa patients, through managing and processing a vast amount of molecular imaging data and beyond, using a multi-omics approach and improving patients' risk-stratification for tailored medicine. Artificial intelligence (AI) and radiomics may allow clinicians to improve the overall efficiency and accuracy of using these "big data" in both the diagnostic and theragnostic field: from technical aspects (such as semi-automatization of tumor segmentation, image reconstruction, and interpretation) to clinical outcomes, improving a deeper understanding of the molecular environment of PCa, refining personalized treatment strategies, and increasing the ability to predict the outcome. This systematic review aims to describe the current literature on AI and radiomics applied to molecular imaging of prostate cancer