Comparison of machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer from 18F-FDG PET/CT images

abstract: Background This study aimed to compare one state-of-the-art deep learning method and four classical machine learning methods for classifying mediastinal lymph node metastasis of non-small cell lung cancer (NSCLC) from [superscript 18]F-FDG PET/CT images. Another objective was to compare the discriminative power of the recently popular PET/CT texture features with the widely used diagnostic features such as tumor size, CT value, SUV, image contrast, and intensity standard deviation. The four classical machine learning methods included random forests, support vector machines, adaptive boosting, and artificial neural network. The deep learning method was the convolutional neural networks (CNN). The five methods were evaluated using 1397 lymph nodes collected from PET/CT images of 168 patients, with corresponding pathology analysis results as gold standard. The comparison was conducted using 10 times 10-fold cross-validation based on the criterion of sensitivity, specificity, accuracy (ACC), and area under the ROC curve (AUC). For each classical method, different input features were compared to select the optimal feature set. Based on the optimal feature set, the classical methods were compared with CNN, as well as with human doctors from our institute. Results For the classical methods, the diagnostic features resulted in 81~85% ACC and 0.87~0.92 AUC, which were significantly higher than the results of texture features. CNN’s sensitivity, specificity, ACC, and AUC were 84, 88, 86, and 0.91, respectively. There was no significant difference between the results of CNN and the best classical method. The sensitivity, specificity, and ACC of human doctors were 73, 90, and 82, respectively. All the five machine learning methods had higher sensitivities but lower specificities than human doctors. Conclusions The present study shows that the performance of CNN is not significantly different from the best classical methods and human doctors for classifying mediastinal lymph node metastasis of NSCLC from PET/CT images. Because CNN does not need tumor segmentation or feature calculation, it is more convenient and more objective than the classical methods. However, CNN does not make use of the import diagnostic features, which have been proved more discriminative than the texture features for classifying small-sized lymph nodes. Therefore, incorporating the diagnostic features into CNN is a promising direction for future research.The electronic version of this article is the complete one and can be found online at: https://ejnmmires.springeropen.com/articles/10.1186/s13550-017-0260-

Application of Artificial Neural Network to Preoperative 18F-FDG PET/CT for Predicting Pathological Nodal Involvement in Non-small-cell Lung Cancer Patients

Purpose: To evaluate the performance of artificial neural networks (aNN) applied to preoperative 18F-FDG PET/CT for predicting nodal involvement in non-small-cell lung cancer (NSCLC) patients. Methods: We retrospectively analyzed data from 540 clinically resectable NSCLC patients (333 M; 67.4 \ub1 9 years) undergone preoperative 18F-FDG PET/CT and pulmonary resection with hilo-mediastinal lymphadenectomy. A 3-layers NN model was applied (dataset randomly splitted into 2/3 training and 1/3 testing). Using histopathological reference standard, NN performance for nodal involvement (N0/N+ patient) was calculated by ROC analysis in terms of: area under the curve (AUC), accuracy (ACC), sensitivity (SE), specificity (SP), positive and negative predictive values (PPV, NPV). Diagnostic performance of PET visual analysis (N+ patient: at least one node with uptake mediastinal blood-pool) and of logistic regression (LR) was evaluated. Results: Histology proved 108/540 (20%) nodal-metastatic patients. Among all collected data, relevant features selected as input parameters were: patients\u2019 age, tumor parameters (size, PET visual and semiquantitative features, histotype, grading), PET visual nodal result (patient-based, as N0/N+ and N0/N1/N2). Training and testing NN performance (AUC = 0.849, 0.769): ACC = 80 and 77%; SE = 72 and 58%; SP = 81 and 81%; PPV = 50 and 44%; NPV = 92 and 89%, respectively. Visual PET performance: ACC = 82%, SE = 32%, SP = 94%; PPV = 57%, NPV = 85%. Training and testing LR performance (AUC = 0.795, 0.763): ACC = 75 and 77%; SE = 68 and 55%; SP = 77 and 82%; PPV = 43 and 43%; NPV = 90 and 88%, respectively..Conclusions: aNN application to preoperative 18F-FDG PET/CT provides overall good performance for predicting nodal involvement in NSCLC patients candidate to surgery, especially for ruling out nodal metastases, being NPV the best diagnostic result; a high NPV was also reached by PET qualitative assessment. Moreover, in such population with low a priori nodal involvement probability, aNN better identify the relatively few and unexpected nodal-metastatic patients than PET analysis, so supporting the additional aNN use in case of PET-negative images

Inferring FDG-PET-positivity of lymph node metastases in proven lung cancer from contrast-enhanced CT using radiomics and machine learning

Background: We evaluated the role of radiomics applied to contrast-enhanced computed tomography (CT) in the detection of lymph node (LN) metastases in patients with known lung cancer compared to 18F-fluorodeoxyglucose positron emission tomography (PET)/CT as a reference. Methods: This retrospective analysis included 381 patients with 1,799 lymph nodes (450 malignant, 1,349 negative). The data set was divided into a training and validation set. A radiomics analysis with 4 filters and 6 algorithms resulting in 24 different radiomics signatures and a bootstrap algorithm (Bagging) with 30 bootstrap iterations was performed. A decision curve analysis was applied to generate a net benefit to compare the radiomics signature to two expert radiologists as one-by-one and as a prescreening tool in combination with the respective radiologist and only the radiologists. Results: All 24 modeling methods showed good and reliable discrimination for malignant/benign LNs (area under the curve 0.75-0.87). The decision curve analysis showed a net benefit for the least absolute shrinkage and selection operator (LASSO) classifier for the entire probability range and outperformed the expert radiologists except for the high probability range. Using the radiomics signature as a prescreening tool for the radiologists did not improve net benefit. Conclusions: Radiomics showed good discrimination power irrespective of the modeling technique in detecting LN metastases in patients with known lung cancer. The LASSO classifier was a suitable diagnostic tool and even outperformed the expert radiologists, except for high probabilities. Radiomics failed to improve clinical benefit as a prescreening tool

Radiomics for Response and Outcome Assessment for Non-Small Cell Lung Cancer.

Routine follow-up visits and radiographic imaging are required for outcome evaluation and tumor recurrence monitoring. Yet more personalized surveillance is required in order to sufficiently address the nature of heterogeneity in nonsmall cell lung cancer and possible recurrences upon completion of treatment. Radiomics, an emerging noninvasive technology using medical imaging analysis and data mining methodology, has been adopted to the area of cancer diagnostics in recent years. Its potential application in response assessment for cancer treatment has also drawn considerable attention. Radiomics seeks to extract a large amount of valuable information from patients' medical images (both pretreatment and follow-up images) and quantitatively correlate image features with diagnostic and therapeutic outcomes. Radiomics relies on computers to identify and analyze vast amounts of quantitative image features that were previously overlooked, unmanageable, or failed to be identified (and recorded) by human eyes. The research area has been focusing on the predictive accuracy of pretreatment features for outcome and response and the early discovery of signs of tumor response, recurrence, distant metastasis, radiation-induced lung injury, death, and other outcomes, respectively. This review summarized the application of radiomics in response assessments in radiotherapy and chemotherapy for non-small cell lung cancer, including image acquisition/reconstruction, region of interest definition/segmentation, feature extraction, and feature selection and classification. The literature search for references of this article includes PubMed peer-reviewed publications over the last 10 years on the topics of radiomics, textural features, radiotherapy, chemotherapy, lung cancer, and response assessment. Summary tables of radiomics in response assessment and treatment outcome prediction in radiation oncology have been developed based on the comprehensive review of the literature

Heterogeneidad tumoral en imágenes PET-CT

Tesis inédita de la Universidad Complutense de Madrid, Facultad de Ciencias Físicas, Departamento de Estructura de la Materia, Física Térmica y Electrónica, leída el 28/01/2021Cancer is a leading cause of morbidity and mortality [1]. The most frequent cancers worldwide are non–small cell lung carcinoma (NSCLC) and breast cancer [2], being their management a challenging task [3]. Tumor diagnosis is usually made through biopsy [4]. However, medical imaging also plays an important role in diagnosis, staging, response to treatment, and recurrence assessment [5]. Tumor heterogeneity is recognized to be involved in cancer treatment failure, with worse clinical outcomes for highly heterogeneous tumors [6,7]. This leads to the existence of tumor sub-regions with different biological behavior (some more aggressive and treatment-resistant than others) [8-10]. Which are characterized by a different pattern of vascularization, vessel permeability, metabolism, cell proliferation, cell death, and other features, that can be measured by modern medical imaging techniques, including positron emission tomography/computed tomography (PET/CT) [10-12]. Thus, the assessment of tumor heterogeneity through medical images could allow the prediction of therapy response and long-term outcomes of patients with cancer [13]. PET/CT has become essential in oncology [14,15] and is usually evaluated through semiquantitative metabolic parameters, such as maximum/mean standard uptake value (SUVmax, SUVmean) or metabolic tumor volume (MTV), which are valuables as prognostic image-based biomarkers in several tumors [16-17], but these do not assess tumor heterogeneity. Likewise, fluorodeoxyglucose (18F-FDG) PET/CT is important to differentiate malignant from benign solitary pulmonary nodules (SPN), reducing so the number of patients who undergo unnecessary surgical biopsies. Several publications have shown that some quantitative image features, extracted from medical images, are suitable for diagnosis, tumor staging, the prognosis of treatment response, and long-term evolution of cancer patients [18-20]. The process of extracting and relating image features with clinical or biological variables is called “Radiomics” [9,20-24]. Radiomic parameters, such as textural features have been related directly to tumor heterogeneity [25]. This thesis investigated the relationships of the tumor heterogeneity, assessed by 18F-FDG-PET/CT texture analysis, with metabolic parameters and pathologic staging in patients with NSCLC, and explored the diagnostic performance of different metabolic, morphologic, and clinical criteria for classifying (malignant or not) of solitary pulmonary nodules (SPN). Furthermore, 18F-FDG-PET/CT radiomic features of patients with recurrent/metastatic breast cancer were used for constructing predictive models of response to the chemotherapy, based on an optimal combination of several feature selection and machine learning (ML) methods...El cáncer es una de las principales causas de morbilidad y mortalidad. Los más frecuentes son el carcinoma de pulmón de células no pequeñas (NSCLC) y el cáncer de mama, siendo su tratamiento un reto. El diagnóstico se suele realizar mediante biopsia. La heterogeneidad tumoral (HT) está implicada en el fracaso del tratamiento del cáncer, con peores resultados clínicos para tumores muy heterogéneos. Esta conduce a la existencia de subregiones tumorales con diferente comportamiento biológico (algunas más agresivas y resistentes al tratamiento); las cuales se caracterizan por diferentes patrones de vascularización, permeabilidad de los vasos sanguíneos, metabolismo, proliferación y muerte celular, que se pueden medir mediante imágenes médicas, incluida la tomografía por emisión de positrones/tomografía computarizada con fluorodesoxiglucosa (18F-FDG-PET/CT). La evaluación de la HT a través de imágenes médicas, podría mejorar la predicción de la respuesta al tratamiento y de los resultados a largo plazo, en pacientes con cáncer. La 18F-FDG-PET/CT es esencial en oncología, generalmente se evalúa con parámetros metabólicos semicuantitativos, como el valor de captación estándar máximo/medio (SUVmáx, SUVmedio) o el volumen tumoral metabólico (MTV), que tienen un gran valor pronóstico en varios tumores, pero no evalúan la HT. Asimismo, es importante para diferenciar los nódulos pulmonares solitarios (NPS) malignos de los benignos, reduciendo el número de pacientes que van a biopsias quirúrgicas innecesarias. Publicaciones recientes muestran que algunas características cuantitativas, extraídas de las imágenes médicas, son robustas para diagnóstico, estadificación, pronóstico de la respuesta al tratamiento y la evolución, de pacientes con cáncer. El proceso de extraer y relacionar estas características con variables clínicas o biológicas se denomina “Radiomica”. Algunos parámetros radiómicos, como la textura, se han relacionado directamente con la HT. Esta tesis investigó las relaciones entre HT, evaluada mediante análisis de textura (AT) de imágenes 18F-FDG-PET/CT, con parámetros metabólicos y estadificación patológica en pacientes con NSCLC, y exploró el rendimiento diagnóstico de diferentes criterios metabólicos, morfológicos y clínicos para la clasificación de NPS. Además, se usaron características radiómicas de imágenes 18F-FDG-PET/CT de pacientes con cáncer de mama recurrente/metastásico, para construir modelos predictivos de la respuesta a la quimioterapia, combinándose varios métodos de selección de características y aprendizaje automático (ML)...Fac. de Ciencias FísicasTRUEunpu

The eye of nuclear medicine

n/

Applications of machine learning algorithms using texture analysis-derived features extracted from computed tomography and magnetic resonance images

Radiomics relies on post-processing images derived from diagnostic examinations such as ultrasound, computed tomography (CT), magnetic resonance (MR) or positron emission tomography, by means of appropriate created algorithms with the extraction of a big amount of data. One of the main applications of radiomics is texture analysis (TA), a post processing imaging technique that analyzes the spatial variation of pixel intensity levels within an image obtaining quantitative data reflecting image heterogeneity. Machine learning (ML) is an application of artificial intelligence for recognizing patterns that can be applied to medical images, enabling the development of algorithms that can learn and make prediction. The aim of the present work is to illustrate our experience in TA and ML field using MR and CT images acquired in patients with adrenal lesions and head and neck cancer imaging, respectively. In particular, we aimed to assess the accuracy of ML algorithms in the differential diagnosis of adrenal lesions and to predict tumor grade and nodal involvement in oropharynx and oral cavity squamocellular carcinoma using MR and CT images, respectively. According to our results, the ML algorithm using MR-derived texture features correctly classified the 80% of adrenal lesions, performing better than a senior radiologist. When applied to CT-derived texture features, the ML classifier was also useful to accurately predict tumor grade, the presence of nodal involvement and to define N stage in patients with OC and OP SCC with a diagnostic accuracy of 91.6%, 85.5% and 90%, respectively Our results support the potential use of ML software employing TA-derived features for the differential diagnosis of solid lesions as well as for the prediction of histological features and the presence of nodal metastases in oncologic patients. The proven potential of ML to provide quantitative imaging biomarkers as well as the fast development of this technique will probably lead to its clinical implementation in radiological practice

Application of radiomics in diagnosis and treatment of lung cancer

Radiomics has become a research field that involves the process of converting standard nursing images into quantitative image data, which can be combined with other data sources and subsequently analyzed using traditional biostatistics or artificial intelligence (Al) methods. Due to the capture of biological and pathophysiological information by radiomics features, these quantitative radiomics features have been proven to provide fast and accurate non-invasive biomarkers for lung cancer risk prediction, diagnosis, prognosis, treatment response monitoring, and tumor biology. In this review, radiomics has been emphasized and discussed in lung cancer research, including advantages, challenges, and drawbacks

Quantitative PET and SPECT

Since the introduction of personalized medicine, the primary focus of imaging has moved from detection and diagnosis to tissue characterization, the determination of prognosis, prediction of treatment efficacy, and measurement of treatment response. Precision (personalized) imaging heavily relies on the use of hybrid technologies and quantitative imaging biomarkers. The growing number of promising theragnostics require accurate quantification for pre- and post-treatment dosimetry. Furthermore, quantification is required in the pharmacokinetic analysis of new tracers and drugs and in the assessment of drug resistance. Positron Emission Tomography (PET) is, by nature, a quantitative imaging tool, relating the time–activity concentration in tissues and the basic functional parameters governing the biological processes being studied. Recent innovations in single photon emission computed tomography (SPECT) reconstruction techniques have allowed for SPECT to move from relative/semi-quantitative measures to absolute quantification. The strength of PET and SPECT is that they permit whole-body molecular imaging in a noninvasive way, evaluating multiple disease sites. Furthermore, serial scanning can be performed, allowing for the measurement of functional changes over time during therapeutic interventions. This Special Issue highlights the hot topics on quantitative PET and SPECT