Recent Applications of Artificial Intelligence in Radiotherapy: Where We Are and Beyond

In recent decades, artificial intelligence (AI) tools have been applied in many medical fields, opening the possibility of finding novel solutions for managing very complex and multifactorial problems, such as those commonly encountered in radiotherapy (RT). We conducted a PubMed and Scopus search to identify the AI application field in RT limited to the last four years. In total, 1824 original papers were identified, and 921 were analyzed by considering the phase of the RT workflow according to the applied AI approaches. AI permits the processing of large quantities of information, data, and images stored in RT oncology information systems, a process that is not manageable for individuals or groups. AI allows the iterative application of complex tasks in large datasets (e.g., delineating normal tissues or finding optimal planning solutions) and might support the entire community working in the various sectors of RT, as summarized in this overview. AI-based tools are now on the roadmap for RT and have been applied to the entire workflow, mainly for segmentation, the generation of synthetic images, and outcome prediction. Several concerns were raised, including the need for harmonization while overcoming ethical, legal, and skill barriers

Intensity modulated radiation therapy and arc therapy: validation and evolution as applied to tumours of the head and neck, abdominal and pelvic regions

Intensiteitsgemoduleerde radiotherapie (IMRT) laat een betere controle over de dosisdistributie (DD) toe dan meer conventionele bestralingstechnieken. Zo is het met IMRT mogelijk om concave DDs te bereiken en om de risico-organen conformeel uit te sparen. IMRT werd in het UZG klinisch toegepast voor een hele waaier van tumorlocalisaties. De toepassing van IMRT voor de bestraling van hoofd- en halstumoren (HHT) vormt het onderwerp van het eerste deel van deze thesis. De planningsstrategie voor herbestralingen en bestraling van HHT, uitgaande van de keel en de mondholte wordt beschreven, evenals de eerste klinische resultaten hiervan. IMRT voor tumoren van de neus(bij)holten leidt tot minstens even goede lokale controle (LC) en overleving als conventionele bestralingstechnieken, en dit zonder stralingsgeïnduceerde blindheid. IMRT leidt dus tot een gunstiger toxiciteitprofiel maar heeft nog geen bewijs kunnen leveren van een gunstig effect op LC of overleving. De meeste hervallen van HHT worden gezien in het gebied dat tot een hoge dosis bestraald werd, wat erop wijst dat deze “hoge dosis” niet volstaat om alle clonogene tumorcellen uit te schakelen. We startten een studie op, om de mogelijkheid van dosisescalatie op geleide van biologische beeldvorming uit te testen. Naast de toepassing en klinische validatie van IMRT bestond het werk in het kader van deze thesis ook uit de ontwikkeling en het klinisch opstarten van intensiteitgemoduleerde arc therapie (IMAT). IMAT is een rotationele vorm van IMRT (d.w.z. de gantry draait rond tijdens de bestraling), waarbij de modulatie van de intensiteit bereikt wordt door overlappende arcs. IMAT heeft enkele duidelijke voordelen ten opzichte van IMRT in bepaalde situaties. Als het doelvolume concaaf rond een risico-orgaan ligt met een grote diameter, biedt IMAT eigenlijk een oneindig aantal bundelrichtingen aan. Een planningsstrategie voor IMAT werd ontwikkeld, en type-oplossingen voor totaal abdominale bestraling en rectumbestraling werden onderzocht en klinisch toegepast

Odontology & artificial intelligence

Neste trabalho avaliam-se os três fatores que fizeram da inteligência artificial uma tecnologia essencial hoje em dia, nomeadamente para a odontologia: o desempenho do computador, Big Data e avanços algorítmicos. Esta revisão da literatura avaliou todos os artigos publicados na PubMed até Abril de 2019 sobre inteligência artificial e odontologia. Ajudado com inteligência artificial, este artigo analisou 1511 artigos. Uma árvore de decisão (If/Then) foi executada para selecionar os artigos mais relevantes (217), e um algoritmo de cluster k-means para resumir e identificar oportunidades de inovação. O autor discute os artigos mais interessantes revistos e compara o que foi feito em inovação durante o International Dentistry Show, 2019 em Colónia. Concluiu, assim, de forma crítica que há uma lacuna entre tecnologia e aplicação clínica desta, sendo que a inteligência artificial fornecida pela indústria de hoje pode ser considerada um atraso para o clínico de amanhã, indicando-se um possível rumo para a aplicação clínica da inteligência artificial.There are three factors that have made artificial intelligence (AI) an essential technology today: the computer performance, Big Data and algorithmic advances. This study reviews the literature on AI and Odontology based on articles retrieved from PubMed. With the help of AI, this article analyses a large number of articles (a total of 1511). A decision tree (If/Then) was run to select the 217 most relevant articles-. Ak-means cluster algorithm was then used to summarize and identify innovation opportunities. The author discusses the most interesting articles on AI research and compares them to the innovation presented during the International Dentistry Show 2019 in Cologne. Three technologies available now are evaluated and three suggested options are been developed. The author concludes that AI provided by the industry today is a hold-up for the praticioner of tomorrow. The author gives his opinion on how to use AI for the profit of patients

Using machine learning to understand and improve care and outcomes for patients with head and neck cancer

Head and neck cancer (HNC) is a complex disease with diversity in treatment modality and survival by anatomical site of origin. There is limited knowledge of the utility of oncology information systems (OIS) for the collection and reporting of HNC data during routine clinical practice to investigate prognostic factors and predict head and neck cancer-specific survival (HNCSS). Routinely collected structured data was extracted from an OIS from seven major hospitals in Australia for patients diagnosed with HNC between 2000 and 2017 and treated with definitive radiotherapy. Deaths were obtained from the National Death Index via record linkage, and HNCSS was measured from the date of diagnosis until death from HNC. Open-source machine learning and nomogram models were used to predict HNCSS and perform multivariable analysis to identify prognostic factors. Descriptive and survival analysis was used to identify inter-hospital variation in data collection, primary radiotherapy treatment, and survival. A random sample of clinical radiation oncology documents from an OIS were anonymised using a customised open-source tool (Microsoft Presidio) to evaluate the use of unstructured information for medical research. Not all user-defined fields were routinely completed and not all hospitals relied solely on the OIS, with one hospital collecting disease information in a parallel database. However, structured information collected in a standardised way with minimal missing data during routine clinical practice in an OIS can be used to predict two-year HNCSS with high performance. Evidence of inter-hospital variation in data completeness, primary radiotherapy dose, and five-year HNCSS was detected. The presence of missing data in the OIS reduced the number of predictors for prognostic analysis and prevented exploratory analysis to explain differences in survival by hospital. Lastly, the application of the anonymisation tool on unstructured clinical information sourced from an OIS demonstrated safe and secure use for some fields and a need to improve the detection and removal of person names. Data mining techniques for unstructured data or strategies to improve structured data collection should be explored to enable the development of prediction models using more complete data, patients, and variables, followed by external validation to confirm model performance

Methodological conduct of prognostic prediction models developed using machine learning in oncology: a systematic review.

BACKGROUND: Describe and evaluate the methodological conduct of prognostic prediction models developed using machine learning methods in oncology. METHODS: We conducted a systematic review in MEDLINE and Embase between 01/01/2019 and 05/09/2019, for studies developing a prognostic prediction model using machine learning methods in oncology. We used the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement, Prediction model Risk Of Bias ASsessment Tool (PROBAST) and CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies (CHARMS) to assess the methodological conduct of included publications. Results were summarised by modelling type: regression-, non-regression-based and ensemble machine learning models. RESULTS: Sixty-two publications met inclusion criteria developing 152 models across all publications. Forty-two models were regression-based, 71 were non-regression-based and 39 were ensemble models. A median of 647 individuals (IQR: 203 to 4059) and 195 events (IQR: 38 to 1269) were used for model development, and 553 individuals (IQR: 69 to 3069) and 50 events (IQR: 17.5 to 326.5) for model validation. A higher number of events per predictor was used for developing regression-based models (median: 8, IQR: 7.1 to 23.5), compared to alternative machine learning (median: 3.4, IQR: 1.1 to 19.1) and ensemble models (median: 1.7, IQR: 1.1 to 6). Sample size was rarely justified (n = 5/62; 8%). Some or all continuous predictors were categorised before modelling in 24 studies (39%). 46% (n = 24/62) of models reporting predictor selection before modelling used univariable analyses, and common method across all modelling types. Ten out of 24 models for time-to-event outcomes accounted for censoring (42%). A split sample approach was the most popular method for internal validation (n = 25/62, 40%). Calibration was reported in 11 studies. Less than half of models were reported or made available. CONCLUSIONS: The methodological conduct of machine learning based clinical prediction models is poor. Guidance is urgently needed, with increased awareness and education of minimum prediction modelling standards. Particular focus is needed on sample size estimation, development and validation analysis methods, and ensuring the model is available for independent validation, to improve quality of machine learning based clinical prediction models

Advanced Computational Methods for Oncological Image Analysis

[Cancer is the second most common cause of death worldwide and encompasses highly variable clinical and biological scenarios. Some of the current clinical challenges are (i) early diagnosis of the disease and (ii) precision medicine, which allows for treatments targeted to specific clinical cases. The ultimate goal is to optimize the clinical workflow by combining accurate diagnosis with the most suitable therapies. Toward this, large-scale machine learning research can define associations among clinical, imaging, and multi-omics studies, making it possible to provide reliable diagnostic and prognostic biomarkers for precision oncology. Such reliable computer-assisted methods (i.e., artificial intelligence) together with clinicians’ unique knowledge can be used to properly handle typical issues in evaluation/quantification procedures (i.e., operator dependence and time-consuming tasks). These technical advances can significantly improve result repeatability in disease diagnosis and guide toward appropriate cancer care. Indeed, the need to apply machine learning and computational intelligence techniques has steadily increased to effectively perform image processing operations—such as segmentation, co-registration, classification, and dimensionality reduction—and multi-omics data integration.

Heterogeneidad tumoral en imágenes PET-CT

Tesis inédita de la Universidad Complutense de Madrid, Facultad de Ciencias Físicas, Departamento de Estructura de la Materia, Física Térmica y Electrónica, leída el 28/01/2021Cancer is a leading cause of morbidity and mortality [1]. The most frequent cancers worldwide are non–small cell lung carcinoma (NSCLC) and breast cancer [2], being their management a challenging task [3]. Tumor diagnosis is usually made through biopsy [4]. However, medical imaging also plays an important role in diagnosis, staging, response to treatment, and recurrence assessment [5]. Tumor heterogeneity is recognized to be involved in cancer treatment failure, with worse clinical outcomes for highly heterogeneous tumors [6,7]. This leads to the existence of tumor sub-regions with different biological behavior (some more aggressive and treatment-resistant than others) [8-10]. Which are characterized by a different pattern of vascularization, vessel permeability, metabolism, cell proliferation, cell death, and other features, that can be measured by modern medical imaging techniques, including positron emission tomography/computed tomography (PET/CT) [10-12]. Thus, the assessment of tumor heterogeneity through medical images could allow the prediction of therapy response and long-term outcomes of patients with cancer [13]. PET/CT has become essential in oncology [14,15] and is usually evaluated through semiquantitative metabolic parameters, such as maximum/mean standard uptake value (SUVmax, SUVmean) or metabolic tumor volume (MTV), which are valuables as prognostic image-based biomarkers in several tumors [16-17], but these do not assess tumor heterogeneity. Likewise, fluorodeoxyglucose (18F-FDG) PET/CT is important to differentiate malignant from benign solitary pulmonary nodules (SPN), reducing so the number of patients who undergo unnecessary surgical biopsies. Several publications have shown that some quantitative image features, extracted from medical images, are suitable for diagnosis, tumor staging, the prognosis of treatment response, and long-term evolution of cancer patients [18-20]. The process of extracting and relating image features with clinical or biological variables is called “Radiomics” [9,20-24]. Radiomic parameters, such as textural features have been related directly to tumor heterogeneity [25]. This thesis investigated the relationships of the tumor heterogeneity, assessed by 18F-FDG-PET/CT texture analysis, with metabolic parameters and pathologic staging in patients with NSCLC, and explored the diagnostic performance of different metabolic, morphologic, and clinical criteria for classifying (malignant or not) of solitary pulmonary nodules (SPN). Furthermore, 18F-FDG-PET/CT radiomic features of patients with recurrent/metastatic breast cancer were used for constructing predictive models of response to the chemotherapy, based on an optimal combination of several feature selection and machine learning (ML) methods...El cáncer es una de las principales causas de morbilidad y mortalidad. Los más frecuentes son el carcinoma de pulmón de células no pequeñas (NSCLC) y el cáncer de mama, siendo su tratamiento un reto. El diagnóstico se suele realizar mediante biopsia. La heterogeneidad tumoral (HT) está implicada en el fracaso del tratamiento del cáncer, con peores resultados clínicos para tumores muy heterogéneos. Esta conduce a la existencia de subregiones tumorales con diferente comportamiento biológico (algunas más agresivas y resistentes al tratamiento); las cuales se caracterizan por diferentes patrones de vascularización, permeabilidad de los vasos sanguíneos, metabolismo, proliferación y muerte celular, que se pueden medir mediante imágenes médicas, incluida la tomografía por emisión de positrones/tomografía computarizada con fluorodesoxiglucosa (18F-FDG-PET/CT). La evaluación de la HT a través de imágenes médicas, podría mejorar la predicción de la respuesta al tratamiento y de los resultados a largo plazo, en pacientes con cáncer. La 18F-FDG-PET/CT es esencial en oncología, generalmente se evalúa con parámetros metabólicos semicuantitativos, como el valor de captación estándar máximo/medio (SUVmáx, SUVmedio) o el volumen tumoral metabólico (MTV), que tienen un gran valor pronóstico en varios tumores, pero no evalúan la HT. Asimismo, es importante para diferenciar los nódulos pulmonares solitarios (NPS) malignos de los benignos, reduciendo el número de pacientes que van a biopsias quirúrgicas innecesarias. Publicaciones recientes muestran que algunas características cuantitativas, extraídas de las imágenes médicas, son robustas para diagnóstico, estadificación, pronóstico de la respuesta al tratamiento y la evolución, de pacientes con cáncer. El proceso de extraer y relacionar estas características con variables clínicas o biológicas se denomina “Radiomica”. Algunos parámetros radiómicos, como la textura, se han relacionado directamente con la HT. Esta tesis investigó las relaciones entre HT, evaluada mediante análisis de textura (AT) de imágenes 18F-FDG-PET/CT, con parámetros metabólicos y estadificación patológica en pacientes con NSCLC, y exploró el rendimiento diagnóstico de diferentes criterios metabólicos, morfológicos y clínicos para la clasificación de NPS. Además, se usaron características radiómicas de imágenes 18F-FDG-PET/CT de pacientes con cáncer de mama recurrente/metastásico, para construir modelos predictivos de la respuesta a la quimioterapia, combinándose varios métodos de selección de características y aprendizaje automático (ML)...Fac. de Ciencias FísicasTRUEunpu

Prognostic radiological variables derived from oesophageal cancer staging investigations

Accurate radiological staging is vital in oesophageal cancer (OC). Radiological staging largely informs risk-stratification, treatment decisions and planning. However, the prognosis of OC remains poor, suggesting that radiological staging must improve. Therefore, the additional value of novel prognostic variables compared to current staging methods was assessed in a large cohort of OC patients managed by a regional upper gastrointestinal cancer network. Radiological-pathological correlation of resected lymph nodes assessed the accuracy of CT, EUS and PET/CT N-stage. The added value of PET-defined variables to predict circumferential resection margin (CRM) involvement was investigated. With EUS use declining, differences in PET and EUS measurements were assessed to understand potential implications for treatment planning should staging PET/CT be performed alone. Validation of two prognostic models; one in patients staged N0 on PET/CT and one incorporating novel PET features, was performed. The accuracy of CT, EUS and PET/CT N-stage was poor (54.5%, 55.4% and 57.1%, respectively) which greatly impacts on patient selection and treatment decisions. EUS continues to play an important role in OC staging, being significantly and independently associated with overall survival (OS;p=0.012) and CRM involvement (p=0.022). PET-defined variables had no additional value for predicting CRM status. The difference between PET and EUS length of disease was statistically significant (p<0.001), increasing the risk of geographical miss (38.1%) had PET/CT been used alone. Three novel PET image features (log (TLG), log(Histogram Energy) and Histogram Kurtosis) were independently associated with OS in the prognostic model. There was a significant OS difference between patient quartiles (p<0.001) in the development and validation cohorts. Incorporation of these image features added prognostic value and improved model performance compared to current staging methods. These significant data demonstrate radiological prognostic variables that add value in OC management and highlight the importance of improved radiological staging

Advanced machine learning methods for oncological image analysis

Cancer is a major public health problem, accounting for an estimated 10 million deaths worldwide in 2020 alone. Rapid advances in the field of image acquisition and hardware development over the past three decades have resulted in the development of modern medical imaging modalities that can capture high-resolution anatomical, physiological, functional, and metabolic quantitative information from cancerous organs. Therefore, the applications of medical imaging have become increasingly crucial in the clinical routines of oncology, providing screening, diagnosis, treatment monitoring, and non/minimally- invasive evaluation of disease prognosis. The essential need for medical images, however, has resulted in the acquisition of a tremendous number of imaging scans. Considering the growing role of medical imaging data on one side and the challenges of manually examining such an abundance of data on the other side, the development of computerized tools to automatically or semi-automatically examine the image data has attracted considerable interest. Hence, a variety of machine learning tools have been developed for oncological image analysis, aiming to assist clinicians with repetitive tasks in their workflow. This thesis aims to contribute to the field of oncological image analysis by proposing new ways of quantifying tumor characteristics from medical image data. Specifically, this thesis consists of six studies, the first two of which focus on introducing novel methods for tumor segmentation. The last four studies aim to develop quantitative imaging biomarkers for cancer diagnosis and prognosis. The main objective of Study I is to develop a deep learning pipeline capable of capturing the appearance of lung pathologies, including lung tumors, and integrating this pipeline into the segmentation networks to leverage the segmentation accuracy. The proposed pipeline was tested on several comprehensive datasets, and the numerical quantifications show the superiority of the proposed prior-aware DL framework compared to the state of the art. Study II aims to address a crucial challenge faced by supervised segmentation models: dependency on the large-scale labeled dataset. In this study, an unsupervised segmentation approach is proposed based on the concept of image inpainting to segment lung and head- neck tumors in images from single and multiple modalities. The proposed autoinpainting pipeline shows great potential in synthesizing high-quality tumor-free images and outperforms a family of well-established unsupervised models in terms of segmentation accuracy. Studies III and IV aim to automatically discriminate the benign from the malignant pulmonary nodules by analyzing the low-dose computed tomography (LDCT) scans. In Study III, a dual-pathway deep classification framework is proposed to simultaneously take into account the local intra-nodule heterogeneities and the global contextual information. Study IV seeks to compare the discriminative power of a series of carefully selected conventional radiomics methods, end-to-end Deep Learning (DL) models, and deep features-based radiomics analysis on the same dataset. The numerical analyses show the potential of fusing the learned deep features into radiomic features for boosting the classification power. Study V focuses on the early assessment of lung tumor response to the applied treatments by proposing a novel feature set that can be interpreted physiologically. This feature set was employed to quantify the changes in the tumor characteristics from longitudinal PET-CT scans in order to predict the overall survival status of the patients two years after the last session of treatments. The discriminative power of the introduced imaging biomarkers was compared against the conventional radiomics, and the quantitative evaluations verified the superiority of the proposed feature set. Whereas Study V focuses on a binary survival prediction task, Study VI addresses the prediction of survival rate in patients diagnosed with lung and head-neck cancer by investigating the potential of spherical convolutional neural networks and comparing their performance against other types of features, including radiomics. While comparable results were achieved in intra- dataset analyses, the proposed spherical-based features show more predictive power in inter-dataset analyses. In summary, the six studies incorporate different imaging modalities and a wide range of image processing and machine-learning techniques in the methods developed for the quantitative assessment of tumor characteristics and contribute to the essential procedures of cancer diagnosis and prognosis

The impact of arterial input function determination variations on prostate dynamic contrast-enhanced magnetic resonance imaging pharmacokinetic modeling: a multicenter data analysis challenge, part II

This multicenter study evaluated the effect of variations in arterial input function (AIF) determination on pharmacokinetic (PK) analysis of dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) data using the shutter-speed model (SSM). Data acquired from eleven prostate cancer patients were shared among nine centers. Each center used a site-specific method to measure the individual AIF from each data set and submitted the results to the managing center. These AIFs, their reference tissue-adjusted variants, and a literature population-averaged AIF, were used by the managing center to perform SSM PK analysis to estimate Ktrans (volume transfer rate constant), ve (extravascular, extracellular volume fraction), kep (efflux rate constant), and τi (mean intracellular water lifetime). All other variables, including the definition of the tumor region of interest and precontrast T1 values, were kept the same to evaluate parameter variations caused by variations in only the AIF. Considerable PK parameter variations were observed with within-subject coefficient of variation (wCV) values of 0.58, 0.27, 0.42, and 0.24 for Ktrans, ve, kep, and τi, respectively, using the unadjusted AIFs. Use of the reference tissue-adjusted AIFs reduced variations in Ktrans and ve (wCV = 0.50 and 0.10, respectively), but had smaller effects on kep and τi (wCV = 0.39 and 0.22, respectively). kep is less sensitive to AIF variation than Ktrans, suggesting it may be a more robust imaging biomarker of prostate microvasculature. With low sensitivity to AIF uncertainty, the SSM-unique τi parameter may have advantages over the conventional PK parameters in a longitudinal study