Spatio-Temporal Hybrid Fusion of CAE and SWIn Transformers for Lung Cancer Malignancy Prediction

The paper proposes a novel hybrid discovery Radiomics framework that simultaneously integrates temporal and spatial features extracted from non-thin chest Computed Tomography (CT) slices to predict Lung Adenocarcinoma (LUAC) malignancy with minimum expert involvement. Lung cancer is the leading cause of mortality from cancer worldwide and has various histologic types, among which LUAC has recently been the most prevalent. LUACs are classified as pre-invasive, minimally invasive, and invasive adenocarcinomas. Timely and accurate knowledge of the lung nodules malignancy leads to a proper treatment plan and reduces the risk of unnecessary or late surgeries. Currently, chest CT scan is the primary imaging modality to assess and predict the invasiveness of LUACs. However, the radiologists' analysis based on CT images is subjective and suffers from a low accuracy compared to the ground truth pathological reviews provided after surgical resections. The proposed hybrid framework, referred to as the CAET-SWin, consists of two parallel paths: (i) The Convolutional Auto-Encoder (CAE) Transformer path that extracts and captures informative features related to inter-slice relations via a modified Transformer architecture, and; (ii) The Shifted Window (SWin) Transformer path, which is a hierarchical vision transformer that extracts nodules' related spatial features from a volumetric CT scan. Extracted temporal (from the CAET-path) and spatial (from the Swin path) are then fused through a fusion path to classify LUACs. Experimental results on our in-house dataset of 114 pathologically proven Sub-Solid Nodules (SSNs) demonstrate that the CAET-SWin significantly improves reliability of the invasiveness prediction task while achieving an accuracy of 82.65%, sensitivity of 83.66%, and specificity of 81.66% using 10-fold cross-validation.Comment: arXiv admin note: substantial text overlap with arXiv:2110.0872

NYCTALE: Neuro-Evidence Transformer for Adaptive and Personalized Lung Nodule Invasiveness Prediction

Drawing inspiration from the primate brain's intriguing evidence accumulation process, and guided by models from cognitive psychology and neuroscience, the paper introduces the NYCTALE framework, a neuro-inspired and evidence accumulation-based Transformer architecture. The proposed neuro-inspired NYCTALE offers a novel pathway in the domain of Personalized Medicine (PM) for lung cancer diagnosis. In nature, Nyctales are small owls known for their nocturnal behavior, hunting primarily during the darkness of night. The NYCTALE operates in a similarly vigilant manner, i.e., processing data in an evidence-based fashion and making predictions dynamically/adaptively. Distinct from conventional Computed Tomography (CT)-based Deep Learning (DL) models, the NYCTALE performs predictions only when sufficient amount of evidence is accumulated. In other words, instead of processing all or a pre-defined subset of CT slices, for each person, slices are provided one at a time. The NYCTALE framework then computes an evidence vector associated with contribution of each new CT image. A decision is made once the total accumulated evidence surpasses a specific threshold. Preliminary experimental analyses conducted using a challenging in-house dataset comprising 114 subjects. The results are noteworthy, suggesting that NYCTALE outperforms the benchmark accuracy even with approximately 60% less training data on this demanding and small dataset

AI-Enabled Lung Cancer Prognosis

Lung cancer is the primary cause of cancer-related mortality, claiming approximately 1.79 million lives globally in 2020, with an estimated 2.21 million new cases diagnosed within the same period. Among these, Non-Small Cell Lung Cancer (NSCLC) is the predominant subtype, characterized by a notably bleak prognosis and low overall survival rate of approximately 25% over five years across all disease stages. However, survival outcomes vary considerably based on the stage at diagnosis and the therapeutic interventions administered. Recent advancements in artificial intelligence (AI) have revolutionized the landscape of lung cancer prognosis. AI-driven methodologies, including machine learning and deep learning algorithms, have shown promise in enhancing survival prediction accuracy by efficiently analyzing complex multi-omics data and integrating diverse clinical variables. By leveraging AI techniques, clinicians can harness comprehensive prognostic insights to tailor personalized treatment strategies, ultimately improving patient outcomes in NSCLC. Overviewing AI-driven data processing can significantly help bolster the understanding and provide better directions for using such systems.Comment: This is the author's version of a book chapter entitled: "Cancer Research: An Interdisciplinary Approach", Springe

Neural network-based model for evaluating inert nodules and volume doubling time in T1 lung adenocarcinoma: a nested case−control study

ObjectiveThe purpose of this study is to establish model for assessing inert nodules predicting nodule volume-doubling.MethodsA total of 201 patients with T1 lung adenocarcinoma were analysed retrospectively pulmonary nodule information was predicted by an AI pulmonary nodule auxiliary diagnosis system. The nodules were classified into two groups: inert nodules (volume-doubling time (VDT)>600 days n=152) noninert nodules (VDT<600 days n=49). Then taking the clinical imaging features obtained at the first examination as predictive variables the inert nodule judgement model <sn</sn>>(INM) volume-doubling time estimation model (VDTM) were constructed based on a deep learning-based neural network. The performance of the INM was evaluated by the area under the curve (AUC) obtained from receiver operating characteristic (ROC) analysis the performance of the VDTM was evaluated by R2(determination coefficient).ResultsThe accuracy of the INM in the training and testing cohorts was 81.13% and 77.50%, respectively. The AUC of the INM in the training and testing cohorts was 0.7707 (95% CI 0.6779-0.8636) and 0.7700 (95% CI 0.5988-0.9412), respectively. The INM was effective in identifying inert pulmonary nodules; additionally, the R2 of the VDTM in the training cohort was 0.8008, and that in the testing cohort was 0.6268. The VDTM showed moderate performance in estimating the VDT, which can provide some reference during a patients’ first examination and consultationConclusionThe INM and the VDTM based on deep learning can help radiologists and clinicians distinguish among inert nodules and predict the nodule volume-doubling time to accurately treat patients with pulmonary nodules

A survey of deep learning models in medical therapeutic areas.

pre-print1407 K

Application of radiomics in diagnosis and treatment of lung cancer

Radiomics has become a research field that involves the process of converting standard nursing images into quantitative image data, which can be combined with other data sources and subsequently analyzed using traditional biostatistics or artificial intelligence (Al) methods. Due to the capture of biological and pathophysiological information by radiomics features, these quantitative radiomics features have been proven to provide fast and accurate non-invasive biomarkers for lung cancer risk prediction, diagnosis, prognosis, treatment response monitoring, and tumor biology. In this review, radiomics has been emphasized and discussed in lung cancer research, including advantages, challenges, and drawbacks

Investigating the Uncertainties in CT Non-Small Cell Lung Cancer Radiomics

Radiomics is a technique that extracts quantitative features, termed radiomic features, from medical images using data-characterization algorithms. These radiomic features can be used to identify tissue characteristics and radiologic phenotyping that are not observable by clinicians in a non-invasive, low-cost manner, potentially generating image biomarkers for clinical decision. To date, there are still many uncertainties involved in radiomics which limit its clinical implementation. Herein, we propose to explore the impact of each component in the radiomics pipeline on predicting clinical outcomes. In Chapter II, we conduct a thorough review of CT lung cancer radiomics studies to examine the typical feature selection methods and predictive models for radiomics, outlining current practices and identifying common factors that may negatively impact study outcomes. In Chapter III, we investigate radiomic feature uniqueness, a novel approach to evaluate the relationship between radiomic features and underlying tissue structure as a determinant of feature relevance. The results show approximately 10% of the examined radiomic features are not unique to a defined ROI for CT NSCLC. Features that are not unique should be removed prior to conducting radiomic analysis, reducing feature dimensionality in radiomic studies. In Chapter IV, we perform a multi-faceted examination of feature selection methods, predictive models and related factors including cohort size, cohort composition, number of input features, and training/validation methods. The results reveal the impact of these factors on radiomic model performance. In Chapter V, we investigate the impact of clinical features on predicting clinical outcome. The results show that clinical features or their combination with radiomic features can improve predictive performance over radiomic features alone. The uncertainties involved in CT NSCLC radiomics are likely to be present in other radiomic studies where the same or similar machine learning methods are applied. Our study provides a better understanding of the underlying factors in radiomics, which will help establish the foundation for clinical implementation of radiomics