Artificial intelligence in cancer imaging: Clinical challenges and applications

Judgement, as one of the core tenets of medicine, relies upon the integration of multilayered data with nuanced decision making. Cancer offers a unique context for medical decisions given not only its variegated forms with evolution of disease but also the need to take into account the individual condition of patients, their ability to receive treatment, and their responses to treatment. Challenges remain in the accurate detection, characterization, and monitoring of cancers despite improved technologies. Radiographic assessment of disease most commonly relies upon visual evaluations, the interpretations of which may be augmented by advanced computational analyses. In particular, artificial intelligence (AI) promises to make great strides in the qualitative interpretation of cancer imaging by expert clinicians, including volumetric delineation of tumors over time, extrapolation of the tumor genotype and biological course from its radiographic phenotype, prediction of clinical outcome, and assessment of the impact of disease and treatment on adjacent organs. AI may automate processes in the initial interpretation of images and shift the clinical workflow of radiographic detection, management decisions on whether or not to administer an intervention, and subsequent observation to a yet to be envisioned paradigm. Here, the authors review the current state of AI as applied to medical imaging of cancer and describe advances in 4 tumor types (lung, brain, breast, and prostate) to illustrate how common clinical problems are being addressed. Although most studies evaluating AI applications in oncology to date have not been vigorously validated for reproducibility and generalizability, the results do highlight increasingly concerted efforts in pushing AI technology to clinical use and to impact future directions in cancer care

Weakly Supervised Learning with Automated Labels from Radiology Reports for Glioma Change Detection

Gliomas are the most frequent primary brain tumors in adults. Glioma change detection aims at finding the relevant parts of the image that change over time. Although Deep Learning (DL) shows promising performances in similar change detection tasks, the creation of large annotated datasets represents a major bottleneck for supervised DL applications in radiology. To overcome this, we propose a combined use of weak labels (imprecise, but fast-to-create annotations) and Transfer Learning (TL). Specifically, we explore inductive TL, where source and target domains are identical, but tasks are different due to a label shift: our target labels are created manually by three radiologists, whereas our source weak labels are generated automatically from radiology reports via NLP. We frame knowledge transfer as hyperparameter optimization, thus avoiding heuristic choices that are frequent in related works. We investigate the relationship between model size and TL, comparing a low-capacity VGG with a higher-capacity ResNeXt model. We evaluate our models on 1693 T2-weighted magnetic resonance imaging difference maps created from 183 patients, by classifying them into stable or unstable according to tumor evolution. The weak labels extracted from radiology reports allowed us to increase dataset size more than 3-fold, and improve VGG classification results from 75% to 82% AUC. Mixed training from scratch led to higher performance than fine-tuning or feature extraction. To assess generalizability, we ran inference on an open dataset (BraTS-2015: 15 patients, 51 difference maps), reaching up to 76% AUC. Overall, results suggest that medical imaging problems may benefit from smaller models and different TL strategies with respect to computer vision datasets, and that report-generated weak labels are effective in improving model performances. Code, in-house dataset and BraTS labels are released.Comment: This work has been submitted as Original Paper to a Journa

Metabolic findings on 3T 1H-MR spectroscopy in peritumoral brain edema.

BACKGROUND AND PURPOSE: Little is known about the metabolic properties of brain edema associated with tumors. This work was conducted on the basis of the assumption that, in the presence of intra-axial and extra-axial brain tumors, the white matter involved by the edema is a site of metabolic change that involves the structure of the myelin sheath. MATERIALS AND METHODS: Thirteen patients comprised our cohort affected by intra-axial and extra-axial cerebral tumors with a peritumoral T2-weighted MR signal hyperintensity as a result of edema, where MR spectroscopy showed no increase in choline-containing compounds. Measurements on proton MR spectroscopy (1H-MR spectroscopy) were performed with a 3T whole-body scanner with use of a point-resolved spectroscopy sequence for localization (TR, 2000 ms; TE, 35 ms), and the metabolites were quantified with the SAGE method. Peak intensities of the main metabolites were expressed as ratios of one another and were compared with values obtained in the white matter of the left frontal region in a control group of 16 healthy volunteers. RESULTS: Choline-to-creatine (Cho/Cr) and myo-inositol-to-creatine (mIns/Cr) signal intensity ratios were normal in all patients. N-acetylaspartate-to-creatine (NAA/Cr) and N-acetylaspartate-to-choline (NAA/Cho) ratios decreased in 4 patients. Glutamate plus glutamine-to-creatine (Glx/Cr) was increased in 10 patients. A resonance peak at 3.44 ppm, strongly suggesting the presence of glucose, was detected in all but 1 patient. Lactate was detected in 12 patients and lipids in 5. Moreover, the resonances that pertained to the aliphatic amino acids valine, leucine, and isoleucine were present in 12 patients. CONCLUSIONS: Our findings on MR spectroscopy confirmed the hypothesis that in the edema surrounding brain tumors, an energy-linked metabolic alteration was associated with injury to the myelin sheath

Neuroimaging of structural pathology and connectomics in traumatic brain injury: Toward personalized outcome prediction.

Recent contributions to the body of knowledge on traumatic brain injury (TBI) favor the view that multimodal neuroimaging using structural and functional magnetic resonance imaging (MRI and fMRI, respectively) as well as diffusion tensor imaging (DTI) has excellent potential to identify novel biomarkers and predictors of TBI outcome. This is particularly the case when such methods are appropriately combined with volumetric/morphometric analysis of brain structures and with the exploration of TBI-related changes in brain network properties at the level of the connectome. In this context, our present review summarizes recent developments on the roles of these two techniques in the search for novel structural neuroimaging biomarkers that have TBI outcome prognostication value. The themes being explored cover notable trends in this area of research, including (1) the role of advanced MRI processing methods in the analysis of structural pathology, (2) the use of brain connectomics and network analysis to identify outcome biomarkers, and (3) the application of multivariate statistics to predict outcome using neuroimaging metrics. The goal of the review is to draw the community's attention to these recent advances on TBI outcome prediction methods and to encourage the development of new methodologies whereby structural neuroimaging can be used to identify biomarkers of TBI outcome

Focal Spot, Winter 2009/2010

https://digitalcommons.wustl.edu/focal_spot_archives/1113/thumbnail.jp

Measurement Variability in Treatment Response Determination for Non-Small Cell Lung Cancer: Improvements using Radiomics

Multimodality imaging measurements of treatment response are critical for clinical practice, oncology trials, and the evaluation of new treatment modalities. The current standard for determining treatment response in non-small cell lung cancer (NSCLC) is based on tumor size using the RECIST criteria. Molecular targeted agents and immunotherapies often cause morphological change without reduction of tumor size. Therefore, it is difficult to evaluate therapeutic response by conventional methods. Radiomics is the study of cancer imaging features that are extracted using machine learning and other semantic features. This method can provide comprehensive information on tumor phenotypes and can be used to assess therapeutic response in this new age of immunotherapy. Delta radiomics, which evaluates the longitudinal changes in radiomics features, shows potential in gauging treatment response in NSCLC. It is well known that quantitative measurement methods may be subject to substantial variability due to differences in technical factors and require standardization. In this review, we describe measurement variability in the evaluation of NSCLC and the emerging role of radiomics. © 2019 Wolters Kluwer Health, Inc. All rights reserved

The potential for liquid biopsies in the precision medical treatment of breast cancer.

Currently the clinical management of breast cancer relies on relatively few prognostic/predictive clinical markers (estrogen receptor, progesterone receptor, HER2), based on primary tumor biology. Circulating biomarkers, such as circulating tumor DNA (ctDNA) or circulating tumor cells (CTCs) may enhance our treatment options by focusing on the very cells that are the direct precursors of distant metastatic disease, and probably inherently different than the primary tumor's biology. To shift the current clinical paradigm, assessing tumor biology in real time by molecularly profiling CTCs or ctDNA may serve to discover therapeutic targets, detect minimal residual disease and predict response to treatment. This review serves to elucidate the detection, characterization, and clinical application of CTCs and ctDNA with the goal of precision treatment of breast cancer