Biomarker Localization From Deep Learning Regression Networks

Biomarker estimation methods from medical images have traditionally followed a segment-and-measure strategy. Deep-learning regression networks have changed such a paradigm, enabling the direct estimation of biomarkers in databases where segmentation masks are not present. While such methods achieve high performance, they operate as a black-box. In this work, we present a novel deep learning network structure that, when trained with only the value of the biomarker, can perform biomarker regression and the generation of an accurate localization mask simultaneously, thus enabling a qualitative assessment of the image locus that relates to the quantitative result. We showcase the proposed method with three different network structures and compare their performance against direct regression networks in four different problems: pectoralis muscle area (PMA), subcutaneous fat area (SFA), liver mass area in single slice computed tomography (CT), and Agatston score estimated from non-contrast thoracic CT images (CAC). Our results show that the proposed method improves the performance with respect to direct biomarker regression methods (correlation coefficient of 0.978, 0.998, and 0.950 for the proposed method in comparison to 0.971, 0.982, and 0.936 for the reference regression methods on PMA, SFA and CAC respectively) while achieving good localization (DICE coefficients of 0.875, 0.914 for PMA and SFA respectively, p < 0.05 for all pairs). We observe the same improvement in regression results comparing the proposed method with those obtained by quantify the outputs using an U-Net segmentation network (0.989 and 0.951 respectively). We, therefore, conclude that it is possible to obtain simultaneously good biomarker regression and localization when training biomarker regression networks using only the biomarker value.This work was supported in part by the National Institutes of Health (NHLBI) under Grant R01HL116931, Grant R21HL14042, and Grant R01HL149877, in part by the COPDGene Study through the NHLBI under Grant NCT00608764, Grant U01 HL089897, and Grant U01 HL089856, and in part by the COPD Foundation through contributions made to the Industry Advisory Committee comprised of AstraZeneca, Boehringer-Ingelheim, GlaxoSmithKline, Novartis, and Sunovion

Bronchoarterial ratio in never‐smokers adults: Implications for bronchial dilation definition

Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/135610/1/resp12875_am.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/135610/2/resp12875.pd

Paired inspiratory-expiratory chest CT scans to assess for small airways disease in COPD

Background: Gas trapping quantified on chest CT scans has been proposed as a surrogate for small airway disease in COPD. We sought to determine if measurements using paired inspiratory and expiratory CT scans may be better able to separate gas trapping due to emphysema from gas trapping due to small airway disease. Methods: Smokers with and without COPD from the COPDGene Study underwent inspiratory and expiratory chest CT scans. Emphysema was quantified by the percent of lung with attenuation < −950HU on inspiratory CT. Four gas trapping measures were defined: (1) Exp−856, the percent of lung < −856HU on expiratory imaging; (2) E/I MLA, the ratio of expiratory to inspiratory mean lung attenuation; (3) RVC856-950, the difference between expiratory and inspiratory lung volumes with attenuation between −856 and −950 HU; and (4) Residuals from the regression of Exp−856 on percent emphysema. Results: In 8517 subjects with complete data, Exp−856 was highly correlated with emphysema. The measures based on paired inspiratory and expiratory CT scans were less strongly correlated with emphysema. Exp−856, E/I MLA and RVC856-950 were predictive of spirometry, exercise capacity and quality of life in all subjects and in subjects without emphysema. In subjects with severe emphysema, E/I MLA and RVC856-950 showed the highest correlations with clinical variables. Conclusions: Quantitative measures based on paired inspiratory and expiratory chest CT scans can be used as markers of small airway disease in smokers with and without COPD, but this will require that future studies acquire both inspiratory and expiratory CT scans

A Genome-wide Association Study of Emphysema and Airway Quantitative Imaging Phenotypes

Rationale: Chronic obstructive pulmonary disease (COPD) is defined by the presence of airflow limitation on spirometry, yet subjects with COPD can have marked differences in computed tomography imaging. These differences may be driven by genetic factors. We hypothesized that a genome-wide association study (GWAS) of quantitative imaging would identify loci not previously identified in analyses of COPD or spirometry. In addition, we sought to determine whether previously described genome-wide significant COPD and spirometric loci were associated with emphysema or airway phenotypes. Objectives: To identify genetic determinants of quantitative imaging phenotypes. Methods: We performed a GWAS on two quantitative emphysema and two quantitative airway imaging phenotypes in the COPDGene (non-Hispanic white and African American), ECLIPSE (Evaluation of COPD Longitudinally to Identify Predictive Surrogate Endpoints), NETT (National Emphysema Treatment Trial), and GenKOLS (Genetics of COPD, Norway) studies and on percentage gas trapping in COPDGene. We also examined specific loci reported as genome-wide significant for spirometric phenotypes related to airflow limitation or COPD. Measurements and Main Results: The total sample size across all cohorts was 12,031, of whom 9,338 were from COPDGene. We identified five loci associated with emphysema-related phenotypes, one with airway-related phenotypes, and two with gas trapping. These loci included previously reported associations, including the HHIP, 15q25, and AGER loci, as well as novel associations near SERPINA10 and DLC1. All previously reported COPD and a significant number of spirometric GWAS loci were at least nominally (P < 0.05) associated with either emphysema or airway phenotypes. Conclusions: Genome-wide analysis may identify novel risk factors for quantitative imaging characteristics in COPD and also identify imaging features associated with previously identified lung function loci

Deep learning-based lesion subtyping and prediction of clinical outcomes in COVID-19 pneumonia using chest CT

The main objective of this work is to develop and evaluate an artificial intelligence system based on deep learning capable of automatically identifying, quantifying, and characterizing COVID-19 pneumonia patterns in order to assess disease severity and predict clinical outcomes, and to compare the prediction performance with respect to human reader severity assessment and whole lung radiomics. We propose a deep learning based scheme to automatically segment the different lesion subtypes in nonenhanced CT scans. The automatic lesion quantification was used to predict clinical outcomes. The proposed technique has been independently tested in a multicentric cohort of 103 patients, retrospectively collected between March and July of 2020. Segmentation of lesion subtypes was evaluated using both overlapping (Dice) and distance-based (Hausdorff and average surface) metrics, while the proposed system to predict clinically relevant outcomes was assessed using the area under the curve (AUC). Additionally, other metrics including sensitivity, specificity, positive predictive value and negative predictive value were estimated. 95% confidence intervals were properly calculated. The agreement between the automatic estimate of parenchymal damage (%) and the radiologists' severity scoring was strong, with a Spearman correlation coefficient (R) of 0.83. The automatic quantification of lesion subtypes was able to predict patient mortality, admission to the Intensive Care Units (ICU) and need for mechanical ventilation with an AUC of 0.87, 0.73 and 0.68 respectively. The proposed artificial intelligence system enabled a better prediction of those clinically relevant outcomes when compared to the radiologists' interpretation and to whole lung radiomics. In conclusion, deep learning lesion subtyping in COVID-19 pneumonia from noncontrast chest CT enables quantitative assessment of disease severity and better prediction of clinical outcomes with respect to whole lung radiomics or radiologists' severity score

Ventricular Geometry From Non-contrast Non-ECG-gated CT Scans:An Imaging Marker of Cardiopulmonary Disease in Smokers

Cardiovascular disease is a major cause of morbidity in smokers, and as much as 50% of the estimated 24 million patients in the United States with chronic obstructive pulmonary disease (COPD) die of cardiovascular causes (1,2). Although echocardiography and cardiac magnetic resonance imaging (MRI) are often used to study cardiac structure and function in COPD (3), these are not routinely deployed in all smokers. Computed tomographic (CT) imaging of the chest is broadly used in clinical care and is increasingly used for lung cancer screening in high-risk smokers (4). Assessment of cardiac structure on those CT scans may help identify patients with COPD at greater risk of developing cardiac dysfunction. Rapid, noninvasive assessments of cardiac morphology and a better understanding of the functional interdependence of heart and lung may improve healthcare outcomes through early detection and initiation of treatment

Association Between Interstitial Lung Abnormalities and All-Cause Mortality.

To access publisher's full text version of this article, please click on the hyperlink in Additional Links field or click on the hyperlink at the top of the page marked Files. This article is open access.Interstitial lung abnormalities have been associated with lower 6-minute walk distance, diffusion capacity for carbon monoxide, and total lung capacity. However, to our knowledge, an association with mortality has not been previously investigated.To investigate whether interstitial lung abnormalities are associated with increased mortality.Prospective cohort studies of 2633 participants from the FHS (Framingham Heart Study; computed tomographic [CT] scans obtained September 2008-March 2011), 5320 from the AGES-Reykjavik Study (Age Gene/Environment Susceptibility; recruited January 2002-February 2006), 2068 from the COPDGene Study (Chronic Obstructive Pulmonary Disease; recruited November 2007-April 2010), and 1670 from ECLIPSE (Evaluation of COPD Longitudinally to Identify Predictive Surrogate Endpoints; between December 2005-December 2006).Interstitial lung abnormality status as determined by chest CT evaluation.All-cause mortality over an approximate 3- to 9-year median follow-up time. Cause-of-death information was also examined in the AGES-Reykjavik cohort.Interstitial lung abnormalities were present in 177 (7%) of the 2633 participants from FHS, 378 (7%) of 5320 from AGES-Reykjavik, 156 (8%) of 2068 from COPDGene, and in 157 (9%) of 1670 from ECLIPSE. Over median follow-up times of approximately 3 to 9 years, there were more deaths (and a greater absolute rate of mortality) among participants with interstitial lung abnormalities when compared with those who did not have interstitial lung abnormalities in the following cohorts: 7% vs 1% in FHS (6% difference [95% CI, 2% to 10%]), 56% vs 33% in AGES-Reykjavik (23% difference [95% CI, 18% to 28%]), and 11% vs 5% in ECLIPSE (6% difference [95% CI, 1% to 11%]). After adjustment for covariates, interstitial lung abnormalities were associated with a higher risk of death in the FHS (hazard ratio [HR], 2.7 [95% CI, 1.1 to 6.5]; P = .03), AGES-Reykjavik (HR, 1.3 [95% CI, 1.2 to 1.4]; P < .001), COPDGene (HR, 1.8 [95% CI, 1.1 to 2.8]; P = .01), and ECLIPSE (HR, 1.4 [95% CI, 1.1 to 2.0]; P = .02) cohorts. In the AGES-Reykjavik cohort, the higher rate of mortality could be explained by a higher rate of death due to respiratory disease, specifically pulmonary fibrosis.In 4 separate research cohorts, interstitial lung abnormalities were associated with a greater risk of all-cause mortality. The clinical implications of this association require further investigation.National Institutes of Health (NIH) T32 HL007633 Icelandic Research Fund 141513-051 Landspitali Scientific Fund A-2015-030 National Cancer Institute grant 1K23CA157631 NIH K08 HL097029 R01 HL113264 R21 HL119902 K25 HL104085 R01 HL116931 R01 HL116473 K01 HL118714 R01 HL089897 R01 HL089856 N01-AG-1-2100 HHSN27120120022C P01 HL105339 P01 HL114501 R01 HL107246 R01 HL122464 R01 HL111024 National Heart, Lung, and Blood Institute's Framingham Heart Study contract N01-HC-2519.5 GlaxoSmithKline NCT00292552 5C0104960 National Institute on Aging (NIA) grant 27120120022C NIA Intramural Research Program, Hjartavernd (the Icelandic Heart Association) Althingi (the Icelandic Parliament) NIA 27120120022

Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study

The VESSEL12 (VESsel SEgmentation in the Lung) challenge objectively compares the performance of different algorithms to identify vessels in thoracic computed tomography (CT) scans. Vessel segmentation is fundamental in computer aided processing of data generated by 3D imaging modalities. As manual vessel segmentation is prohibitively time consuming, any real world application requires some form of automation. Several approaches exist for automated vessel segmentation, but judging their relative merits is difficult due to a lack of standardized evaluation. We present an annotated reference dataset containing 20 CT scans and propose nine categories to perform a comprehensive evaluation of vessel segmentation algorithms from both academia and industry. Twenty algorithms participated in the VESSEL12 challenge, held at International Symposium on Biomedical Imaging (ISBI) 2012. All results have been published at the VESSEL12 website http://vessel12.grand-challenge.org. The challenge remains ongoing and open to new participants. Our three contributions are: (1) an annotated reference dataset available online for evaluation of new algorithms; (2) a quantitative scoring system for objective comparison of algorithms; and (3) performance analysis of the strengths and weaknesses of the various vessel segmentation methods in the presence of various lung diseases.Rudyanto, RD.; Kerkstra, S.; Van Rikxoort, EM.; Fetita, C.; Brillet, P.; Lefevre, C.; Xue, W.... (2014). Comparing algorithms for automated vessel segmentation in computed tomography scans of the lung: the VESSEL12 study. Medical Image Analysis. 18(7):1217-1232. doi:10.1016/j.media.2014.07.003S1217123218

Automated Agatston score computation in a large dataset of non ECG-gated chest computed tomography

The Agatston score, computed from ECG-gated computed tomography (CT), is a well established metric of coronary artery disease. It has been recently shown that the Agatston score computed from chest CT (non ECG-gated) studies is highly correlated with the Agatston score computed from cardiac CT scans. In this work we present an automated method to compute the Agatston score from chest CT images. Coronary arteries calcifications (CACs) are defined as voxels contained within the coronary arteries with a value greater or equal to 130 Hounsfield Units (HU). CACs are automatically detected in chest CT studies by locating the heart, generating a region of interest around it, thresholding the image in such region and applying a set of rules to discriminate CACs from calcifications in the main vessels or from metallic implants. We evaluate the methodology in a large cohort of 1500 patients for whom manual reference standard is available. Our results show that the Pearson correlation coefficient between manual and automated Agatston score is ρ = 0.86 (p < 0.0001

Sampling and visualizing creases with scale-space particles.

Particle systems have gained importance as a methodology for sampling implicit surfaces and segmented objects to improve mesh generation and shape analysis. We propose that particle systems have a significantly more general role in sampling structure from unsegmented data. We describe a particle system that computes samplings of crease features (i.e. ridges and valleys, as lines or surfaces) that effectively represent many anatomical structures in scanned medical data. Because structure naturally exists at a range of sizes relative to the image resolution, computer vision has developed the theory of scale-space, which considers an n-D image as an (n+1)-D stack of images at different blurring levels. Our scale-space particles move through continuous four-dimensional scale-space according to spatial constraints imposed by the crease features, a particle-image energy that draws particles towards scales of maximal feature strength, and an inter-particle energy that controls sampling density in space and scale. To make scale-space practical for large three-dimensional data, we present a spline-based interpolation across scale from a small number of pre-computed blurrings at optimally selected scales. The configuration of the particle system is visualized with tensor glyphs that display information about the local Hessian of the image, and the scale of the particle. We use scale-space particles to sample the complex three-dimensional branching structure of airways in lung CT, and the major white matter structures in brain DTI