A representational framework and user-interface for an image understanding workstation

Problems in image understanding involve a wide variety of data (e.g., image arrays, edge maps, 3-D shape models) and processes or algorithms (e.g., convolution, feature extraction, rendering). The underlying structure of an Image Understanding Workstation designed to support mulitple levels and types of representations for both data and processes is described, also the user-interface. The Image Understanding Workstation consists of two parts: the Image Understanding (IU) Framework, and the user-interface. The IU Framework is the set of data and process representations. It includes multiple levels of representation for data such as images (2-D), sketches (2-D), surfaces (2 1/2 D), and models (3-D). The representation scheme for processes characterizes their inputs, outputs, and parameters. Data and processes may reside on different classes of machines. The user-interface to the IU Workstation gives the user convenient access for creating, manipulating, transforming, and displaying image data. The user-interface follows the structure of the IU Framework and gives the user control over multiple types of data and processes. Both the IU Framework and user-interface are implemented on a LISP machine

Quantifying the Preferential Direction of the Model Gradient in Adversarial Training With Projected Gradient Descent

Adversarial training, especially projected gradient descent (PGD), has been the most successful approach for improving robustness against adversarial attacks. After adversarial training, gradients of models with respect to their inputs have a preferential direction. However, the direction of alignment is not mathematically well established, making it difficult to evaluate quantitatively. We propose a novel definition of this direction as the direction of the vector pointing toward the closest point of the support of the closest inaccurate class in decision space. To evaluate the alignment with this direction after adversarial training, we apply a metric that uses generative adversarial networks to produce the smallest residual needed to change the class present in the image. We show that PGD-trained models have a higher alignment than the baseline according to our definition, that our metric presents higher alignment values than a competing metric formulation, and that enforcing this alignment increases the robustness of models.Comment: Updates for second version: added methods/analysis for multiclass datasets; added new references found since last submission; removed claims about interpretability; overall editin

Interpretation of Disease Evidence for Medical Images Using Adversarial Deformation Fields

The high complexity of deep learning models is associated with the difficulty of explaining what evidence they recognize as correlating with specific disease labels. This information is critical for building trust in models and finding their biases. Until now, automated deep learning visualization solutions have identified regions of images used by classifiers, but these solutions are too coarse, too noisy, or have a limited representation of the way images can change. We propose a novel method for formulating and presenting spatial explanations of disease evidence, called deformation field interpretation with generative adversarial networks (DeFI-GAN). An adversarially trained generator produces deformation fields that modify images of diseased patients to resemble images of healthy patients. We validate the method studying chronic obstructive pulmonary disease (COPD) evidence in chest x-rays (CXRs) and Alzheimer's disease (AD) evidence in brain MRIs. When extracting disease evidence in longitudinal data, we show compelling results against a baseline producing difference maps. DeFI-GAN also highlights disease biomarkers not found by previous methods and potential biases that may help in investigations of the dataset and of the adopted learning methods.Comment: Accepted for MICCAI 202

Adversarial regression training for visualizing the progression of chronic obstructive pulmonary disease with chest x-rays

Knowledge of what spatial elements of medical images deep learning methods use as evidence is important for model interpretability, trustiness, and validation. There is a lack of such techniques for models in regression tasks. We propose a method, called visualization for regression with a generative adversarial network (VR-GAN), for formulating adversarial training specifically for datasets containing regression target values characterizing disease severity. We use a conditional generative adversarial network where the generator attempts to learn to shift the output of a regressor through creating disease effect maps that are added to the original images. Meanwhile, the regressor is trained to predict the original regression value for the modified images. A model trained with this technique learns to provide visualization for how the image would appear at different stages of the disease. We analyze our method in a dataset of chest x-rays associated with pulmonary function tests, used for diagnosing chronic obstructive pulmonary disease (COPD). For validation, we compute the difference of two registered x-rays of the same patient at different time points and correlate it to the generated disease effect map. The proposed method outperforms a technique based on classification and provides realistic-looking images, making modifications to images following what radiologists usually observe for this disease. Implementation code is available at https://github.com/ricbl/vrgan.Comment: Accepted for MICCAI 201

Effect of strain on surface diffusion in semiconductor heteroepitaxy

We present a first-principles analysis of the strain renormalization of the cation diffusivity on the GaAs(001) surface. For the example of In/GaAs(001)-c(4x4) it is shown that the binding of In is increased when the substrate lattice is expanded. The diffusion barrier \Delta E(e) has a non-monotonic strain dependence with a maximum at compressive strain values (e 0) studied. We discuss the consequences of spatial variations of both the binding energy and the diffusion barrier of an adatom caused by the strain field around a heteroepitaxial island. For a simplified geometry, we evaluate the speed of growth of two coherently strained islands on the GaAs(001) surface and identify a growth regime where island sizes tend to equalize during growth due to the strain dependence of surface diffusion.Comment: 10 pages, 8 figures, LaTeX2e, to appear in Phys. Rev. B (2001). Other related publications can be found at http://www.rz-berlin.mpg.de/th/paper.htm

Physician supply forecast: better than peering in a crystal ball?

<p>Abstract</p> <p>Background</p> <p>Anticipating physician supply to tackle future health challenges is a crucial but complex task for policy planners. A number of forecasting tools are available, but the methods, advantages and shortcomings of such tools are not straightforward and not always well appraised. Therefore this paper had two objectives: to present a typology of existing forecasting approaches and to analyse the methodology-related issues.</p> <p>Methods</p> <p>A literature review was carried out in electronic databases Medline-Ovid, Embase and ERIC. Concrete examples of planning experiences in various countries were analysed.</p> <p>Results</p> <p>Four main forecasting approaches were identified. The supply projection approach defines the necessary inflow to maintain or to reach in the future an arbitrary predefined level of service offer. The demand-based approach estimates the quantity of health care services used by the population in the future to project physician requirements. The needs-based approach involves defining and predicting health care deficits so that they can be addressed by an adequate workforce. Benchmarking health systems with similar populations and health profiles is the last approach. These different methods can be combined to perform a gap analysis. The methodological challenges of such projections are numerous: most often static models are used and their uncertainty is not assessed; valid and comprehensive data to feed into the models are often lacking; and a rapidly evolving environment affects the likelihood of projection scenarios. As a result, the internal and external validity of the projections included in our review appeared limited.</p> <p>Conclusion</p> <p>There is no single accepted approach to forecasting physician requirements. The value of projections lies in their utility in identifying the current and emerging trends to which policy-makers need to respond. A genuine gap analysis, an effective monitoring of key parameters and comprehensive workforce planning are key elements to improving the usefulness of physician supply projections.</p

Non-emphysematous chronic obstructive pulmonary disease is associated with diabetes mellitus

Abstract Background Chronic obstructive pulmonary disease (COPD) has been classically divided into blue bloaters and pink puffers. The utility of these clinical subtypes is unclear. However, the broader distinction between airway-predominant and emphysema-predominant COPD may be clinically relevant. The objective was to define clinical features of emphysema-predominant and non-emphysematous COPD patients. Methods Current and former smokers from the Genetic Epidemiology of COPD Study (COPDGene) had chest computed tomography (CT) scans with quantitative image analysis. Emphysema-predominant COPD was defined by low attenuation area at -950 Hounsfield Units (LAA-950) ≥10%. Non-emphysematous COPD was defined by airflow obstruction with minimal to no emphysema (LAA-950 < 5%). Results Out of 4197 COPD subjects, 1687 were classified as emphysema-predominant and 1817 as non-emphysematous; 693 had LAA-950 between 5–10% and were not categorized. Subjects with emphysema-predominant COPD were older (65.6 vs 60.6 years, p < 0.0001) with more severe COPD based on airflow obstruction (FEV1 44.5 vs 68.4%, p < 0.0001), greater exercise limitation (6-minute walk distance 1138 vs 1331 ft, p < 0.0001) and reduced quality of life (St. George’s Respiratory Questionnaire score 43 vs 31, p < 0.0001). Self-reported diabetes was more frequent in non-emphysematous COPD (OR 2.13, p < 0.001), which was also confirmed using a strict definition of diabetes based on medication use. The association between diabetes and non-emphysematous COPD was replicated in the ECLIPSE study. Conclusions Non-emphysematous COPD, defined by airflow obstruction with a paucity of emphysema on chest CT scan, is associated with an increased risk of diabetes. COPD patients without emphysema may warrant closer monitoring for diabetes, hypertension, and hyperlipidemia and vice versa. Trial registration Clinicaltrials.gov identifiers: COPDGene NCT00608764 , ECLIPSE NCT00292552 .http://deepblue.lib.umich.edu/bitstream/2027.42/109496/1/12890_2014_Article_599.pd