MedGAN: Medical Image Translation using GANs

Image-to-image translation is considered a new frontier in the field of medical image analysis, with numerous potential applications. However, a large portion of recent approaches offers individualized solutions based on specialized task-specific architectures or require refinement through non-end-to-end training. In this paper, we propose a new framework, named MedGAN, for medical image-to-image translation which operates on the image level in an end-to-end manner. MedGAN builds upon recent advances in the field of generative adversarial networks (GANs) by merging the adversarial framework with a new combination of non-adversarial losses. We utilize a discriminator network as a trainable feature extractor which penalizes the discrepancy between the translated medical images and the desired modalities. Moreover, style-transfer losses are utilized to match the textures and fine-structures of the desired target images to the translated images. Additionally, we present a new generator architecture, titled CasNet, which enhances the sharpness of the translated medical outputs through progressive refinement via encoder-decoder pairs. Without any application-specific modifications, we apply MedGAN on three different tasks: PET-CT translation, correction of MR motion artefacts and PET image denoising. Perceptual analysis by radiologists and quantitative evaluations illustrate that the MedGAN outperforms other existing translation approaches.Comment: 16 pages, 8 figure

MITK-ModelFit: A generic open-source framework for model fits and their exploration in medical imaging -- design, implementation and application on the example of DCE-MRI

Many medical imaging techniques utilize fitting approaches for quantitative parameter estimation and analysis. Common examples are pharmacokinetic modeling in DCE MRI/CT, ADC calculations and IVIM modeling in diffusion-weighted MRI and Z-spectra analysis in chemical exchange saturation transfer MRI. Most available software tools are limited to a special purpose and do not allow for own developments and extensions. Furthermore, they are mostly designed as stand-alone solutions using external frameworks and thus cannot be easily incorporated natively in the analysis workflow. We present a framework for medical image fitting tasks that is included in MITK, following a rigorous open-source, well-integrated and operating system independent policy. Software engineering-wise, the local models, the fitting infrastructure and the results representation are abstracted and thus can be easily adapted to any model fitting task on image data, independent of image modality or model. Several ready-to-use libraries for model fitting and use-cases, including fit evaluation and visualization, were implemented. Their embedding into MITK allows for easy data loading, pre- and post-processing and thus a natural inclusion of model fitting into an overarching workflow. As an example, we present a comprehensive set of plug-ins for the analysis of DCE MRI data, which we validated on existing and novel digital phantoms, yielding competitive deviations between fit and ground truth. Providing a very flexible environment, our software mainly addresses developers of medical imaging software that includes model fitting algorithms and tools. Additionally, the framework is of high interest to users in the domain of perfusion MRI, as it offers feature-rich, freely available, validated tools to perform pharmacokinetic analysis on DCE MRI data, with both interactive and automatized batch processing workflows.Comment: 31 pages, 11 figures URL: http://mitk.org/wiki/MITK-ModelFi

Impulsivity Relates to Relative Preservation of Mesolimbic Connectivity in Patients with Parkinson Disease.

IntroductionThe relationship between Parkinson Disease (PD) pathology, dopamine replacement therapy (DRT), and impulse control disorder (ICD) development is still incompletely understood. Given the sensorimotor-lateral substantia nigra (SN) selective degeneration associated with PD, we posit that a relative sparing of the limbic-medial SN in the context of DRT drives impulsive, reward-seeking behavior in PD patients with recent history of severe impulsivity.MethodsImpulsive and control participants were selected from a consecutive list of PD patients receiving pre-operative deep brain stimulation (DBS) planning scans including 3T structural MRI and 64 direction diffusion tensor imaging (DTI). Using previously identified substantia nigra (SN) subsegment network connectivity profiles to develop classification targets, split-hemisphere target-based SN segmentation with probabilistic tractography was performed. The relative subsegment volumes and strength of connectivity between the SN and the limbic, associative, and motor network targets were compared.ResultsOur results show that there is greater probability of connectivity between the SN and limbic network targets relative to motor and associative network targets in PD patients with recent history of severe impulsivity as compared to PD patients without impulsivity (P = 0.0075). We did not observe relative volumetric subsegment differences across groups.ConclusionFirstly, our results suggest that fine-grained, atlas-derived classification targets may be used in PD to parcellate and classify functionally distinct subsegments of the SN, with the apparent preservation of previously reported topographical limbic-medial SN, associative-ventral SN, and sensorimotor-lateral SN orientation. We suggest that relative, as opposed to absolute, degeneration amongst SN-associated dopaminergic networks relates to the impulsivity phenotype in PD

Template-Cut: A Pattern-Based Segmentation Paradigm

We present a scale-invariant, template-based segmentation paradigm that sets up a graph and performs a graph cut to separate an object from the background. Typically graph-based schemes distribute the nodes of the graph uniformly and equidistantly on the image, and use a regularizer to bias the cut towards a particular shape. The strategy of uniform and equidistant nodes does not allow the cut to prefer more complex structures, especially when areas of the object are indistinguishable from the background. We propose a solution by introducing the concept of a "template shape" of the target object in which the nodes are sampled non-uniformly and non-equidistantly on the image. We evaluate it on 2D-images where the object's textures and backgrounds are similar, and large areas of the object have the same gray level appearance as the background. We also evaluate it in 3D on 60 brain tumor datasets for neurosurgical planning purposes.Comment: 8 pages, 6 figures, 3 tables, 6 equations, 51 reference