Groupwise Multimodal Image Registration using Joint Total Variation

In medical imaging it is common practice to acquire a wide range of modalities (MRI, CT, PET, etc.), to highlight different structures or pathologies. As patient movement between scans or scanning session is unavoidable, registration is often an essential step before any subsequent image analysis. In this paper, we introduce a cost function based on joint total variation for such multimodal image registration. This cost function has the advantage of enabling principled, groupwise alignment of multiple images, whilst being insensitive to strong intensity non-uniformities. We evaluate our algorithm on rigidly aligning both simulated and real 3D brain scans. This validation shows robustness to strong intensity non-uniformities and low registration errors for CT/PET to MRI alignment. Our implementation is publicly available at https://github.com/brudfors/coregistration-njtv

A Survey on Deep Learning in Medical Image Analysis

Deep learning algorithms, in particular convolutional networks, have rapidly become a methodology of choice for analyzing medical images. This paper reviews the major deep learning concepts pertinent to medical image analysis and summarizes over 300 contributions to the field, most of which appeared in the last year. We survey the use of deep learning for image classification, object detection, segmentation, registration, and other tasks and provide concise overviews of studies per application area. Open challenges and directions for future research are discussed.Comment: Revised survey includes expanded discussion section and reworked introductory section on common deep architectures. Added missed papers from before Feb 1st 201

The Integration of Positron Emission Tomography With Magnetic Resonance Imaging

A number of laboratories and companies are currently exploring the development of integrated imaging systems for magnetic resonance imaging (MRI) and positron emission tomography (PET). Scanners for both preclinical and human research applications are being pursued. In contrast to the widely distributed and now quite mature PET/computed tomography technology, most PET/MRI designs allow for simultaneous rather than sequential acquisition of PET and MRI data. While this offers the possibility of novel imaging strategies, it also creates considerable challenges for acquiring artifact-free images from both modalities. This paper discusses the motivation for developing combined PET/MRI technology, outlines the obstacles in realizing such an integrated instrument, and presents recent progress in the development of both the instrumentation and of novel imaging agents for combined PET/MRI studies. The performance of the first-generation PET/MRI systems is described. Finally, a range of possible biomedical applications for PET/MRI are outlined

A robust coregistration method for in vivo studies using a first generation simultaneous PET/MR scanner

Purpose: Hybrid positron emission tomography (PET)/magnetic resonance (MR) imaging systems have recently been built that allow functional and anatomical information obtained from PET and MR to be acquired simultaneously. The authors have developed a robust coregistration scheme for a first generation small animal PET/MR imaging system and illustrated the potential of this system to study intratumoral heterogeneity in a mouse model. Methods: An alignment strategy to fuse simultaneously acquired PET and MR data, using the MR imaging gradient coordinate system as the reference basis, was developed. The fidelity of the alignment was evaluated over multiple study sessions. In order to explore its robustness in vivo, the alignment strategy was applied to explore the heterogeneity of glucose metabolism in a xenograft tumor model, using ^(18)F-FDG-PET to guide the acquisition of localized ^1H MR spectra within a single imaging session. Results: The alignment method consistently fused the PET/MR data sets with subvoxel accuracy (registration error mean=0.55 voxels, <0.28 mm); this was independent of location within the field of view. When the system was used to study intratumoral heterogeneity within xenograft tumors, a correlation of high ^(18)F-FDG-PET signal with high choline/creatine ratio was observed. Conclusions: The authors present an implementation of an efficient and robust coregistration scheme for multimodal noninvasive imaging using PET and MR. This setup allows time-sensitive, multimodal studies of physiology to be conducted in an efficient manner

Combining Shape and Learning for Medical Image Analysis

Automatic methods with the ability to make accurate, fast and robust assessments of medical images are highly requested in medical research and clinical care. Excellent automatic algorithms are characterized by speed, allowing for scalability, and an accuracy comparable to an expert radiologist. They should produce morphologically and physiologically plausible results while generalizing well to unseen and rare anatomies. Still, there are few, if any, applications where today\u27s automatic methods succeed to meet these requirements.\ua0The focus of this thesis is two tasks essential for enabling automatic medical image assessment, medical image segmentation and medical image registration. Medical image registration, i.e. aligning two separate medical images, is used as an important sub-routine in many image analysis tools as well as in image fusion, disease progress tracking and population statistics. Medical image segmentation, i.e. delineating anatomically or physiologically meaningful boundaries, is used for both diagnostic and visualization purposes in a wide range of applications, e.g. in computer-aided diagnosis and surgery.The thesis comprises five papers addressing medical image registration and/or segmentation for a diverse set of applications and modalities, i.e. pericardium segmentation in cardiac CTA, brain region parcellation in MRI, multi-organ segmentation in CT, heart ventricle segmentation in cardiac ultrasound and tau PET registration. The five papers propose competitive registration and segmentation methods enabled by machine learning techniques, e.g. random decision forests and convolutional neural networks, as well as by shape modelling, e.g. multi-atlas segmentation and conditional random fields