Imaging Informatics and the Human Brain Project: the Role of Structure, Review

(no abstract

Registration of brain tumor images using hyper-elastic regularization

In this paper, we present a method to estimate a deformation field between two instances of a brain volume having tumor. The novelties include the assessment of the disease progress by observing the healthy tissue deformation and usage of the Neo-Hookean strain energy density model as a regularizer in deformable registration framework. Implementations on synthetic and patient data provide promising results, which might have relevant use in clinical problems

Data registration and fusion for cardiac applications

The registration and fusion of information from multiple cardiac image modalities such as magnetic resonance imaging (MRI), X-ray computed tomography (CT), positron emission tomography (PET) and single photon emission computed tomography (SPECT) has been of increasing interest to the medical community as tools for furthering physiological understanding and for diagnostic of ischemic heart diseases. Ischemic heart diseases and their consequence, myocardial infarct, are the leading cause of mortality in industrial countries. In cardiac image registration and data fusion, the combination of structural information from MR images and functional information from PET and SPECT is of special interest in the estimation of myocardial function and viability. Cardiac image registration is a more complex problem than brain image registration. The non-rigid motion of the heart and the thorax structures introduce additional difficulties in registration. In this thesis the goal was develop methods for cardiac data registration and fusion. A rigid registration method was developed to register cardiac MR and PET images. The method was based on the registration of the segmented thorax structures from MR and PET transmission images. The thorax structures were segmented from images using deformable models. A MR short axis registration with PET emission image was also derived. The rigid registration method was evaluated using simulated images and clinical MR and PET images from ten patients with multivessel coronary artery diseases. Also an elastic registration method was developed to register intra-patient cardiac MR and PET images and inter-patient head MR images. In the elastic registration method, a combination of mutual information, gradient information and smoothness of transformation was used to guide the deformation of one image towards another image. An approach for the creation of 3-D functional maps of the heart was also developed. An individualized anatomical heart model was extracted from the MR images. A rigid registration of anatomical MR images and PET metabolic images was carried out using surface based registration, and the registration of MR images with magnetocardiography (MCG) data using external markers. The method resulted in a 3-D anatomical and functional model of the heart that included structural information from the MRI and functional information from the PET and MCG. Different error sources in the registration method of the MR images and MCG data was also evaluated in this thesis. The results of the rigid MR-PET registration method were also used in the comparison of multimodality MR imaging methods to PET.reviewe

Construction of boundary element models in bioelectromagnetism

Multisensor electro- and magnetoencephalographic (EEG and MEG) as well as electro- and magnetocardiographic (ECG and MCG) recordings have been proved useful in noninvasively extracting information on bioelectric excitation. The anatomy of the patient needs to be taken into account, when excitation sites are localized by solving the inverse problem. In this work, a methodology has been developed to construct patient specific boundary element models for bioelectromagnetic inverse problems from magnetic resonance (MR) data volumes as well as from two orthogonal X-ray projections. The process consists of three main steps: reconstruction of 3-D geometry, triangulation of reconstructed geometry, and registration of the model with a bioelectromagnetic measurement system. The 3-D geometry is reconstructed from MR data by matching a 3-D deformable boundary element template to images. The deformation is accomplished as an energy minimization process consisting of image and model based terms. The robustness of the matching is improved by multi-resolution and global-to-local approaches as well as using oriented distance maps. A boundary element template is also used when 3-D geometry is reconstructed from X-ray projections. The deformation is first accomplished in 2-D for the contours of simulated, built from the template, and real X-ray projections. The produced 2-D vector field is back-projected and interpolated on the 3-D template surface. A marching cube triangulation is computed for the reconstructed 3-D geometry. Thereafter, a non-iterative mesh-simplification method is applied. The method is based on the Voronoi-Delaunay duality on a 3-D surface with discrete distance measures. Finally, the triangulated surfaces are registered with a bioelectromagnetic measurement utilizing markers. More than fifty boundary element models have been successfully constructed from MR images using the methods developed in this work. A simulation demonstrated the feasibility of X-ray reconstruction; some practical problems of X-ray imaging need to be solved to begin tests with real data.reviewe

Piecewise Affine Registration of Biological Images for Volume Reconstruction

This manuscript tackles the reconstruction of 3D volumes via mono-modal registration of series of 2D biological images (histological sections, autoradiographs, cryosections, etc.). The process of acquiring these images typically induces composite transformations that we model as a number of rigid or affine local transformations embedded in an elastic one. We propose a registration approach closely derived from this model. Given a pair of input images, we first compute a dense similarity field between them with a block matching algorithm. We use as a similarity measure an extension of the classical correlation coefficient that improves the consistency of the field. A hierarchical clustering algorithm then automatically partitions the field into a number of classes from which we extract independent pairs of sub-images. Our clustering algorithm relies on the Earth mover’s distribution metric and is additionally guided by robust least-square estimation of the transformations associated with each cluster. Finally, the pairs of sub-images are, independently, affinely registered and a hybrid affine/non-linear interpolation scheme is used to compose the output registered image. We investigate the behavior of our approach on several batches of histological data and discuss its sensitivity to parameters and noise