To Learn or Not to Learn Features for Deformable Registration?

Feature-based registration has been popular with a variety of features ranging from voxel intensity to Self-Similarity Context (SSC). In this paper, we examine the question on how features learnt using various Deep Learning (DL) frameworks can be used for deformable registration and whether this feature learning is necessary or not. We investigate the use of features learned by different DL methods in the current state-of-the-art discrete registration framework and analyze its performance on 2 publicly available datasets. We draw insights into the type of DL framework useful for feature learning and the impact, if any, of the complexity of different DL models and brain parcellation methods on the performance of discrete registration. Our results indicate that the registration performance with DL features and SSC are comparable and stable across datasets whereas this does not hold for low level features.Comment: 9 pages, 4 figure

The Human Connectome Project's neuroimaging approach

Noninvasive human neuroimaging has yielded many discoveries about the brain. Numerous methodological advances have also occurred, though inertia has slowed their adoption. This paper presents an integrated approach to data acquisition, analysis and sharing that builds upon recent advances, particularly from the Human Connectome Project (HCP). The 'HCP-style' paradigm has seven core tenets: (i) collect multimodal imaging data from many subjects; (ii) acquire data at high spatial and temporal resolution; (iii) preprocess data to minimize distortions, blurring and temporal artifacts; (iv) represent data using the natural geometry of cortical and subcortical structures; (v) accurately align corresponding brain areas across subjects and studies; (vi) analyze data using neurobiologically accurate brain parcellations; and (vii) share published data via user-friendly databases. We illustrate the HCP-style paradigm using existing HCP data sets and provide guidance for future research. Widespread adoption of this paradigm should accelerate progress in understanding the brain in health and disease

Neurosurgical Ultrasound Pose Estimation Using Image-Based Registration and Sensor Fusion - A Feasibility Study

Modern neurosurgical procedures often rely on computer-assisted real-time guidance using multiple medical imaging modalities. State-of-the-art commercial products enable the fusion of pre-operative with intra-operative images (e.g., magnetic resonance [MR] with ultrasound [US] images), as well as the on-screen visualization of procedures in progress. In so doing, US images can be employed as a template to which pre-operative images can be registered, to correct for anatomical changes, to provide live-image feedback, and consequently to improve confidence when making resection margin decisions near eloquent regions during tumour surgery. In spite of the potential for tracked ultrasound to improve many neurosurgical procedures, it is not widely used. State-of-the-art systems are handicapped by optical tracking’s need for consistent line-of-sight, keeping tracked rigid bodies clean and rigidly fixed, and requiring a calibration workflow. The goal of this work is to improve the value offered by co-registered ultrasound images without the workflow drawbacks of conventional systems. The novel work in this thesis includes: the exploration and development of a GPU-enabled 2D-3D multi-modal registration algorithm based on the existing LC2 metric; and the use of this registration algorithm in the context of a sensor and image-fusion algorithm. The work presented here is a motivating step in a vision towards a heterogeneous tracking framework for image-guided interventions where the knowledge from intraoperative imaging, pre-operative imaging, and (potentially disjoint) wireless sensors in the surgical field are seamlessly integrated for the benefit of the surgeon. The technology described in this thesis, inspired by advances in robot localization demonstrate how inaccurate pose data from disjoint sources can produce a localization system greater than the sum of its parts

Cross-calibration of Time-of-flight and Colour Cameras

Time-of-flight cameras provide depth information, which is complementary to the photometric appearance of the scene in ordinary images. It is desirable to merge the depth and colour information, in order to obtain a coherent scene representation. However, the individual cameras will have different viewpoints, resolutions and fields of view, which means that they must be mutually calibrated. This paper presents a geometric framework for this multi-view and multi-modal calibration problem. It is shown that three-dimensional projective transformations can be used to align depth and parallax-based representations of the scene, with or without Euclidean reconstruction. A new evaluation procedure is also developed; this allows the reprojection error to be decomposed into calibration and sensor-dependent components. The complete approach is demonstrated on a network of three time-of-flight and six colour cameras. The applications of such a system, to a range of automatic scene-interpretation problems, are discussed.Comment: 18 pages, 12 figures, 3 table

Towards HCP-Style macaque connectomes: 24-Channel 3T multi-array coil, MRI sequences and preprocessing

© 2020 The Author(s) Macaque monkeys are an important animal model where invasive investigations can lead to a better understanding of the cortical organization of primates including humans. However, the tools and methods for noninvasive image acquisition (e.g. MRI RF coils and pulse sequence protocols) and image data preprocessing have lagged behind those developed for humans. To resolve the structural and functional characteristics of the smaller macaque brain, high spatial, temporal, and angular resolutions combined with high signal-to-noise ratio are required to ensure good image quality. To address these challenges, we developed a macaque 24-channel receive coil for 3-T MRI with parallel imaging capabilities. This coil enables adaptation of the Human Connectome Project (HCP) image acquisition protocols to the in-vivo macaque brain. In addition, we adapted HCP preprocessing methods to the macaque brain, including spatial minimal preprocessing of structural, functional MRI (fMRI), and diffusion MRI (dMRI). The coil provides the necessary high signal-to-noise ratio and high efficiency in data acquisition, allowing four- and five-fold accelerations for dMRI and fMRI. Automated FreeSurfer segmentation of cortex, reconstruction of cortical surface, removal of artefacts and nuisance signals in fMRI, and distortion correction of dMRI all performed well, and the overall quality of basic neurobiological measures was comparable with those for the HCP. Analyses of functional connectivity in fMRI revealed high sensitivity as compared with those from publicly shared datasets. Tractography-based connectivity estimates correlated with tracer connectivity similarly to that achieved using ex-vivo dMRI. The resulting HCP-style in vivo macaque MRI data show considerable promise for analyzing cortical architecture and functional and structural connectivity using advanced methods that have previously only been available in studies of the human brain

Towards HCP-style macaque connectomes: 24-channel 3T multi-array coil, MRI sequences and preprocessing

Macaque monkeys are an important animal model where invasive investigations can lead to a better understanding of the cortical organization of primates including humans. However, the tools and methods for noninvasive image acquisition (e.g. MRI RF coils and pulse sequence protocols) and image data preprocessing have lagged behind those developed for humans. To resolve the structural and functional characteristics of the smaller macaque brain, high spatial, temporal, and angular resolutions combined with high signal-to-noise ratio are required to ensure good image quality. To address these challenges, we developed a macaque 24-channel receive coil for 3-T MRI with parallel imaging capabilities. This coil enables adaptation of the Human Connectome Project (HCP) image acquisition protocols to the in-vivo macaque brain. In addition, we adapted HCP preprocessing methods to the macaque brain, including spatial minimal preprocessing of structural, functional MRI (fMRI), and diffusion MRI (dMRI). The coil provides the necessary high signal-to-noise ratio and high efficiency in data acquisition, allowing four- and five-fold accelerations for dMRI and fMRI. Automated FreeSurfer segmentation of cortex, reconstruction of cortical surface, removal of artefacts and nuisance signals in fMRI, and distortion correction of dMRI all performed well, and the overall quality of basic neurobiological measures was comparable with those for the HCP. Analyses of functional connectivity in fMRI revealed high sensitivity as compared with those from publicly shared datasets. Tractography-based connectivity estimates correlated with tracer connectivity similarly to that achieved using ex-vivo dMRI. The resulting HCP-style in vivo macaque MRI data show considerable promise for analyzing cortical architecture and functional and structural connectivity using advanced methods that have previously only been available in studies of the human brain

Inferring Geodesic Cerebrovascular Graphs: Image Processing, Topological Alignment and Biomarkers Extraction

A vectorial representation of the vascular network that embodies quantitative features - location, direction, scale, and bifurcations - has many potential neuro-vascular applications. Patient-specific models support computer-assisted surgical procedures in neurovascular interventions, while analyses on multiple subjects are essential for group-level studies on which clinical prediction and therapeutic inference ultimately depend. This first motivated the development of a variety of methods to segment the cerebrovascular system. Nonetheless, a number of limitations, ranging from data-driven inhomogeneities, the anatomical intra- and inter-subject variability, the lack of exhaustive ground-truth, the need for operator-dependent processing pipelines, and the highly non-linear vascular domain, still make the automatic inference of the cerebrovascular topology an open problem. In this thesis, brain vessels’ topology is inferred by focusing on their connectedness. With a novel framework, the brain vasculature is recovered from 3D angiographies by solving a connectivity-optimised anisotropic level-set over a voxel-wise tensor field representing the orientation of the underlying vasculature. Assuming vessels joining by minimal paths, a connectivity paradigm is formulated to automatically determine the vascular topology as an over-connected geodesic graph. Ultimately, deep-brain vascular structures are extracted with geodesic minimum spanning trees. The inferred topologies are then aligned with similar ones for labelling and propagating information over a non-linear vectorial domain, where the branching pattern of a set of vessels transcends a subject-specific quantized grid. Using a multi-source embedding of a vascular graph, the pairwise registration of topologies is performed with the state-of-the-art graph matching techniques employed in computer vision. Functional biomarkers are determined over the neurovascular graphs with two complementary approaches. Efficient approximations of blood flow and pressure drop account for autoregulation and compensation mechanisms in the whole network in presence of perturbations, using lumped-parameters analog-equivalents from clinical angiographies. Also, a localised NURBS-based parametrisation of bifurcations is introduced to model fluid-solid interactions by means of hemodynamic simulations using an isogeometric analysis framework, where both geometry and solution profile at the interface share the same homogeneous domain. Experimental results on synthetic and clinical angiographies validated the proposed formulations. Perspectives and future works are discussed for the group-wise alignment of cerebrovascular topologies over a population, towards defining cerebrovascular atlases, and for further topological optimisation strategies and risk prediction models for therapeutic inference. Most of the algorithms presented in this work are available as part of the open-source package VTrails