3D fusion of histology to multi-parametric MRI for prostate cancer imaging evaluation and lesion-targeted treatment planning

Multi-parametric magnetic resonance imaging (mpMRI) of localized prostate cancer has the potential to support detection, staging and localization of tumors, as well as selection, delivery and monitoring of treatments. Delineating prostate cancer tumors on imaging could potentially further support the clinical workflow by enabling precise monitoring of tumor burden in active-surveillance patients, optimized targeting of image-guided biopsies, and targeted delivery of treatments to decrease morbidity and improve outcomes. Evaluating the performance of mpMRI for prostate cancer imaging and delineation ideally includes comparison to an accurately registered reference standard, such as prostatectomy histology, for the locations of tumor boundaries on mpMRI. There are key gaps in knowledge regarding how to accurately register histological reference standards to imaging, and consequently further gaps in knowledge regarding the suitability of mpMRI for tasks, such as tumor delineation, that require such reference standards for evaluation. To obtain an understanding of the magnitude of the mpMRI-histology registration problem, we quantified the position, orientation and deformation of whole-mount histology sections relative to the formalin-fixed tissue slices from which they were cut. We found that (1) modeling isotropic scaling accounted for the majority of the deformation with a further small but statistically significant improvement from modeling affine transformation, and (2) due to the depth (mean±standard deviation (SD) 1.1±0.4 mm) and orientation (mean±SD 1.5±0.9°) of the sectioning, the assumption that histology sections are cut from the front faces of tissue slices, common in previous approaches, introduced a mean error of 0.7 mm. To determine the potential consequences of seemingly small registration errors such as described above, we investigated the impact of registration accuracy on the statistical power of imaging validation studies using a co-registered spatial reference standard (e.g. histology images) by deriving novel statistical power formulae that incorporate registration error. We illustrated, through a case study modeled on a prostate cancer imaging trial at our centre, that submillimeter differences in registration error can have a substantial impact on the required sample sizes (and therefore also the study cost) for studies aiming to detect mpMRI signal differences due to 0.5 – 2.0 cm3 prostate tumors. With the aim of achieving highly accurate mpMRI-histology registrations without disrupting the clinical pathology workflow, we developed a three-stage method for accurately registering 2D whole-mount histology images to pre-prostatectomy mpMRI that allowed flexible placement of cuts during slicing for pathology and avoided the assumption that histology sections are cut from the front faces of tissue slices. The method comprised a 3D reconstruction of histology images, followed by 3D–3D ex vivo–in vivo and in vivo–in vivo image transformations. The 3D reconstruction method minimized fiducial registration error between cross-sections of non-disruptive histology- and ex-vivo-MRI-visible strand-shaped fiducials to reconstruct histology images into the coordinate system of an ex vivo MR image. We quantified the mean±standard deviation target registration error of the reconstruction to be 0.7±0.4 mm, based on the post-reconstruction misalignment of intrinsic landmark pairs. We also compared our fiducial-based reconstruction to an alternative reconstruction based on mutual-information-based registration, an established method for multi-modality registration. We found that the mean target registration error for the fiducial-based method (0.7 mm) was lower than that for the mutual-information-based method (1.2 mm), and that the mutual-information-based method was less robust to initialization error due to multiple sources of error, including the optimizer and the mutual information similarity metric. The second stage of the histology–mpMRI registration used interactively defined 3D–3D deformable thin-plate-spline transformations to align ex vivo to in vivo MR images to compensate for deformation due to endorectal MR coil positioning, surgical resection and formalin fixation. The third stage used interactively defined 3D–3D rigid or thin-plate-spline transformations to co-register in vivo mpMRI images to compensate for patient motion and image distortion. The combined mean registration error of the histology–mpMRI registration was quantified to be 2 mm using manually identified intrinsic landmark pairs. Our data set, comprising mpMRI, target volumes contoured by four observers and co-registered contoured and graded histology images, was used to quantify the positive predictive values and variability of observer scoring of lesions following the Prostate Imaging Reporting and Data System (PI-RADS) guidelines, the variability of target volume contouring, and appropriate expansion margins from target volumes to achieve coverage of histologically defined cancer. The analysis of lesion scoring showed that a PI-RADS overall cancer likelihood of 5, denoting “highly likely cancer”, had a positive predictive value of 85% for Gleason 7 cancer (and 93% for lesions with volumes \u3e0.5 cm3 measured on mpMRI) and that PI-RADS scores were positively correlated with histological grade (ρ=0.6). However, the analysis also showed interobserver differences in PI-RADS score of 0.6 to 1.2 (on a 5-point scale) and an agreement kappa value of only 0.30. The analysis of target volume contouring showed that target volume contours with suitable margins can achieve near-complete histological coverage for detected lesions, despite the presence of high interobserver spatial variability in target volumes. Prostate cancer imaging and delineation have the potential to support multiple stages in the management of localized prostate cancer. Targeted biopsy procedures with optimized targeting based on tumor delineation may help distinguish patients who need treatment from those who need active surveillance. Ongoing monitoring of tumor burden based on delineation in patients undergoing active surveillance may help identify those who need to progress to therapy early while the cancer is still curable. Preferentially targeting therapies at delineated target volumes may lower the morbidity associated with aggressive cancer treatment and improve outcomes in low-intermediate-risk patients. Measurements of the accuracy and variability of lesion scoring and target volume contouring on mpMRI will clarify its value in supporting these roles

Intensity Based Non-rigid Registration of 3D Whole Mouse Optical and MR Image Volumes

Novel magnetic resonance (MR) imaging techniques can be validated using accurate co-registration with histology. Whole-animal histological sections allow for simultaneous analysis of multiple tissues, and may also aid in registration by providing contextual information and structural support to tissues which if isolated from the body would be difficult to register. This thesis explores the feasibility of co-registration between whole mouse histology with 3D MR images using an intermediate optical image volume acquired during tissue sectioning. Of the two transformations required for this approach, 3D co-registration of MR and optical images is more challenging to perform due to changes in contrast, slice orientation, and resolution between these modalities. Here, an automated non-rigid registration technique utilizing mutual information is proposed to accurately register 3D whole mouse optical and MR images as a first step towards automated registration of histology. Validation of this technique was accomplished through calculation of post-registration target registration error

Quantitative MRI correlates of hippocampal and neocortical pathology in intractable temporal lobe epilepsy

Intractable or drug-resistant epilepsy occurs in over 30% of epilepsy patients, with many of these patients undergoing surgical excision of the affected brain region to achieve seizure control. Advances in MRI have the potential to improve surgical treatment of epilepsy through improved identification and delineation of lesions. However, validation is currently needed to investigate histopathological correlates of these new imaging techniques. The purpose of this work is to investigate histopathological correlates of quantitative relaxometry and DTI from hippocampal and neocortical specimens of intractable TLE patients. To achieve this goal I developed and evaluated a pipeline for histology to in-vivo MRI image registration, which finds dense spatial correspondence between both modalities. This protocol was divided in two steps whereby sparsely sectioned histology from temporal lobe specimens was first registered to the intermediate ex-vivo MRI which is then registered to the in-vivo MRI, completing a pipeline for histology to in-vivo MRI registration. When correlating relaxometry and DTI with neuronal density and morphology in the temporal lobe neocortex, I found T1 to be a predictor of neuronal density in the neocortical GM and demonstrated that employing multi-parametric MRI (combining T1 and FA together) provided a significantly better fit than each parameter alone in predicting density of neurons. This work was the first to relate in-vivo T1 and FA values to the proportion of neurons in GM. When investigating these quantitative multimodal parameters with histological features within the hippocampal subfields, I demonstrated that MD correlates with neuronal density and size, and can act as a marker for neuron integrity within the hippocampus. More importantly, this work was the first to highlight the potential of subfield relaxometry and diffusion parameters (mainly T2 and MD) as well as volumetry in predicting the extent of cell loss per subfield pre-operatively, with a precision so far unachievable. These results suggest that high-resolution quantitative MRI sequences could impact clinical practice for pre-operative evaluation and prediction of surgical outcomes of intractable epilepsy

Histopathological image analysis : a review

Over the past decade, dramatic increases in computational power and improvement in image analysis algorithms have allowed the development of powerful computer-assisted analytical approaches to radiological data. With the recent advent of whole slide digital scanners, tissue histopathology slides can now be digitized and stored in digital image form. Consequently, digitized tissue histopathology has now become amenable to the application of computerized image analysis and machine learning techniques. Analogous to the role of computer-assisted diagnosis (CAD) algorithms in medical imaging to complement the opinion of a radiologist, CAD algorithms have begun to be developed for disease detection, diagnosis, and prognosis prediction to complement the opinion of the pathologist. In this paper, we review the recent state of the art CAD technology for digitized histopathology. This paper also briefly describes the development and application of novel image analysis technology for a few specific histopathology related problems being pursued in the United States and Europe

Image registration of ex-vivo MRI to sparsely sectioned histology of hippocampal and neocortical temporal lobe specimens.

Intractable or drug-resistant epilepsy occurs in up to 30% of epilepsy patients, with many of these patients undergoing surgical excision of the affected brain region to achieve seizure control. Recent magnetic resonance imaging (MRI) sequences and analysis techniques have the potential to detect abnormalities not identified with diagnostic MRI protocols. Prospective studies involving pre-operative imaging and collection of surgically-resected tissue provide a unique opportunity for verification and tuning of these image analysis techniques, since direct comparison can be made against histopathology, and can lead to better prediction of surgical outcomes and potentially less invasive procedures. To carry out MRI and histology comparison, spatial correspondence between the MR images and the histology images must be found. Towards this goal, a novel pipeline is presented here for bringing ex-vivo MRI of surgically-resected temporal lobe specimens and digital histology into spatial correspondence. The sparsely-sectioned histology images represent a challenge for 3D reconstruction which we address with a combined 3D and 2D registration algorithm that alternates between slice-based and volume-based registration with the ex-vivo MRI. We evaluated our registration method on specimens resected from patients undergoing anterior temporal lobectomy (N=7) and found our method to have a mean target registration error of 0.76±0.66 and 0.98±0.60 mm for hippocampal and neocortical specimens respectively. This work allows for the spatially-local comparison of histology with post-operative MRI and paves the way for eventual correlation with pre-operative MRI image analysis techniques

Quantification of tumour heterogenity in MRI

Cancer is the leading cause of death that touches us all, either directly or indirectly. It is estimated that the number of newly diagnosed cases in the Netherlands will increase to 123,000 by the year 2020. General Dutch statistics are similar to those in the UK, i.e. over the last ten years, the age-standardised incidence rate1 has stabilised at around 355 females and 415 males per 100,000. Figure 1 shows the cancer incidence per gender. In the UK, the rise in lifetime risk of cancer is more than one in three and depends on many factors, including age, lifestyle and genetic makeup

A Method for 3D Histopathology Reconstruction Supporting Mouse Microvasculature Analysis.

Structural abnormalities of the microvasculature can impair perfusion and function. Conventional histology provides good spatial resolution with which to evaluate the microvascular structure but affords no 3-dimensional information; this limitation could lead to misinterpretations of the complex microvessel network in health and disease. The objective of this study was to develop and evaluate an accurate, fully automated 3D histology reconstruction method to visualize the arterioles and venules within the mouse hind-limb. Sections of the tibialis anterior muscle from C57BL/J6 mice (both normal and subjected to femoral artery excision) were reconstructed using pairwise rigid and affine registrations of 5 µm-thick, paraffin-embedded serial sections digitized at 0.25 µm/pixel. Low-resolution intensity-based rigid registration was used to initialize the nucleus landmark-based registration, and conventional high-resolution intensity-based registration method. The affine nucleus landmark-based registration was developed in this work and was compared to the conventional affine high-resolution intensity-based registration method. Target registration errors were measured between adjacent tissue sections (pairwise error), as well as with respect to a 3D reference reconstruction (accumulated error, to capture propagation of error through the stack of sections). Accumulated error measures were lower (