3D fusion of histology to multi-parametric MRI for prostate cancer imaging evaluation and lesion-targeted treatment planning

Multi-parametric magnetic resonance imaging (mpMRI) of localized prostate cancer has the potential to support detection, staging and localization of tumors, as well as selection, delivery and monitoring of treatments. Delineating prostate cancer tumors on imaging could potentially further support the clinical workflow by enabling precise monitoring of tumor burden in active-surveillance patients, optimized targeting of image-guided biopsies, and targeted delivery of treatments to decrease morbidity and improve outcomes. Evaluating the performance of mpMRI for prostate cancer imaging and delineation ideally includes comparison to an accurately registered reference standard, such as prostatectomy histology, for the locations of tumor boundaries on mpMRI. There are key gaps in knowledge regarding how to accurately register histological reference standards to imaging, and consequently further gaps in knowledge regarding the suitability of mpMRI for tasks, such as tumor delineation, that require such reference standards for evaluation. To obtain an understanding of the magnitude of the mpMRI-histology registration problem, we quantified the position, orientation and deformation of whole-mount histology sections relative to the formalin-fixed tissue slices from which they were cut. We found that (1) modeling isotropic scaling accounted for the majority of the deformation with a further small but statistically significant improvement from modeling affine transformation, and (2) due to the depth (mean±standard deviation (SD) 1.1±0.4 mm) and orientation (mean±SD 1.5±0.9°) of the sectioning, the assumption that histology sections are cut from the front faces of tissue slices, common in previous approaches, introduced a mean error of 0.7 mm. To determine the potential consequences of seemingly small registration errors such as described above, we investigated the impact of registration accuracy on the statistical power of imaging validation studies using a co-registered spatial reference standard (e.g. histology images) by deriving novel statistical power formulae that incorporate registration error. We illustrated, through a case study modeled on a prostate cancer imaging trial at our centre, that submillimeter differences in registration error can have a substantial impact on the required sample sizes (and therefore also the study cost) for studies aiming to detect mpMRI signal differences due to 0.5 – 2.0 cm3 prostate tumors. With the aim of achieving highly accurate mpMRI-histology registrations without disrupting the clinical pathology workflow, we developed a three-stage method for accurately registering 2D whole-mount histology images to pre-prostatectomy mpMRI that allowed flexible placement of cuts during slicing for pathology and avoided the assumption that histology sections are cut from the front faces of tissue slices. The method comprised a 3D reconstruction of histology images, followed by 3D–3D ex vivo–in vivo and in vivo–in vivo image transformations. The 3D reconstruction method minimized fiducial registration error between cross-sections of non-disruptive histology- and ex-vivo-MRI-visible strand-shaped fiducials to reconstruct histology images into the coordinate system of an ex vivo MR image. We quantified the mean±standard deviation target registration error of the reconstruction to be 0.7±0.4 mm, based on the post-reconstruction misalignment of intrinsic landmark pairs. We also compared our fiducial-based reconstruction to an alternative reconstruction based on mutual-information-based registration, an established method for multi-modality registration. We found that the mean target registration error for the fiducial-based method (0.7 mm) was lower than that for the mutual-information-based method (1.2 mm), and that the mutual-information-based method was less robust to initialization error due to multiple sources of error, including the optimizer and the mutual information similarity metric. The second stage of the histology–mpMRI registration used interactively defined 3D–3D deformable thin-plate-spline transformations to align ex vivo to in vivo MR images to compensate for deformation due to endorectal MR coil positioning, surgical resection and formalin fixation. The third stage used interactively defined 3D–3D rigid or thin-plate-spline transformations to co-register in vivo mpMRI images to compensate for patient motion and image distortion. The combined mean registration error of the histology–mpMRI registration was quantified to be 2 mm using manually identified intrinsic landmark pairs. Our data set, comprising mpMRI, target volumes contoured by four observers and co-registered contoured and graded histology images, was used to quantify the positive predictive values and variability of observer scoring of lesions following the Prostate Imaging Reporting and Data System (PI-RADS) guidelines, the variability of target volume contouring, and appropriate expansion margins from target volumes to achieve coverage of histologically defined cancer. The analysis of lesion scoring showed that a PI-RADS overall cancer likelihood of 5, denoting “highly likely cancer”, had a positive predictive value of 85% for Gleason 7 cancer (and 93% for lesions with volumes \u3e0.5 cm3 measured on mpMRI) and that PI-RADS scores were positively correlated with histological grade (ρ=0.6). However, the analysis also showed interobserver differences in PI-RADS score of 0.6 to 1.2 (on a 5-point scale) and an agreement kappa value of only 0.30. The analysis of target volume contouring showed that target volume contours with suitable margins can achieve near-complete histological coverage for detected lesions, despite the presence of high interobserver spatial variability in target volumes. Prostate cancer imaging and delineation have the potential to support multiple stages in the management of localized prostate cancer. Targeted biopsy procedures with optimized targeting based on tumor delineation may help distinguish patients who need treatment from those who need active surveillance. Ongoing monitoring of tumor burden based on delineation in patients undergoing active surveillance may help identify those who need to progress to therapy early while the cancer is still curable. Preferentially targeting therapies at delineated target volumes may lower the morbidity associated with aggressive cancer treatment and improve outcomes in low-intermediate-risk patients. Measurements of the accuracy and variability of lesion scoring and target volume contouring on mpMRI will clarify its value in supporting these roles

Image registration of ex-vivo MRI to sparsely sectioned histology of hippocampal and neocortical temporal lobe specimens.

Intractable or drug-resistant epilepsy occurs in up to 30% of epilepsy patients, with many of these patients undergoing surgical excision of the affected brain region to achieve seizure control. Recent magnetic resonance imaging (MRI) sequences and analysis techniques have the potential to detect abnormalities not identified with diagnostic MRI protocols. Prospective studies involving pre-operative imaging and collection of surgically-resected tissue provide a unique opportunity for verification and tuning of these image analysis techniques, since direct comparison can be made against histopathology, and can lead to better prediction of surgical outcomes and potentially less invasive procedures. To carry out MRI and histology comparison, spatial correspondence between the MR images and the histology images must be found. Towards this goal, a novel pipeline is presented here for bringing ex-vivo MRI of surgically-resected temporal lobe specimens and digital histology into spatial correspondence. The sparsely-sectioned histology images represent a challenge for 3D reconstruction which we address with a combined 3D and 2D registration algorithm that alternates between slice-based and volume-based registration with the ex-vivo MRI. We evaluated our registration method on specimens resected from patients undergoing anterior temporal lobectomy (N=7) and found our method to have a mean target registration error of 0.76±0.66 and 0.98±0.60 mm for hippocampal and neocortical specimens respectively. This work allows for the spatially-local comparison of histology with post-operative MRI and paves the way for eventual correlation with pre-operative MRI image analysis techniques

Quantitative MRI correlates of hippocampal and neocortical pathology in intractable temporal lobe epilepsy

Intractable or drug-resistant epilepsy occurs in over 30% of epilepsy patients, with many of these patients undergoing surgical excision of the affected brain region to achieve seizure control. Advances in MRI have the potential to improve surgical treatment of epilepsy through improved identification and delineation of lesions. However, validation is currently needed to investigate histopathological correlates of these new imaging techniques. The purpose of this work is to investigate histopathological correlates of quantitative relaxometry and DTI from hippocampal and neocortical specimens of intractable TLE patients. To achieve this goal I developed and evaluated a pipeline for histology to in-vivo MRI image registration, which finds dense spatial correspondence between both modalities. This protocol was divided in two steps whereby sparsely sectioned histology from temporal lobe specimens was first registered to the intermediate ex-vivo MRI which is then registered to the in-vivo MRI, completing a pipeline for histology to in-vivo MRI registration. When correlating relaxometry and DTI with neuronal density and morphology in the temporal lobe neocortex, I found T1 to be a predictor of neuronal density in the neocortical GM and demonstrated that employing multi-parametric MRI (combining T1 and FA together) provided a significantly better fit than each parameter alone in predicting density of neurons. This work was the first to relate in-vivo T1 and FA values to the proportion of neurons in GM. When investigating these quantitative multimodal parameters with histological features within the hippocampal subfields, I demonstrated that MD correlates with neuronal density and size, and can act as a marker for neuron integrity within the hippocampus. More importantly, this work was the first to highlight the potential of subfield relaxometry and diffusion parameters (mainly T2 and MD) as well as volumetry in predicting the extent of cell loss per subfield pre-operatively, with a precision so far unachievable. These results suggest that high-resolution quantitative MRI sequences could impact clinical practice for pre-operative evaluation and prediction of surgical outcomes of intractable epilepsy

Prostate Tumor Volume Measurement on Digital Histopathology and Magnetic Resonance Imaging

An accurate assessment of prostate tumour burden supports appropriate treatment selection, ranging from active surveillance through focal therapy, to radical whole-prostate therapies. For selected patients, knowledge of the three-dimensional locations and sizes of prostate tumours on pre-procedural imaging supports planning of effective focal therapies that preferentially target tumours, while sparing surrounding healthy tissue. In the post-prostatectomy context, pathologic measurement of tumour burden in the surgical specimen may be an independent prognostic factor determining the need for potentially life-saving adjuvant therapy. An accurate and repeatable method for tumour volume assessment based on histology sections taken from the surgical specimen would be supportive both to the clinical workflow in the post-prostatectomy setting and to imaging validation studies correlating tumour burden measurements on pre-prostatectomy imaging with reference standard histologic tumour volume measurements. Digital histopathology imaging is enabling a transition to a more objective quantification of some surgical pathology assessments, such as tumour volume, that are currently visually estimated by pathologists and subject to inter-observer variability. Histologic tumour volume measurement is challenged by the traditional 3–5 mm sparse spacing of images acquired from sections of radical prostatectomy specimens. Tumour volume estimates may benefit from a well-motivated approach to inter-slide tumour boundary interpolation that crosses these large gaps in a smooth fashion. This thesis describes a new level set-based shape interpolation method that reconstructs smooth 3D shapes based on arbitrary 2D tumour contours on digital histology slides. We measured the accuracy of this approach and used it as a reference standard against which to compare previous approaches in the literature that are simpler to implement in a clinical workflow, with the aim of determining a method for histologic tumour volume estimation that is both accurate and amenable to widespread implementation. We also measured the effect of decreasing inter-slide spacing on the repeatability of histologic tumour volume estimation. Furthermore, we used this histologic reference standard for tumour volume to measure the accuracy, inter-observer variability, and inter-sequence variability of prostate tumour volume estimation based on radiologists’ contouring of multi-parametric magnetic resonance imaging (MPMRI). Our key findings were that (1) simple approaches to histologic tumour volume estimation that are based on 2- or 3-dimensional linear tumour measurements are more accurate than those based on 1-dimensional measurements; (2) although tumour shapes produced by smooth through-slide interpolation are qualitatively substantially different from those obtained from a planimetric approach normally used as a reference standard for histologic tumour volume, the volumes obtained were similar; (3) decreasing inter-slide spacing increases repeatability of histologic tumour volume estimates, and this repeatability decreases rapidly for inter-slide spacing values greater than 5 mm; (4) on MPMRI, observers consistently overestimated tumour volume as compared to the histologic reference standard; and (5) inter-sequence variability in MPMRI-based tumour volume estimation exceeded inter-observer variability

Méthode de mise en correspondance tridimensionnelle entre des coupes IRM de la prostate et les coupes histologiques des pièces de prostatectomie

Prostate cancer is the most frequently diagnosed cancer of men in Europe, yet no current imaging technique is capable of detecting with precision tumours in the prostate. The histology slices are the gold standard for the diagnosis. Therefore, in order to evaluate each imaging technique, the histology slices must be precisely registered to the imaged data. As it cannot be assumed that the histology slices are cut along the same plane as the imaged data is acquired, the registration must be considered as a 3D problem. An apparatus has been developed that enables internal fiducial markers to be created in the histology slices in a rapid and standardised manner. An algorithm has been developed that automatically detects and identifies these markers, enabling the alignment of the histology slices. The method has been tested on 10 prostate specimens, with 19.2 slices on average per specimen. The accuracy of the alignment at the fiducial markers was on average 0.18±0.13 mm. A second algorithm was developed to 3D register the aligned histology slices with the MR images. The registration is designed to be guided by the ejaculatory ducts, an anatomical landmark present in every prostate and visible in both histology and MR images acquired at standard clinical resolution. The algorithm was first tested by using the fiducial needles to guide the registration. The average registration accuracy was 0.45 ± 0.25 mm at the fiducial needles and 1.04±0.21 mm at the ejaculatory ducts. The algorithm was then tested by using the ejaculatory ducts to guide the registration. The average registration accuracy was 0.16±0.05 mm at the ejaculatory ducts and 2.82 ± 0.41 mm at the fiducial needles. The results suggest that the histology shrinkage factor is of the order 1.07±0.03 and the tilt of the histology slicing plane is 13.6◦ ±9.61◦, with both parameters showing significant varianceLe cancer de la prostate est le cancer le plus fréquent chez l'homme en Europe, néanmoins il n'existe actuellement pas de technique d'imagerie permettant de détecter avec précision les tumeurs dans la glande. Sachant que les coupes histologiques contiennent la réalité de terrain concernant le diagnostic, il est nécessaire de recaler les images de chaque technique d'imagerie aux coupes histologiques afin de pouvoir les évaluer. De plus, comme il n'existe pas de méthode permettant de contrôler précisément le plan de coupe histologique, le recalage doit être considéré comme un problème 3D. Un dispositif permettant de réaliser, de manière rapide et standardisée, des marqueurs internes dans les coupes histologiques a été développé, de même qu'un algorithme permettant de détecter automatiquement ces marqueurs, de les identifier et d'aligner les coupes histologiques. La méthode a été testée sur 10 prostates, avec en moyenne 19.2 coupes par prostate, et a permis d'obtenir une précision de recalage moyenne de 0.18 ± 0.13 mm au niveau des marqueurs. Un deuxième algorithme a été développé pour recaler les coupes histologiques, une fois alignées, avec les images IRM. Ce recalage a été conçu pour être guidé par les canaux éjaculateurs, un repère anatomique présent dans chaque prostate et visible à la fois en histologie et dans les images IRM cliniques, acquises avec une résolution standard. L'algorithme a d'abord été testé en s'appuyant sur les marqueurs artificiels. La précision obtenue pour le recalage était en moyenne de 0.45±0.25 mm au niveau des marqueurs et de 1.04 ± 0.21 mm au niveau des canaux éjaculateurs. L'algorithme a enfin été testé en guidant le recalage à l'aide de la position des canaux éjaculateurs. La précision moyenne obtenue était alors de 0.16±0.05 mm au niveau des canaux éjaculateurs et de 2.82±0.41 mm au niveau des marqueurs. Ces résultats suggèrent une valeur du facteur de rétrécissement de l'ordre de 1.07±0.03 et une inclinaison vis à vis du plan de coupe histologique de l'ordre de 13.6◦ ± 9.61◦, avec une variance importante pour ces deux paramètre

Intensity Based Non-rigid Registration of 3D Whole Mouse Optical and MR Image Volumes

Novel magnetic resonance (MR) imaging techniques can be validated using accurate co-registration with histology. Whole-animal histological sections allow for simultaneous analysis of multiple tissues, and may also aid in registration by providing contextual information and structural support to tissues which if isolated from the body would be difficult to register. This thesis explores the feasibility of co-registration between whole mouse histology with 3D MR images using an intermediate optical image volume acquired during tissue sectioning. Of the two transformations required for this approach, 3D co-registration of MR and optical images is more challenging to perform due to changes in contrast, slice orientation, and resolution between these modalities. Here, an automated non-rigid registration technique utilizing mutual information is proposed to accurately register 3D whole mouse optical and MR images as a first step towards automated registration of histology. Validation of this technique was accomplished through calculation of post-registration target registration error