Simultaneous Segmentation and Anatomical Labeling of the Cerebral Vasculature

We present a novel algorithm for the simultaneous segmentation and anatomical labeling of the cerebral vasculature. The method first constructs an over-complete graph capturing the vasculature. It then selects and labels the subset of edges that most likely represents the true vasculature. Unlike existing approaches that first attempt to obtain a good segmentation and then perform labeling, we jointly optimize for both by simultaneously taking into account the image evidence and the prior knowledge about the geometry and connectivity of the vasculature. This results in an Integer Program (IP), which we solve optimally using a branch-and-cut algorithm. We evaluate our approach on a public dataset of 50 cerebral MRA images, and demonstrate that it compares favorably against state-of-the-art methods

Open-source virtual bronchoscopy for image guided navigation

This thesis describes the development of an open-source system for virtual bronchoscopy used in combination with electromagnetic instrument tracking. The end application is virtual navigation of the lung for biopsy of early stage cancer nodules. The open-source platform 3D Slicer was used for creating freely available algorithms for virtual bronchscopy. Firstly, the development of an open-source semi-automatic algorithm for prediction of solitary pulmonary nodule malignancy is presented. This approach may help the physician decide whether to proceed with biopsy of the nodule. The user-selected nodule is segmented in order to extract radiological characteristics (i.e., size, location, edge smoothness, calcification presence, cavity wall thickness) which are combined with patient information to calculate likelihood of malignancy. The overall accuracy of the algorithm is shown to be high compared to independent experts' assessment of malignancy. The algorithm is also compared with two different predictors, and our approach is shown to provide the best overall prediction accuracy. The development of an airway segmentation algorithm which extracts the airway tree from surrounding structures on chest Computed Tomography (CT) images is then described. This represents the first fundamental step toward the creation of a virtual bronchoscopy system. Clinical and ex-vivo images are used to evaluate performance of the algorithm. Different CT scan parameters are investigated and parameters for successful airway segmentation are optimized. Slice thickness is the most affecting parameter, while variation of reconstruction kernel and radiation dose is shown to be less critical. Airway segmentation is used to create a 3D rendered model of the airway tree for virtual navigation. Finally, the first open-source virtual bronchoscopy system was combined with electromagnetic tracking of the bronchoscope for the development of a GPS-like system for navigating within the lungs. Tools for pre-procedural planning and for helping with navigation are provided. Registration between the lungs of the patient and the virtually reconstructed airway tree is achieved using a landmark-based approach. In an attempt to reduce difficulties with registration errors, we also implemented a landmark-free registration method based on a balanced airway survey. In-vitro and in-vivo testing showed good accuracy for this registration approach. The centreline of the 3D airway model is extracted and used to compensate for possible registration errors. Tools are provided to select a target for biopsy on the patient CT image, and pathways from the trachea towards the selected targets are automatically created. The pathways guide the physician during navigation, while distance to target information is updated in real-time and presented to the user. During navigation, video from the bronchoscope is streamed and presented to the physician next to the 3D rendered image. The electromagnetic tracking is implemented with 5 DOF sensing that does not provide roll rotation information. An intensity-based image registration approach is implemented to rotate the virtual image according to the bronchoscope's rotations. The virtual bronchoscopy system is shown to be easy to use and accurate in replicating the clinical setting, as demonstrated in the pre-clinical environment of a breathing lung method. Animal studies were performed to evaluate the overall system performance

Seeing the Big Picture: System Architecture Trends in Endoscopy and LED-Based hyperspectral Subsystem Intergration

Early-stage colorectal lesions remain difficult to detect. Early development of neoplasia tends to be small (less than 10 mm) and flat and difficult to distinguish from surrounding mucosa. Additionally, optical diagnosis of neoplasia as benign or malignant is problematic. Low rates of detection of these lesions allow for continued growth in the colorectum and increased risk of cancer formation. Therefore, it is crucial to detect neoplasia and other non-neoplastic lesions to determine risk and guide future treatment. Technology for detection needs to enhance contrast of subtle tissue differences in the colorectum and track multiple biomarkers simultaneously. This work implements one such technology with the potential to achieve the desired multi-contrast outcome for endoscopic screenings: hyperspectral imaging. Traditional endoscopic imaging uses a white light source and a RGB detector to visualize the colorectum using reflected light. Hyperspectral imaging (HSI) acquires an image over a range of individual wavelength bands to create an image hypercube with a wavelength dimension much deeper and more sensitive than that of an RGB image. A hypercube can consist of reflectance or fluorescence (or both) spectra depending on the filtering optics involved. Prior studies using HSI in endoscopy have normally involved ex vivo tissues or xiv optics that created a trade-off between spatial resolution, spectral discrimination and temporal sampling. This dissertation describes the systems design of an alternative HSI endoscopic imaging technology that can provide high spatial resolution, high spectral distinction and video-rate acquisition in vivo. The hyperspectral endoscopic system consists of a novel spectral illumination source for image acquisition dependent on the fluorescence excitation (instead of emission). Therefore, this work represents a novel contribution to the field of endoscopy in combining excitation-scanning hyperspectral imaging and endoscopy. This dissertation describes: 1) systems architecture of the endoscopic system in review of previous iterations and theoretical next-generation options, 2) feasibility testing of a LED-based hyperspectral endoscope system and 3) another LED-based spectral illuminator on a microscope platform to test multi-spectral contrast imaging. The results of the architecture point towards an endoscopic system with more complex imaging and increased computational capabilities. The hyperspectral endoscope platform proved feasibility of a LED-based spectral light source with a multi-furcated solid light guide. Another LED-based design was tested successfully on a microscope platform with a dual mirror array similar to telescope designs. Both feasibility tests emphasized optimization of coupling optics and combining multiple diffuse light sources to a common output. These results should lead to enhanced imagery for endoscopic tissue discrimination and future optical diagnosis for routine colonoscopy