A framework for tumor segmentation and interactive immersive visualization of medical image data for surgical planning

This dissertation presents the framework for analyzing and visualizing digital medical images. Two new segmentation methods have been developed: a probability based segmentation algorithm, and a segmentation algorithm that uses a fuzzy rule based system to generate similarity values for segmentation. A visualization software application has also been developed to effectively view and manipulate digital medical images on a desktop computer as well as in an immersive environment.;For the probabilistic segmentation algorithm, image data are first enhanced by manually setting the appropriate window center and width, and if needed a sharpening or noise removal filter is applied. To initialize the segmentation process, a user places a seed point within the object of interest and defines a search region for segmentation. Based on the pixels\u27 spatial and intensity properties, a probabilistic selection criterion is used to extract pixels with a high probability of belonging to the object. To facilitate the segmentation of multiple slices, an automatic seed selection algorithm was developed to keep the seeds in the object as its shape and/or location changes between consecutive slices.;The second segmentation method, a new segmentation method using a fuzzy rule based system to segment tumors in a three-dimensional CT data was also developed. To initialize the segmentation process, the user selects a region of interest (ROI) within the tumor in the first image of the CT study set. Using the ROI\u27s spatial and intensity properties, fuzzy inputs are generated for use in the fuzzy rules inference system. Using a set of predefined fuzzy rules, the system generates a defuzzified output for every pixel in terms of similarity to the object. Pixels with the highest similarity values are selected as tumor. This process is automatically repeated for every subsequent slice in the CT set without further user input, as the segmented region from the previous slice is used as the ROI for the current slice. This creates a propagation of information from the previous slices, used to segment the current slice. The membership functions used during the fuzzification and defuzzification processes are adaptive to the changes in the size and pixel intensities of the current ROI. The proposed method is highly customizable to suit different needs of a user, requiring information from only a single two-dimensional image.;Segmentation results from both algorithms showed success in segmenting the tumor from seven of the ten CT datasets with less than 10% false positive errors and five test cases with less than 10% false negative errors. The consistency of the segmentation results statistics also showed a high repeatability factor, with low values of inter- and intra-user variability for both methods.;The visualization software developed is designed to load and display any DICOM/PACS compatible three-dimensional image data for visualization and interaction in an immersive virtual environment. The software uses the open-source libraries DCMTK: DICOM Toolkit for parsing of digital medical images, Coin3D and SimVoleon for scenegraph management and volume rendering, and VRJuggler for virtual reality display and interaction. A user can apply pseudo-coloring in real time with multiple interactive clipping planes to slice into the volume for an interior view. A windowing feature controls the tissue density ranges to display. A wireless gamepad controller as well as a simple and intuitive menu interface control user interactions. The software is highly scalable as it can be used on a single desktop computer to a cluster of computers for an immersive multi-projection virtual environment. By wearing a pair of stereo goggles, the surgeon is immersed within the model itself, thus providing a sense of realism as if the surgeon is inside the patient.;The tools developed in this framework are designed to improve patient care by fostering the widespread use of advanced visualization and computational intelligence in preoperative planning, surgical training, and diagnostic assistance. Future work includes further improvements to both segmentation methods with plans to incorporate the use of deformable models and level set techniques to include tumor shape features as part of the segmentation criteria. For the surgical planning components, additional controls and interactions with the simulated endoscopic camera and the ability to segment the colon or a selected region of the airway for a fixed-path navigation as a full virtual endoscopy tool will also be implemented. (Abstract shortened by UMI.

Development of A Kinetic Model For Loop-Free Colonoscopy Technology

The colonoscope is an important tool in diagnosis and management of diseases of the colon. One of the ongoing challenges with this device is that the colonoscope may form a loop together with the colon during the procedure. The result of the loop is that further insertion of the scope in the colon may not be possible. The loop may also cause risks of perforation of the colon and pain in the patient. There are currently several existing devices to overcome loop formation in colonoscopy, some of which have been introduced in clinical work. However, empirical assessment shows that these devices do not work very well. This is the motivation for the research presented in this thesis. In this thesis, a new paradigm of thinking, “doctor-assisted colonoscopy,” is proposed to overcome loop formation. In this new approach, the physician’s role is enhanced with new information that is acquired by sensors outside the human body and inferred from the mathematical model. It is referred to as a kinetic model due to the fact that this model describes the kinetic behaviour of the scope. This thesis is devoted to development of this kinetic model. In this study, the model of the colonoscope and the model of the colon are developed based on the Timoshenko beam theory, and parameters in both models are determined by the experiments. The following conclusions then are made: (1) self-locking of the colonoscope is the most basic cause for a loop to occur, while structural instability of the colonsocope is dependent on the self-locking; (2) both the scope and the colon can be well represented with the Timoshenko beam elements and the Linear Complementary Problem (LCP) formulation derived from Signorini’s law, and Coulom’s law for representation of interactions between the colon and scope is adequate; (3) there are effects from the location, looping, and tip deflection of the scope on flexural rigidity of the scope. Approximately, the flexural rigidity of the CF-Q160L colonoscope ranges from 300 to 650 N•cm2, and its accuracy is proven by a good agreement between the model predicted result and experimental result; (4) Rayleigh damping for the CF-Q160L colonoscope depends more on the mass matrix [M] of the colonoscope than the stiffness matrix [K], which is evident by the large coefficient value of “alpha” (0.3864) and the small coefficient value of “beta” (0.0164). The contributions of this thesis are: (1) the finding that the main cause of the loop is not structural instability of the colonoscope but rather self-locking of the colonoscope, which could lead to design of a “new-generation” colonoscope to avoid the loop; (2) a systematic evaluation of the existing colonoscopy technologies based on the well-proven Axiomatic Design Theory (ADT), which will serve as a guideline for the development of future new colonoscopes in future; (3) an approach to developing a kinetic model of the colonoscope useful to modeling similar objects such as a catheter guide-wire; (4) a novel ex-vivo colonoscopy test-bed with the kinetic and kinematic measurements useful for validation of new designs in colonoscopy technology and also useful for training physicians who perform the colonoscopy procedure; and (5) a new paradigm of thinking for colonoscopy called “doctor-assisted colonoscopy,” which has potential applications to other medical procedures such as catheter-based procedures

Advanced Endoscopic Navigation:Surgical Big Data,Methodology,and Applications

随着科学技术的飞速发展，健康与环境问题日益成为人类面临的最重大问题之一。信息科学、计算机技术、电子工程与生物医学工程等学科的综合应用交叉前沿课题，研究现代工程技术方法，探索肿瘤癌症等疾病早期诊断、治疗和康复手段。本论文综述了计算机辅助微创外科手术导航、多模态医疗大数据、方法论及其临床应用：从引入微创外科手术导航概念出发，介绍了医疗大数据的术前与术中多模态医学成像方法、阐述了先进微创外科手术导航的核心流程包括计算解剖模型、术中实时导航方案、三维可视化方法及交互式软件技术，归纳了各类微创外科手术方法的临床应用。同时，重点讨论了全球各种手术导航技术在临床应用中的优缺点，分析了目前手术导航领域内的最新技术方法。在此基础上，提出了微创外科手术方法正向数字化、个性化、精准化、诊疗一体化、机器人化以及高度智能化的发展趋势。【Abstract】Interventional endoscopy (e.g., bronchoscopy, colonoscopy, laparoscopy, cystoscopy) is a widely performed procedure that involves either diagnosis of suspicious lesions or guidance for minimally invasive surgery in a variety of organs within the body cavity. Endoscopy may also be used to guide the introduction of certain items (e.g., stents) into the body. Endoscopic navigation systems seek to integrate big data with multimodal information (e.g., computed tomography, magnetic resonance images, endoscopic video sequences, ultrasound images, external trackers) relative to the patient's anatomy, control the movement of medical endoscopes and surgical tools, and guide the surgeon's actions during endoscopic interventions. Nevertheless, it remains challenging to realize the next generation of context-aware navigated endoscopy. This review presents a broad survey of various aspects of endoscopic navigation, particularly with respect to the development of endoscopic navigation techniques. First, we investigate big data with multimodal information involved in endoscopic navigation. Next, we focus on numerous methodologies used for endoscopic navigation. We then review different endoscopic procedures in clinical applications. Finally, we discuss novel techniques and promising directions for the development of endoscopic navigation.X.L. acknowledges funding from the Fundamental Research Funds for the Central Universities. T.M.P. acknowledges funding from the Canadian Foundation for Innovation, the Canadian Institutes for Health Research, the National Sciences and Engineering Research Council of Canada, and a grant from Intuitive Surgical Inc

The emerging role of virtual reality as an adjunct to procedural sedation and anesthesia: a narrative review

Over the past 20 years, there has been a significant reduction in the incidence of adverse events associated with sedation outside of the operating room. Non-pharmacologic techniques are increasingly being used as peri-operative adjuncts to facilitate and promote anxiolysis, analgesia and sedation, and to reduce adverse events. This narrative review will briefly explore the emerging role of immersive reality in the peri-procedural care of surgical patients. Immersive virtual reality (VR) is intended to distract patients with the illusion of “being present” inside the computer-generated world, drawing attention away from their anxiety, pain, and discomfort. VR has been described for a variety of procedures that include colonoscopies, venipuncture, dental procedures, and burn wound care. As VR technology develops and the production costs decrease, the role and application of VR in clinical practice will expand. It is important for medical professionals to understand that VR is now available for prime-time use and to be aware of the growing body in the literature that supports VR.info:eu-repo/semantics/publishedVersio