Microscope Embedded Neurosurgical Training and Intraoperative System

In the recent years, neurosurgery has been strongly influenced by new technologies. Computer Aided Surgery (CAS) offers several benefits for patients\u27 safety but fine techniques targeted to obtain minimally invasive and traumatic treatments are required, since intra-operative false movements can be devastating, resulting in patients deaths. The precision of the surgical gesture is related both to accuracy of the available technological instruments and surgeon\u27s experience. In this frame, medical training is particularly important. From a technological point of view, the use of Virtual Reality (VR) for surgeon training and Augmented Reality (AR) for intra-operative treatments offer the best results. In addition, traditional techniques for training in surgery include the use of animals, phantoms and cadavers. The main limitation of these approaches is that live tissue has different properties from dead tissue and that animal anatomy is significantly different from the human. From the medical point of view, Low-Grade Gliomas (LGGs) are intrinsic brain tumours that typically occur in younger adults. The objective of related treatment is to remove as much of the tumour as possible while minimizing damage to the healthy brain. Pathological tissue may closely resemble normal brain parenchyma when looked at through the neurosurgical microscope. The tactile appreciation of the different consistency of the tumour compared to normal brain requires considerable experience on the part of the neurosurgeon and it is a vital point. The first part of this PhD thesis presents a system for realistic simulation (visual and haptic) of the spatula palpation of the LGG. This is the first prototype of a training system using VR, haptics and a real microscope for neurosurgery. This architecture can be also adapted for intra-operative purposes. In this instance, a surgeon needs the basic setup for the Image Guided Therapy (IGT) interventions: microscope, monitors and navigated surgical instruments. The same virtual environment can be AR rendered onto the microscope optics. The objective is to enhance the surgeon\u27s ability for a better intra-operative orientation by giving him a three-dimensional view and other information necessary for a safe navigation inside the patient. The last considerations have served as motivation for the second part of this work which has been devoted to improving a prototype of an AR stereoscopic microscope for neurosurgical interventions, developed in our institute in a previous work. A completely new software has been developed in order to reuse the microscope hardware, enhancing both rendering performances and usability. Since both AR and VR share the same platform, the system can be referred to as Mixed Reality System for neurosurgery. All the components are open source or at least based on a GPL license

Virtual Reality Simulation of Liver Biopsy with a Respiratory Component

International audienceThe field of computer-based simulators has grown exponentially in the last few decades, especially in Medicine. Advantages of medical simulators include: (1) provision of a platform where trainees can practice procedures without risk of harm to patients; (2) anatomical fidelity; (3) the ability to train in an environment wherein physiological behaviour is observed, something that is not permitted where in-vitro phantoms are used; (4) flexibility regarding anatomical and pathological variation of test cases that is valuable in the acquisition of experience; (5) quantification of metrics relating to task performance that can be used to monitor trainee performance throughout the learning curve; and (6) cost effectiveness. In this chapter, we will focus on the current state of the art of medical simulators, the relevant parameters required to design a medical simulator, the basic framework of the simulator, methods to produce a computer-based model of patient respiration and finally a description of a simulator for ultrasound guided for liver biopsy. The model that is discussed presents a framework that accurately simulates respiratory motion, allowing for the fine tuning of relevant parameters in order to produce a patient-specific breathing pattern that can then be incorporated into a simulation with real-rime haptic interaction. Thus work was conducted as part CRaIVE collaboration [1], whose aim is to develop simulators specific to interventional radiology

Contributions to virtual reality

153 p.The thesis contributes in three Virtual Reality areas: ¿ Visual perception: a calibration algorithm is proposed to estimate stereo projection parameters in head-mounted displays, so that correct shapes and distances can be perceived, and calibration and control procedures are proposed to obtain desired accommodation stimuli at different virtual distances.¿ Immersive scenarios: the thesis analyzes several use cases demanding varying degrees of immersion and special, innovative visualization solutions are proposed to fulfil their requirements. Contributions focus on machinery simulators, weather radar volumetric visualization and manual arc welding simulation.¿ Ubiquitous visualization: contributions are presented to scenarios where users access interactive 3D applications remotely. The thesis follows the evolution of Web3D standards and technologies to propose original visualization solutions for volume rendering of weather radar data, e-learning on energy efficiency, virtual e-commerce and visual product configurators

True-color 3D rendering of human anatomy using surface-guided color sampling from cadaver cryosection image data: A practical approach Jon Jatsu Azkue

Three-dimensional computer graphics are increasingly used for scientific visualization and for communicating anatomical knowledge and data. This study presents a practical method to produce true-color 3D surface renditions of anatomical structures. The procedure involves extracting the surface geometry of the structure of interest from a stack of cadaver cryosection images, using the extracted surface as a probe to retrieve color information from cryosection data, and mapping sampled colors back onto the surface model to produce a true-color rendition. Organs and body parts can be rendered separately or in combination to create custom anatomical scenes. By editing the surface probe, structures of interest can be rendered as if they had been previously dissected or prepared for anatomical demonstration. The procedure is highly flexible and nondestructive, offering new opportunities to present and communicate anatomical information and knowledge in a visually realistic manner. The technical procedure is described, including freely available open-source software tools involved in the production process, and examples of color surface renderings of anatomical structures are provided

Contributions to virtual reality

153 p.The thesis contributes in three Virtual Reality areas: ¿ Visual perception: a calibration algorithm is proposed to estimate stereo projection parameters in head-mounted displays, so that correct shapes and distances can be perceived, and calibration and control procedures are proposed to obtain desired accommodation stimuli at different virtual distances.¿ Immersive scenarios: the thesis analyzes several use cases demanding varying degrees of immersion and special, innovative visualization solutions are proposed to fulfil their requirements. Contributions focus on machinery simulators, weather radar volumetric visualization and manual arc welding simulation.¿ Ubiquitous visualization: contributions are presented to scenarios where users access interactive 3D applications remotely. The thesis follows the evolution of Web3D standards and technologies to propose original visualization solutions for volume rendering of weather radar data, e-learning on energy efficiency, virtual e-commerce and visual product configurators