Research on real-time physics-based deformation for haptic-enabled medical simulation

This study developed a multiple effective visuo-haptic surgical engine to handle a variety of surgical manipulations in real-time. Soft tissue models are based on biomechanical experiment and continuum mechanics for greater accuracy. Such models will increase the realism of future training systems and the VR/AR/MR implementations for the operating room

Design and development of a VR system for exploration of medical data using haptic rendering and high quality visualization

[no abstract

Surface-Only Simulation of Fluids

Surface-only simulation methods for fluid dynamics are those that perform computation only on a surface representation, without relying on any volumetric discretization. Such methods have superior asymptotic complexity in time and memory than the traditional volumetric discretization approaches, and thus are more tractable for simulation of complex fluid phenomena. Although for most computer graphics applications and many engineering applications, the interior flow inside the fluid phases is typically not of interest, the vast majority of existing numerical techniques still rely on discretization of the volumetric domain. My research first tackles the mesh-based surface tracking problem in the multimaterial setting, and then proposes surface-only simulation solutions for two scenarios: the soap-films and bubbles, and the general 3D liquids. Throughout these simulation approaches, all computation takes place on the surface, and volumetric discretization is entirely eliminated

Fast soft-tissue deformations with FEM

Soft body simulation has been a very active research area in computer animation since Baraff and Witkin's 1998 work on cloth simulation, which led Pixar to start using such techniques in all of its animated movies that followed. Many challenges in these simulations come from different roots. From a numerical point of view, deformable systems are large sparse problems that can become numerically unstable at surprising rates and may need to be modified at each time-step. From a mathematical point of view, hyperelastic models defined by continuum mechanics need to be derived, established and configured. And from the geometric side, physical interaction with the environment and self-collisions may need to be detected and introduced into the solver. It is a fact that the Computer Graphics academia primarily focuses on offline methods, both for rendering and simulation. At the same time, the advances from the industry mainly apply to real-time rendering. However, we wondered how such high-quality simulation methods would map to a real-time use case. In this thesis, we delve into the simulation system used by Pixar's Fizt2 simulator, based on the Finite Element Method, and investigate how to apply the same techniques in real-time while preserving robustness and fidelity, altogether providing the user with some interaction mechanisms. A 3D engine for simulating deformable materials has been developed following the described models, with an interactive interface that allows the definition and configuration of scenes and later interaction with the simulation

Robust interactive simulation of deformable solids with detailed geometry using corotational FEM

This thesis focuses on the interactive simulation of highly detailed deformable solids modelled with the Corotational Finite Element Method. Starting from continuum mechanics we derive the discrete equations of motion and present a simulation scheme with support for user-in-the-loop interaction, geometric constraints and contact treatment. The interplay between accuracy and computational cost is discussed in depth, and practical approximations are analyzed with an emphasis on robustness and efficiency, as required by interactive simulation. The first part of the thesis focuses on deformable material discretization using the Finite Element Method with simplex elements and a corotational linear constitutive model, and presents our contributions to the solution of widely reported robustness problems in case of large stretch deformations and finite element degeneration. First,we introduce a stress differential approximation for quasi-implicit corotational linear FEM that improves its results for large deformations and closely matches the fullyimplicit solution with minor computational overhead. Next, we address the problem ofrobustness and realism in simulations involving element degeneration, and show that existing methods have previously unreported flaws that seriously threaten robustness and physical plausibility in interactive applications. We propose a new continuous-time approach, degeneration-aware polar decomposition, that avoids such flaws and yields robust degeneration recovery. In the second part we focus on geometry representation and contact determination for deformable solids with highly detailed surfaces. Given a high resolution closed surface mesh we automatically build a coarse embedding tetrahedralization and a partitioned representation of the collision geometry in a preprocess. During simulation, our proposed contact determination algorithm finds all intersecting pairs of deformed triangles using a memory-efficient barycentric bounding volume hierarchy, connects them into potentially disjoint intersection curves and performs a topological flood process on the exact intersection surfaces to discover a minimal set of contact points. A novel contact normal definition is used to find contact point correspondences suitable for contact treatment.Aquesta tesi tracta sobre la simulació interactiva de sòlids deformables amb superfícies detallades, modelats amb el Mètode dels Elements Finits (FEM) Corotacionals. A partir de la mecànica del continuu derivem les equacions del moviment discretes i presentem un esquema de simulació amb suport per a interacció d'usuari, restriccions geomètriques i tractament de contactes. Aprofundim en la interrelació entre precisió i cost de computació, i analitzem aproximacions pràctiques fent èmfasi en la robustesa i l'eficiència necessàries per a la simulació interactiva. La primera part de la tesi es centra en la discretització del material deformable mitjançant el Mètode dels Elements Finits amb elements de tipus s'implex i un model constituent basat en elasticitat linial corotacional, i presenta les nostres contribucions a la solució de problemes de robustesa àmpliament coneguts que apareixen en cas de sobreelongament i degeneració dels elements finits. Primer introduïm una aproximació dels diferencials d'estress per a FEM linial corotacional amb integració quasi-implícita que en millora els resultats per a deformacions grans i s'apropa a la solució implícita amb un baix cost computacional. A continuació tractem el problema de la robustesa i el realisme en simulacions que inclouen degeneració d'elements finits, i mostrem que els mètodes existents presenten inconvenients que posen en perill la robustesa plausibilitat de la simulació en aplicacions interactives. Proposem un enfocament nou basat en temps continuu, la descomposició polar amb coneixement de degeneració, que evita els inconvenients esmentats i permet corregir la degeneració de forma robusta. A la segona part de la tesi ens centrem en la representació de geometria i la determinació de contactes per a sòlids deformables amb superfícies detallades. A partir d'una malla de superfície tancada construím una tetraedralització englobant de forma automàtica en un preprocés, i particionem la geometria de colisió. Proposem un algorisme de detecció de contactes que troba tots els parells de triangles deformats que intersecten mitjançant una jerarquia de volums englobants en coordenades baricèntriques, els connecta en corbes d'intersecció potencialment disjuntes i realitza un procés d'inundació topològica sobre les superfícies d'intersecció exactes per tal de descobrir un conjunt mínim de punts de contacte. Usem una definició nova de la normal de contacte per tal de calcular correspondències entre punts de contacte útils per al seu tractament.Postprint (published version

Real-time hybrid cutting with dynamic fluid visualization for virtual surgery

It is widely accepted that a reform in medical teaching must be made to meet today's high volume training requirements. Virtual simulation offers a potential method of providing such trainings and some current medical training simulations integrate haptic and visual feedback to enhance procedure learning. The purpose of this project is to explore the capability of Virtual Reality (VR) technology to develop a training simulator for surgical cutting and bleeding in a general surgery

Multi-Surface Simplex Spine Segmentation for Spine Surgery Simulation and Planning

This research proposes to develop a knowledge-based multi-surface simplex deformable model for segmentation of healthy as well as pathological lumbar spine data. It aims to provide a more accurate and robust segmentation scheme for identification of intervertebral disc pathologies to assist with spine surgery planning. A robust technique that combines multi-surface and shape statistics-aware variants of the deformable simplex model is presented. Statistical shape variation within the dataset has been captured by application of principal component analysis and incorporated during the segmentation process to refine results. In the case where shape statistics hinder detection of the pathological region, user-assistance is allowed to disable the prior shape influence during deformation. Results have been validated against user-assisted expert segmentation