Adaptive Resolution for Topology Modifications in Physically-based Animation

This paper shows the interest of basing a mechanical mesh upon an efficient topological model in order to give any simulation the ability to refine this mesh locally and apply topological modifications such as cutting, tear and matter destruction.Refinement and modifications can indeed be combined in order to get a more precise result.The powerful combinatorial map model provides the mathematical background which ensures that the quasi-manifold property is guaranteed for the mesh after any topological modification.The obtained results offer the versatility and time efficiency that are expected in applications such as surgical simulation

Dynamic Real-Time Deformations using Space and Time Adaptive Sampling

International audienceThis paper presents the first robust method for animating dynamic visco-elastic deformable objects that provides a guaranteed frame rate. The approach uses an automatic space and time adaptive level of detail technique, in combination with a large-displacement (Green) strain tensor formulation. The body is hierarchically partitioned into a number of tetrahedral regions and mass samples. The local resolution is determined by a quality condition that indicates where and when the resolution is too coarse. As the object moves and deforms, the sampling is refined to concentrate the computational load into the regions that deform the most. Our model consist of a continuous equation solved using a local explicit finite element method. We demonstrate that our adaptive Green strain tensor formulation virtually suppresses unwanted artifacts in the dynamic behavior, compared to adaptive mass-spring and other adaptive approaches. In particular, damped elastic vibration modes are shown to be nearly unchanged for several levels of refinement. Results are presented in the context of a virtual reality system. The user interacts in real-time with the dynamic object (such as a liver) through the control of a rigid tool, attached to a haptic device driven with forces derived from the method.Nous présentons une méthode robuste pour calculer les déformations dynamiques d'objets visco-élastiques, avec une garantie de temps-réel. L'idee maîtresse est d'utiliser une adaptation automatique, dans le temps et dans l'espace, du niveau de détail à laquelle la simulation est calculée, en combinaison avec un modèle élastique autorisant les grands déplacements (tenseur de Green). Le corps déformable est divisé en une hiérarchie de maillages tétrahédraux, du plus grossier aux plus fin. La résolution locale des calculs est déterminée par un critère de qualité qui nous dit quand et où raffiner ou déraffiner le modèle. Lors des déformations, la puissance de calcul se concentre ainsi tout naturellement sur les régions ou les déformations sont les plus grandes. Notre modèle repose sur une équation de l´elasticité des milieux continus, intégrée en utilisant une méthode d'éléments finis explicites. Nous avons montré expérimentalement que notre simulation adaptative basée sur le tenseur de Green supprime les artéfacts du comportement dynamique qui pouvaient être observés lorsque la même méthodologie était appliquée à d'autres modèles (masses-ressorts, tenseur de Cauchy, etc). En particulier, les modes de vibration du matériau semblent sensiblement les mêmes à tous les niveaux de résolution, ce qui s'est révélé indispensable pour faire fonctionner le modèle. Nous présentons nos résultats dans le contexte d'un système de réalité virtuelle ou l'utilisateur intéragit avec l'objet via un outil rigide, contrôlé par une interface à retour d'effort

An interactive meshless cutting model for nonlinear viscoelastic soft tissue in surgical simulators

In this paper, we present a novel interactive cutting simulation model for soft tissue based on the meshless framework. Unlike most existing methods that consider the cutting process of soft tissue in an over simplified manner, the presented model is able to simulate the complete cutting process that includes three stages: deformation before cutting open (DBCO), cutting open (CO), and deformation after cutting open (DACO). To characterize the complicated physical and mechanical properties of soft tissue, both nonlinearity and viscoelasticity were incorporated into the equations governing the motion of soft tissue. A line contact model was used for simulating the cutting process after analyzing the two major types of surgical instruments, i.e., scalpel and electrostick. The cutting speed and angle were taken into account in order to improve haptic rendering. Biomechanical tests and simulation experiments verified the validity of the introduced model. Specifically, the displacement vs. cutting force curves can be divided into three segments corresponding to the three stages of the cutting process. The results were also applied in a liver cutting simulating system and satisfactory visual effect and haptic feedback were achieved

MTCut: GPU-based marching tetra cuts

Isosurface construction and rendering based on tetrahedral grids has shown to be feasible on programmable graphics hardware. In this paper we present MTCut: a volume cutting algorithm that is able to cut isosurfaces obtained by a Marching Tetrahedra algorithm on volume data. It does not require a tetrahedal representation and runs in real time for complex meshes of up to 1.8M triangles. Our algorithm takes as input the isosurface to be cut, slices it, and produces the cut geometry in response to the user interaction with a haptic device. The result is a watertight manifold that can be interactively recovered back to CPU in response to a user request.Postprint (published version

Real-time simulation of surgery by Proper Generalized Decomposition techniques

La simulación quirúrgica por ordenador en tiempo real se ha convertido en una alternativa muy atractiva a los simuladores quirúrgicos tradicionales. Entre otras ventajas, los simuladores por ordenador consiguen ahorros importantes de tiempo y de costes de mantenimiento, y permiten que los estudiantes practiquen sus habilidades quirúrgicas en un entorno seguro tantas veces como sea necesario. Sin embargo, a pesar de las capacidades de los ordenadores actuales, la cirugía computacional sigue siendo un campo de investigación exigente. Uno de sus mayores retos es la alta velocidad a la que se tienen que resolver complejos problemas de mecánica de medios continuos para que los interfaces hápticos puedan proporcionar un sentido del tacto realista (en general, se necesitan velocidades de respuesta de 500-1000 Hz).Esta tesis presenta algunos métodos numéricos novedosos para la simulación interactiva de dos procedimientos quirúrgicos habituales: el corte y el rasgado (o desgarro) de tejidos blandos. El marco común de los métodos presentados es el uso de la Descomposición Propia Generalizada (PGD en inglés) para la generación de vademécums computacionales, esto es, metasoluciones generales de problemas paramétricos de altas dimensiones que se pueden evaluar a velocidades de respuesta compatibles con entornos hápticos.En el caso del corte, los vademécums computacionales se utilizan de forma conjunta con técnicas basadas en XFEM, mientras que la carga de cálculo se distribuye entre una etapa off-line (previa a la ejecución interactiva) y otra on-line (en tiempo de ejecución). Durante la fase off-line, para el órgano en cuestión se precalculan tanto un vademécum computacional para cualquier posición de una carga, como los desplazamientos producidos por un conjunto de cortes. Así, durante la etapa on-line, los resultados precalculados se combinan de la forma más adecuada para obtener en tiempo real la respuesta a las acciones dirigidas por el usuario. En cuanto al rasgado, a partir de una ecuación paramétrica basada en mecánica del daño continuo, se obtiene un vademécum computacional. La complejidad del modelo se reduce mediante técnicas de Descomposición Ortogonal Propia (POD en inglés), y el vademécum se incorpora a una formulación incremental explícita que se puede interpretar como una especie de integrador temporal.A modo de ejemplo, el método para el corte se aplica a la simulación de un procedimiento quirúrgico refractivo de la córnea conocido como queratotomía radial, mientras que el método para el rasgado se centra en la simulación de la colecistectomía laparoscópica (la extirpación de la vesícula biliar mediante laparoscopia). En ambos casos, los métodos implementados ofrecen excelentes resultados en términos de velocidades de respuesta y producen simulaciones muy realistas desde los puntos de vista visual y háptico.The real-time computer-based simulation of surgery has proven to be an appealing alternative to traditional surgical simulators. Amongst other advantages, computer-based simulators provide considerable savings on time and maintenance costs, and allow trainees to practice their surgical skills in a safe environment as often as necessary. However, in spite of the current computer capabilities, computational surgery continues to be a challenging field of research. One of its major issues is the high speed at which complex problems in continuum mechanics have to be solved so that haptic interfaces can render a realistic sense of touch (generally, feedback rates of 500–1 000 Hz are required). This thesis introduces some novel numerical methods for the interactive simulation of two usual surgical procedures: cutting and tearing of soft tissues. The common framework of the presented methods is the use of the Proper Generalised Decomposition (PGD) for the generation of computational vademecums, i. e. general meta-solutions of parametric high-dimensional problems that can be evaluated at feedback rates compatible with haptic environments. In the case of cutting, computational vademecums are used jointly with XFEM-based techniques, and the computing workload is distributed into an off-line and an on-line stage. During the off-line stage, both a computational vademecum for any position of a load and the displacements produced by a set of cuts are pre-computed for the organ under consideration. Thus, during the on-line stage, the pre-computed results are properly combined together to obtain in real-time the response to the actions driven by the user. Concerning tearing, a computational vademecum is obtained from a parametric equation based on continuum damage mechanics. The complexity of the model is reduced by Proper Orthogonal Decomposition (POD) techniques, and the vademecum is incorporated into an explicit incremental formulation that can be viewed as a sort of time integrator. By way of example, the cutting method is applied to the simulation of a corneal refractive surgical procedure known as radial keratotomy, whereas the tearing method focuses on the simulation of laparoscopic cholecystectomy (i. e. the removal of the gallbladder). In both cases, the implemented methods offer excellent performances in terms of feedback rates, and produce.<br /

Serial FEM/XFEM-Based Update of Preoperative Brain Images Using Intraoperative MRI

Current neuronavigation systems cannot adapt to changing intraoperative conditions over time. To overcome this limitation, we present an experimental end-to-end system capable of updating 3D preoperative images in the presence of brain shift and successive resections. The heart of our system is a nonrigid registration technique using a biomechanical model, driven by the deformations of key surfaces tracked in successive intraoperative images. The biomechanical model is deformed using FEM or XFEM, depending on the type of deformation under consideration, namely, brain shift or resection. We describe the operation of our system on two patient cases, each comprising five intraoperative MR images, and we demonstrate that our approach significantly improves the alignment of nonrigidly registered images

Cutting in deformable objects

Virtual reality simulations of surgical procedures allow such procedures to be practiced on computers instead of patients and test-animals. The core of such a system is a soft tissue simulation, that has to react very quickly but be realistic at the same time. This thesis discusses how deformable models can be simulated for this context, using an existing mathematical technique, the Finite Element Method. This method represents the object with a mesh, the material is subdivided in geometric primitives, such as triangles. Both the number of primitives and their shape influence the speed of a simulation. Hence, when the mesh changes, e.g. when simulating a procedure, this has to be done with care. This thesis shows how the interaction of meshing and simulation can be handled in software

Patient Specific Systems for Computer Assisted Robotic Surgery Simulation, Planning, and Navigation

The evolving scenario of surgery: starting from modern surgery, to the birth of medical imaging and the introduction of minimally invasive techniques, has seen in these last years the advent of surgical robotics. These systems, making possible to get through the difficulties of endoscopic surgery, allow an improved surgical performance and a better quality of the intervention. Information technology contributed to this evolution since the beginning of the digital revolution: providing innovative medical imaging devices and computer assisted surgical systems. Afterwards, the progresses in computer graphics brought innovative visualization modalities for medical datasets, and later the birth virtual reality has paved the way for virtual surgery. Although many surgical simulators already exist, there are no patient specific solutions. This thesis presents the development of patient specific software systems for preoperative planning, simulation and intraoperative assistance, designed for robotic surgery: in particular for bimanual robots that are becoming the future of single port interventions. The first software application is a virtual reality simulator for this kind of surgical robots. The system has been designed to validate the initial port placement and the operative workspace for the potential application of this surgical device. Given a bimanual robot with its own geometry and kinematics, and a patient specific 3D virtual anatomy, the surgical simulator allows the surgeon to choose the optimal positioning of the robot and the access port in the abdominal wall. Additionally, it makes possible to evaluate in a virtual environment if a dexterous movability of the robot is achievable, avoiding unwanted collisions with the surrounding anatomy to prevent potential damages in the real surgical procedure. Even if the software has been designed for a specific bimanual surgical robot, it supports any open kinematic chain structure: as far as it can be described in our custom format. The robot capabilities to accomplish specific tasks can be virtually tested using the deformable models: interacting directly with the target virtual organs, trying to avoid unwanted collisions with the surrounding anatomy not involved in the intervention. Moreover, the surgical simulator has been enhanced with algorithms and data structures to integrate biomechanical parameters into virtual deformable models (based on mass-spring-damper network) of target solid organs, in order to properly reproduce the physical behaviour of the patient anatomy during the interactions. The main biomechanical parameters (Young's modulus and density) have been integrated, allowing the automatic tuning of some model network elements, such as: the node mass and the spring stiffness. The spring damping coefficient has been modeled using the Rayleigh approach. Furthermore, the developed method automatically detect the external layer, allowing the usage of both the surface and internal Young's moduli, in order to model the main parts of dense organs: the stroma and the parenchyma. Finally the model can be manually tuned to represent lesion with specific biomechanical properties. Additionally, some software modules of the simulator have been properly extended to be integrated in a patient specific computer guidance system for intraoperative navigation and assistance in robotic single port interventions. This application provides guidance functionalities working in three different modalities: passive as a surgical navigator, assistive as a guide for the single port placement and active as a tutor preventing unwanted collision during the intervention. The simulation system has beed tested by five surgeons: simulating the robot access port placemen, and evaluating the robot movability and workspace inside the patient abdomen. The tested functionalities, rated by expert surgeons, have shown good quality and performance of the simulation. Moreover, the integration of biomechanical parameters into deformable models has beed tested with various material samples. The results have shown a good visual realism ensuring the performance required by an interactive simulation. Finally, the intraoperative navigator has been tested performing a cholecystectomy on a synthetic patient mannequin, in order to evaluate: the intraoperative navigation accuracy, the network communications latency and the overall usability of the system. The tests performed demonstrated the effectiveness and the usability of the software systems developed: encouraging the introduction of the proposed solution in the clinical practice, and the implementation of further improvements. Surgical robotics will be enhanced by an advanced integration of medical images into software systems: allowing the detailed planning of surgical interventions by means of virtual surgery simulation based on patient specific biomechanical parameters. Furthermore, the advanced functionalities offered by these systems, enable surgical robots to improve the intraoperative surgical assistance: benefitting of the knowledge of the virtual patient anatomy

Interaktive Echtzeitsimulation deformierbarer Oberflächen für Trainingssysteme in der Augenchirurgie

Die Arbeit befasst sich mit Simulations-Algorithmen für virtuelle Augenoperationen. Sie konzentriert sich auf die Simulation von Membranen, die im Verlauf eines chirurgischen Eingriffs aus dem Auge entfernt werden müssen. Es werden Algorithmen vorgestellt, die eine realistische Interaktion zwischen Membran und chirurgischem Instrument ermöglichen, und die eine physikalisch plausible Riss-Simulation garantieren

Déformation et découpe interactive de solides à géométrie complexe

Cette thèse consiste à explorer une nouvelle approche pour la simulation d'objets flexibles par la mécanique des milieux continus, dans le cadre d'applications graphiques interactives telles que le jeu vidéo ou l'entraînement aux gestes chirurgicaux. Elle s'inscrit en continuité d'un stage de M2-R sur ce même sujet. Il est important de pouvoir régler simplement un compromis entre précision et temps de calcul suivant la nature de l'application. Les approches actuelles de simulation utilisent principalement la méthode des éléments finis. Celle-ci repose sur un maillage volumique des objets qu'il est souvent difficile d'adapter dynamiquement aux besoins de l'application. La nouveauté introduite par cette thèse est d'utiliser des repères déformables comme primitives cinématiques, avec des champs de déplacements inspirés des méthodes de 'skinning' utilisées en informatique graphique. Le but est d'éviter ainsi les difficultés liées au maillage volumique, ainsi que de faciliter le raffinement et la simplification adaptatives par simple ajout ou suppression de repère déformable là où c'est souhaitable. Ce travail est financé par le projet européen 'Passport for Virtual Surgery', dont le but est de créer automatiquement des modèles physiques pour l'entraînement aux gestes de chirurgie hépatique, à partir de données médicales et anatomiques personnalisées. Dans ce contexte, Guillaume, en collaboration avec d'autres membres du projet, mettra en place les outils nécessaires pour construire la scène physique à partir d'images médicales segmentées et de connaissances anatomiques génériques. Le foie sera dans un premier temps représenté par des modèles physiques précédemment développés à EVASION et étendus aux opérations de découpe. Par la suite, il y appliquera son nouveau modèle mécanique basé sur des repères déformables. The aim of this thesis is to develop a new approach for the simulation of flexible objects based on the continous middle method, related with interactive graphics applications such as video games or training in surgery. It is a continuity of the M2 research internship on the same topic. It is important to simply settle a compromise between accuracy and time computing according to the application. Current simulation approaches mainly use the finite element method, which is based on a volumetric mesh of the simulated objects. It is often difficult to dynamically adapt the needs to the application. The novelty of this thesis is to use deformable reference frames as kinematic primitives, with displacement fields based on 'skinning' methods used in computer graphics. The aim is to avoid the difficulties associated with volumetric mesh, and make the refinement and the adaptive simplification easier by adding or deleting deformable reference frames if necessary. This work is funded by the European project 'Passport for Virtual Surgery', which aims to automatically create models for physical training in gestures of liver surgery, from medical and anatomical custom data. In this context, Guillaume, in collaboration with other members of the project, will develop the tools necessary to build the physical scene from segmented medical images and generic anatomical knowledge. The liver will initially be represented by physical models previously developed in the EVASION team and then extended to cutting operations. Thereafter, Guillaume will apply his new mechanical model based on deformable reference frames.Physically based deformable models have become ubiquitous in computer graphics. It allow to synthetize real behaviors, based on the physical laws from continuum mechanics. In this thesis, we focus on interactive simulations such as to video games or surgical simulators. The majority of the existing works focused up to here on the animation of objects made of homogeneous materials. Nevertheless, plenty of real objects, for instance like the biological structures, consist of multiple imbricated materials. Their decomposition in homogeneous zones requires a high-resolution spatial discretization to solve the variations of the material properties, which requires prohibitive computation time. In this context, we present new real time simulation techniques for deformable objects which can be cut. First of all, we present a real time method for cutting deformable objects in which, contrary to the previous methods, the object deforms on the cutting tool contact and cuts occur only when the pressure reaches a certain level. The independence of the physical, collision and visual models makes the topological changes easier. The GPU computing and local modifications enable fast execution. Then, a dynamic meshless method is described, which uses reference frames as control nodes instead of using points, with a displacement field formulation similar to skinning. It allows to easily tune the weights and benefits from the rigor of physical methods as the finite elements. The introduction of integration points, reducing the samples number by a least squares approximation, speeds up the spatial integrations. Other pre-computations are proposed in order to speed up the simulation time. Finally, new anisotropic shape functions are defined to encode the variations of material properties thanks to the introduction of the compliance distance. These complex shape functions uncouple the material resolution of the displacement functions ones. It allow an extremely sparse nodes sampling. The use of the compliance distance allows an automatic nodes distribution with regard to the material properties.SAVOIE-SCD - Bib.électronique (730659901) / SudocGRENOBLE1/INP-Bib.électronique (384210012) / SudocGRENOBLE2/3-Bib.électronique (384219901) / SudocSudocFranceF