Development of a Reality-Based, Haptics-Enabled Simulator for Tool-Tissue Interactions

The advent of complex surgical procedures has driven the need for finite element based surgical training simulators which provide realistic visual and haptic feedback throughout the surgical task. The foundation of a simulator stems from the use of accurate, reality-based models for the global tissue response as well as the tool-tissue interactions. To that end, ex vivo and in vivo tests were conducted for soft-tissue probing and in vivo tests were conducted for soft-tissue cutting for the purpose of model development. In formulating a surgical training system, there is a desire to replicate the surgical task as accurately as possible for haptic and visual realism. However, for many biological tissues, there is a discrepancy between the mechanical characteristics of ex vivo and in vivo tissue. The efficacy of utilizing an ex vivo model for simulation of in vivo probing tasks on porcine liver was evaluated by comparing the simulated probing task to an identical in vivo probing experiment. The models were then further improved upon to better replicate the in vivo response. During the study of cutting modeling, in vivo cutting experiments were performed on porcine liver to derive the force-displacement response of the tissue to a scalpel blade. Using this information, a fracture mechanics based approach was applied to develop a fully defined cohesive zone model governing the separation properties of the liver directly in front of the scalpel blade. Further, a method of scaling the cohesive zone parameters was presented to minimize the computational expense in an effort to apply the cohesive based cutting approach to real-time simulators. The development of the models for the global tissue response and local tool-tissue interactions for probing and cutting of soft-tissue provided the framework for real-time simulation of basic surgical skills training. Initially, a pre-processing approach was used for the development of reality-based, haptics enabled simulators for probing and cutting of soft tissue. Then a real-time finite element based simulator was developed to simulate the probing task without the need to know the tool path prior to simulation

Real-Time Graphic and Haptic Simulation of Deformable Tissue Puncture

A myriad of surgical tasks rely on puncturing tissue membranes (Fig. 1) and cutting through tissue mass. Properly training a practitioner for such tasks requires a simulator that can display both the graphical changes and the haptic forces of these deformations, punctures, and cutting actions. This paper documents our work to create a simulator that can model these effects in real time. Generating graphic and haptic output necessitates the use of a predictive model to track the tissue’s physical state. Many finite element methods (FEM) exist for computing tissue deformation ([1],[4]). These methods often obtain accurate results, but they can be computationally intensive for complex models. Real-time tasks using this approach are often limited in their complexity and workspace domain due to the large computational overhead of FEM. The computer graphics community has developed a large range of methods for modeling deformable media [5], often trading complete physical accuracy for computational speedup. Casson and Laugier [3] outline a mass-spring mesh model based on these principles, but they do not explore its usage with haptic interaction. Gerovich et al. [2] detail a set of haptic interaction rules (Fig. 2) for one dimensional simulation of multi-layer deformable tissue, but they do not provide strategies for integrating this model with realistic graphic feedback

Real-time Error Control for Surgical Simulation

Objective: To present the first real-time a posteriori error-driven adaptive finite element approach for real-time simulation and to demonstrate the method on a needle insertion problem. Methods: We use corotational elasticity and a frictional needle/tissue interaction model. The problem is solved using finite elements within SOFA. The refinement strategy relies upon a hexahedron-based finite element method, combined with a posteriori error estimation driven local $h$-refinement, for simulating soft tissue deformation. Results: We control the local and global error level in the mechanical fields (e.g. displacement or stresses) during the simulation. We show the convergence of the algorithm on academic examples, and demonstrate its practical usability on a percutaneous procedure involving needle insertion in a liver. For the latter case, we compare the force displacement curves obtained from the proposed adaptive algorithm with that obtained from a uniform refinement approach. Conclusions: Error control guarantees that a tolerable error level is not exceeded during the simulations. Local mesh refinement accelerates simulations. Significance: Our work provides a first step to discriminate between discretization error and modeling error by providing a robust quantification of discretization error during simulations.Comment: 12 pages, 16 figures, change of the title, submitted to IEEE TBM

A novel haptic model and environment for maxillofacial surgical operation planning and manipulation

This paper presents a practical method and a new haptic model to support manipulations of bones and their segments during the planning of a surgical operation in a virtual environment using a haptic interface. To perform an effective dental surgery it is important to have all the operation related information of the patient available beforehand in order to plan the operation and avoid any complications. A haptic interface with a virtual and accurate patient model to support the planning of bone cuts is therefore critical, useful and necessary for the surgeons. The system proposed uses DICOM images taken from a digital tomography scanner and creates a mesh model of the filtered skull, from which the jaw bone can be isolated for further use. A novel solution for cutting the bones has been developed and it uses the haptic tool to determine and define the bone-cutting plane in the bone, and this new approach creates three new meshes of the original model. Using this approach the computational power is optimized and a real time feedback can be achieved during all bone manipulations. During the movement of the mesh cutting, a novel friction profile is predefined in the haptical system to simulate the force feedback feel of different densities in the bone

Controlling the Error on Target Motion through Real-time Mesh Adaptation: Applications to Deep Brain Stimulation

We present an error-controlled mesh refinement procedure for needle insertion simulation and apply it to the simulation of electrode implantation for deep brain stimulation, including brain shift. Our approach enables to control the error in the computation of the displacement and stress fields around the needle tip and needle shaft by suitably refining the mesh, whilst maintaining a coarser mesh in other parts of the domain. We demonstrate through academic and practical examples that our approach increases the accuracy of the displacement and stress fields around the needle without increasing the computational expense. This enables real-time simulations. The proposed methodology has direct implications to increase the accuracy and control the computational expense of the simulation of percutaneous procedures such as biopsy, brachytherapy, regional anesthesia, or cryotherapy and can be essential to the development of robotic guidance.Comment: 21 pages, 14 figure

Analytical modeling of spindle-tool dynamics on machine tools using Timoshenko beam model and receptance coupling for the prediction of tool point FRF

Regenerative chatter is a well-known machining problem that results in unstable cutting process, poor surface quality and reduced material removal rate. This undesired self-excited vibration problem is one of the main obstacles in utilizing the total capacity of a machine tool in production. In order to obtain a chatter-free process on a machining center, stability diagrams can be used. Numerically or analytically, constructing the stability lobe diagram for a certain spindleholdertool combination implies knowing the system dynamics at the tool tip; i.e., the point frequency response function (FRF) that relates the dynamic displacement and force at that point. This study presents an analytical method that uses Timoshenko beam theory for calculating the tool point FRF of a given combination by using the receptance coupling and structural modication methods. The objective of the study is two fold. Firstly, it is aimed to develop a reliable mathematical model to predict tool point FRF in a machining center so that chatter stability analysis can be done, and secondly to make use of this model in studying the effects of individual bearing and contact parameters on tool point FRF so that better approaches can be found in predicting contact parameters from experimental measurements. The model can also be used to study the effects of several spindle, holder and tool parameters on chatter stability. In this paper, the mathematical model, as well as the details of obtaining the system component (spindle, holder and tool) dynamics and coupling them to obtain the tool point FRF are given. The model suggested is veried by comparing the natural frequencies of an example spindleholdertool assembly obtained from the model with those obtained from a nite element software

Analytical models for high performance milling. Part I: cutting forces, structural deformations and tolerance integrity

Milling is one of the most common manufacturing processes in industry. Despite recent advances in machining technology, productivity in milling is usually reduced due to the process limitations such as high cutting forces and stability. If milling conditions are not selected properly, the process may result in violations of machine limitations and part quality, or reduced productivity. The usual practice in machining operations is to use experience-based selection of cutting parameters which may not yield optimum conditions. In this two-part paper, milling force, part and tool deection, form error and stability models are presented. These methods can be used to check the process constraints as well as optimal selection of the cutting conditions for high performance milling. The use of the models in optimizing the process variables such as feed, depth of cut and spindle speed are demonstrated by simulations and experiments

Machining stability and machine tool dynamics

Machining is a common manufacturing process in industry due to its high flexibility and ability to produce parts which excellent quality. The productivity and quality in machining operations can be limited by several process constraints one of which is the self-excited chatter vibrations. Under certain conditions, the process may become unstable yielding oscillations with high amplitudes which result in poor surface finish and damage to the cutting tool, part and the machine tool itself. Stability analysis of the dynamic cutting process can be used to determine chatter-free machining conditions with high material removal rate. Since chatter is a result of the dynamic interactions between the process and the structures both cutting and machine tool dynamics are important elements of the stability analysis. In this paper, methods developed for stability analysis of cutting processes and machine tool dynamics will be presented. Implications of these methods in the selection of process parameters and machine tool design will be also discussed with example applications