Virtual reality training and assessment in laparoscopic rectum surgery

Background: Virtual-reality (VR) based simulation techniques offer an efficient and low cost alternative to conventional surgery training. This article describes a VR training and assessment system in laparoscopic rectum surgery. Methods: To give a realistic visual performance of interaction between membrane tissue and surgery tools, a generalized cylinder based collision detection and a multi-layer mass-spring model are presented. A dynamic assessment model is also designed for hierarchy training evaluation. Results: With this simulator, trainees can operate on the virtual rectum with both visual and haptic sensation feedback simultaneously. The system also offers surgeons instructions in real time when improper manipulation happens. The simulator has been tested and evaluated by ten subjects. Conclusions: This prototype system has been verified by colorectal surgeons through a pilot study. They believe the visual performance and the tactile feedback are realistic. It exhibits the potential to effectively improve the surgical skills of trainee surgeons and significantly shorten their learning curve. © 2014 John Wiley & Sons, Ltd

Haptic Rendering Based on RBF Approximation from Dynamically Updated Data

In this paper, an extension of our previous research focused on haptic rendering based on interpolation from precomputed data is presented. The technique employs the radial-basis function (RBF) interpolation to achieve the accuracy of the force response approximation, however, it assumes that the data used by the interpolation method are generated on-the-fly during the haptic interaction. The issue caused by updating the RBF coefficients during the interaction is analyzed and a force-response smoothing strategy is proposed

Realistic tool-tissue interaction models for surgical simulation and planning

Surgical simulators present a safe and potentially effective method for surgical training, and can also be used in pre- and intra-operative surgical planning. Realistic modeling of medical interventions involving tool-tissue interactions has been considered to be a key requirement in the development of high-fidelity simulators and planners. The soft-tissue constitutive laws, organ geometry and boundary conditions imposed by the connective tissues surrounding the organ, and the shape of the surgical tool interacting with the organ are some of the factors that govern the accuracy of medical intervention planning.\ud \ud This thesis is divided into three parts. First, we compare the accuracy of linear and nonlinear constitutive laws for tissue. An important consequence of nonlinear models is the Poynting effect, in which shearing of tissue results in normal force; this effect is not seen in a linear elastic model. The magnitude of the normal force for myocardial tissue is shown to be larger than the human contact force discrimination threshold. Further, in order to investigate and quantify the role of the Poynting effect on material discrimination, we perform a multidimensional scaling study. Second, we consider the effects of organ geometry and boundary constraints in needle path planning. Using medical images and tissue mechanical properties, we develop a model of the prostate and surrounding organs. We show that, for needle procedures such as biopsy or brachytherapy, organ geometry and boundary constraints have more impact on target motion than tissue material parameters. Finally, we investigate the effects surgical tool shape on the accuracy of medical intervention planning. We consider the specific case of robotic needle steering, in which asymmetry of a bevel-tip needle results in the needle naturally bending when it is inserted into soft tissue. We present an analytical and finite element (FE) model for the loads developed at the bevel tip during needle-tissue interaction. The analytical model explains trends observed in the experiments. We incorporated physical parameters (rupture toughness and nonlinear material elasticity) into the FE model that included both contact and cohesive zone models to simulate tissue cleavage. The model shows that the tip forces are sensitive to the rupture toughness. In order to model the mechanics of deflection of the needle, we use an energy-based formulation that incorporates tissue-specific parameters such as rupture toughness, nonlinear material elasticity, and interaction stiffness, and needle geometric and material properties. Simulation results follow similar trends (deflection and radius of curvature) to those observed in macroscopic experimental studies of a robot-driven needle interacting with gels

Real-time simulation of soft tissue deformation for surgical simulation

Surgical simulation plays an important role in the training, planning and evaluation of many surgical procedures. It requires realistic and real-time simulation of soft tissue deformation under interaction with surgical tools. However, it is challenging to satisfy both of these conflicting requirements. On one hand, biological soft tissues are complex in terms of material compositions, structural formations, and mechanical behaviours, resulting in nonlinear deformation characteristics under an external load. Due to the involvement of both material and geometric nonlinearities, the use of nonlinear elasticity causes a highly expensive computational load, leading to the difficulty to achieve the real-time computational performance required by surgical simulation. On the other hand, in order to satisfy the real-time computational requirement, most of the existing methods are mainly based on linear elasticity under the assumptions of small deformation and homogeneity to describe deformation of soft tissues. Such simplifications allow reduced runtime computation; however, they are inadequate for modelling nonlinear material properties such as anisotropy, heterogeneity and large deformation of soft tissues. In general, the two conflicting requirements of surgical simulation raise immense complexity in modelling of soft tissue deformation. This thesis focuses on establishment of new methodologies for modelling of soft tissue deformation for surgical simulation. Due to geometric and material nonlinearities in soft tissue deformation, the existing methods have only limited capabilities in achieving nonlinear soft tissue deformation in real-time. In this thesis, the main focus is devoted to the real-time and realistic modelling of nonlinear soft tissue deformation for surgical simulation. New methodologies, namely new ChainMail algorithms, energy propagation method, and energy balance method, are proposed to address soft tissue deformation. Results demonstrate that the proposed methods can simulate the typical soft tissue mechanical properties, accommodate isotropic and homogeneous, anisotropic and heterogeneous materials, handle incompressibility and viscoelastic behaviours, conserve system energy, and achieve realistic, real-time and stable deformation. In the future, it is projected to extend the proposed methodologies to handle surgical operations, such as cutting, joining and suturing, for topology changes occurred in surgical simulation

Haptic feedback from human tissues of various stiffness and homogeneity

This work presents methods for haptic modelling of soft and hard tissue with varying stiffness. The model provides visualization of deformation and calculates force feedback during simulated epidural needle insertion. A spring-mass-damper (SMD) network is configured from magnetic resonance image (MRI) slices of patient’s lumbar region to represent varying stiffness throughout tissue structure. Reaction force is calculated from the SMD network and a haptic device is configured to produce a needle insertion simulation. The user can feel the changing forces as the needle is inserted through tissue layers and ligaments. Methods for calculating the force feedback at various depths of needle insertion are presented. Voxelization is used to fill ligament surface meshes with spring mass damper assemblies for simulated needle insertion into soft and hard tissues. Modelled vertebrae cannot be pierced by the needle. Graphs were produced during simulated needle insertions to compare the applied force to haptic reaction force. Preliminary saline pressure measurements during Tuohy epidural needle insertion are also used as a basis for forces generated in the simulation

Point Primitives Based Virtual Surgery System

In order to achieve a high degree of visual realism in surgery simulation, we present a virtual surgery system framework, which is based on point primitives for the virtual surgery scene rendering and the biomechanical calculation of the soft tissue. To embody the superiority of this framework, two virtual surgery systems based on point primitives we developed are exhibited in this paper. Six critical functional modules were selected as representative of basic and advanced virtual surgery skill. These modules were: 1) point-based texture mapping; 2) deformation simulation; 3) cutting simulation; 4) tearing simulation; 5) dynamic texture mapping; and 6) 3-D display. These modules were elaborated by including working principle, execution process, and the performance of the algorithm. The experimental results have shown that point primitives-based virtual surgery systems obtained higher performance in terms of computational efficiency and rendering effect than traditional meshes-based virtual surgery system