Deformable Object Modelling Through Cellular Neural Network

This paper presents a new methodology for thedeformable object modelling by drawing an analogybetween cellular neural network (CNN) and elasticdeformation. The potential energy stored in an elasticbody as a result of a deformation caused by an externalforce is propagated among mass points by the non-linearCNN activity. An improved autonomous CNN model isdeveloped for propagating the energy generated by theexternal force on the object surface in the naturalmanner of heat conduction. A heat flux based method ispresented to derive the internal forces from the potentialenergy distribution established by the CNN. Theproposed methodology models non-linear materials withnon-linear CNN rather than geometric non-linearity inthe most existing deformation methods. It can not onlydeal with large-range deformations due to the localconnectivity of cells and the CNN dynamics, but it canalso accommodate both isotropic and anisotropicmaterials by simply modifying conductivity constants.Examples are presented tThis paper presents a new methodology for the deformable object modelling by drawing an analogy between cellular neural network (CNN) and elastic deformation. The potential energy stored in an elastic body as a result of a deformation caused by an external force is propagated among mass points by the non-linear CNN activity. An improved autonomous CNN model is developed for propagating the energy generated by the external force on the object surface in the natural manner of heat conduction. A heat flux based method is presented to derive the internal forces from the potential energy distribution established by the CNN. The proposed methodology models non-linear materials with non-linear CNN rather than geometric non-linearity in the most existing deformation methods. It can not only deal with large-range deformations due to the local connectivity of cells and the CNN dynamics, but it can also accommodate both isotropic and anisotropic materials by simply modifying conductivity constants. Examples are presented to demonstrate the efficacy of the proposed methodology

Soft volume simulation using a deformable surface model

The aim of the research is to contribute to the modelling of deformable objects, such as soft tissues in medical simulation. Interactive simulation for medical training is a concept undergoing rapid growth as the underlying technologies support the increasingly more realstic and functional training environments. The prominent issues in the deployment of such environments centre on a fine balance between the accuracy of the deformable model and real-time interactivity. Acknowledging the importance of interacting with non-rigid materials such as the palpation of a breast for breast assessment, this thesis has explored the physics-based modelling techniques for both volume and surface approach. This thesis identified that the surface approach based on the mass spring system (MSS) has the benefits of rapid prototyping, reduced mesh complexity, computational efficiency and the support for large material deformation compared to the continuum approach. However, accuracy relative to real material properties is often over looked in the configuration of the resulting model. This thesis has investigated the potential and the feasibility of surface modelling for simulating soft objects regardless of the design of the mesh topology and the non-existence of internal volume discretisation. The assumptions of the material parameters such as elasticity, homogeneity and incompressibility allow a reduced set of material values to be implemented in order to establish the association with the surface configuration. A framework for a deformable surface model was generated in accordance with the issues of the estimation of properties and volume behaviour corresponding to the material parameters. The novel extension to the surface MSS enables the tensile properties of the material to be integrated into an enhanced configuration despite its lack of volume information. The benefits of the reduced complexity of a surface model are now correlated with the improved accuracy in the estimation of properties and volume behaviour. Despite the irregularity of the underlying mesh topology and the absence of volume, the model reflected the original material values and preserved volume with minimal deviations. Global deformation effect which is essential to emulate the run time behaviour of a real soft material upon interaction, such as the palpation of a generic breast, was also demonstrated, thus indicating the potential of this novel technique in the application of soft tissue simulation

GPU Implementation of extended total Lagrangian explicit (gpuXTLED) for Surgical Incision Application

An extended total Lagrangian explicit dynamic (XTLED) is presented as a potential numerical method for simulating interactive or physics-based surgical incisions of soft tissues. The simulation of surgical incision is vital to the integrity of virtual reality simulators that are used for immersive surgical training. However, most existing numerical methods either compromise on computational speed for accuracy or vice versa. This is due to the challenge of modelling nonlinear behaviour of soft tissues, incorporating incision and subsequently updating topology to account for the incision. To tackle these challenges, XTLED method which combines the extended finite element method (XFEM) using total Lagrangian formulation with explicit time integration method was developed. The algorithm was developed and deformations of 3D geometries under tension, were simulated. An attempt was made to validate the XTLED method using silicon samples with different incision configuration and a comparison was made between XTLED and FEM. Results show that XTLED could potentially be used to simulate interactive soft tissue incision. However, further quantitative verification and validation are required. In addition, numerical analyses conducted show that solutions may not be obtainable due to simulation errors. However, it is unclear whether these errors are inherent in the XTLED method or the algorithm created for the XTLED method in this thesis

Real-time hybrid cutting with dynamic fluid visualization for virtual surgery

It is widely accepted that a reform in medical teaching must be made to meet today's high volume training requirements. Virtual simulation offers a potential method of providing such trainings and some current medical training simulations integrate haptic and visual feedback to enhance procedure learning. The purpose of this project is to explore the capability of Virtual Reality (VR) technology to develop a training simulator for surgical cutting and bleeding in a general surgery

VISIO-HAPTIC DEFORMABLE MODEL FOR HAPTIC DOMINANT PALPATION SIMULATOR

Vision and haptic are two most important modalities in a medical simulation. While visual cues assist one to see his actions when performing a medical procedure, haptic cues enable feeling the object being manipulated during the interaction. Despite their importance in a computer simulation, the combination of both modalities has not been adequately assessed, especially that in a haptic dominant environment. Thus, resulting in poor emphasis in resource allocation management in terms of effort spent in rendering the two modalities for simulators with realistic real-time interactions. Addressing this problem requires an investigation on whether a single modality (haptic) or a combination of both visual and haptic could be better for learning skills in a haptic dominant environment such as in a palpation simulator. However, before such an investigation could take place one main technical implementation issue in visio-haptic rendering needs to be addresse

Efficient techniques for soft tissue modeling and simulation

Performing realistic deformation simulations in real time is a challenging problem in computer graphics. Among numerous proposed methods including Finite Element Modeling and ChainMail, we have implemented a mass spring system because of its acceptable accuracy and speed. Mass spring systems have, however, some drawbacks such as, the determination of simulation coefficients with their iterative nature. Given the correct parameters, mass spring systems can accurately simulate tissue deformations but choosing parameters that capture nonlinear deformation behavior is extremely difficult. Since most of the applications require a large number of elements i. e. points and springs in the modeling process it is extremely difficult to reach realtime performance with an iterative method. We have developed a new parameter identification method based on neural networks. The structure of the mass spring system is modified and neural networks are integrated into this structure. The input space consists of changes in spring lengths and velocities while a "teacher" signal is chosen as the total spring force, which is expressed in terms of positional changes and applied external forces. Neural networks are trained to learn nonlinear tissue characteristics represented by spring stiffness and damping in the mass spring algorithm. The learning algorithm is further enhanced by an adaptive learning rate, developed particularly for mass spring systems. In order to avoid the iterative approach in deformation simulations we have developed a new deformation algorithm. This algorithm defines the relationships between points and springs and specifies a set of rules on spring movements and deformations. These rules result in a deformation surface, which is called the search space. The deformation algorithm then finds the deformed points and springs in the search space with the help of the defined rules. The algorithm also sets rules on each element i. e. triangle or tetrahedron so that they do not pass through each other. The new algorithm is considerably faster than the original mass spring systems algorithm and provides an opportunity for various deformation applications. We have used mass spring systems and the developed method in the simulation of craniofacial surgery. For this purpose, a patient-specific head model was generated from MRI medical data by applying medical image processing tools such as, filtering, the segmentation and polygonal representation of such model is obtained using a surface generation algorithm. Prism volume elements are generated between the skin and bone surfaces so that different tissue layers are included to the head model. Both methods produce plausible results verified by surgeons

Soft volume simulation using a deformable surface model

The aim of the research is to contribute to the modelling of deformable objects, such as soft tissues in medical simulation. Interactive simulation for medical training is a concept undergoing rapid growth as the underlying technologies support the increasingly more realstic and functional training environments. The prominent issues in the deployment of such environments centre on a fine balance between the accuracy of the deformable model and real-time interactivity. Acknowledging the importance of interacting with non-rigid materials such as the palpation of a breast for breast assessment, this thesis has explored the physics-based modelling techniques for both volume and surface approach. This thesis identified that the surface approach based on the mass spring system (MSS) has the benefits of rapid prototyping, reduced mesh complexity, computational efficiency and the support for large material deformation compared to the continuum approach. However, accuracy relative to real material properties is often over looked in the configuration of the resulting model. This thesis has investigated the potential and the feasibility of surface modelling for simulating soft objects regardless of the design of the mesh topology and the non-existence of internal volume discretisation. The assumptions of the material parameters such as elasticity, homogeneity and incompressibility allow a reduced set of material values to be implemented in order to establish the association with the surface configuration. A framework for a deformable surface model was generated in accordance with the issues of the estimation of properties and volume behaviour corresponding to the material parameters. The novel extension to the surface MSS enables the tensile properties of the material to be integrated into an enhanced configuration despite its lack of volume information. The benefits of the reduced complexity of a surface model are now correlated with the improved accuracy in the estimation of properties and volume behaviour. Despite the irregularity of the underlying mesh topology and the absence of volume, the model reflected the original material values and preserved volume with minimal deviations. Global deformation effect which is essential to emulate the run time behaviour of a real soft material upon interaction, such as the palpation of a generic breast, was also demonstrated, thus indicating the potential of this novel technique in the application of soft tissue simulation.EThOS - Electronic Theses Online ServiceUniversiti Malaysia Sarawak (UMS)Malaysia. Jabatan Perkhidmatan Awam (JPA)Malaysia. Kementerian Pengajian Tinggi (KPT)GBUnited Kingdo

Real-time simulation of surgery by Proper Generalized Decomposition techniques

La simulación quirúrgica por ordenador en tiempo real se ha convertido en una alternativa muy atractiva a los simuladores quirúrgicos tradicionales. Entre otras ventajas, los simuladores por ordenador consiguen ahorros importantes de tiempo y de costes de mantenimiento, y permiten que los estudiantes practiquen sus habilidades quirúrgicas en un entorno seguro tantas veces como sea necesario. Sin embargo, a pesar de las capacidades de los ordenadores actuales, la cirugía computacional sigue siendo un campo de investigación exigente. Uno de sus mayores retos es la alta velocidad a la que se tienen que resolver complejos problemas de mecánica de medios continuos para que los interfaces hápticos puedan proporcionar un sentido del tacto realista (en general, se necesitan velocidades de respuesta de 500-1000 Hz).Esta tesis presenta algunos métodos numéricos novedosos para la simulación interactiva de dos procedimientos quirúrgicos habituales: el corte y el rasgado (o desgarro) de tejidos blandos. El marco común de los métodos presentados es el uso de la Descomposición Propia Generalizada (PGD en inglés) para la generación de vademécums computacionales, esto es, metasoluciones generales de problemas paramétricos de altas dimensiones que se pueden evaluar a velocidades de respuesta compatibles con entornos hápticos.En el caso del corte, los vademécums computacionales se utilizan de forma conjunta con técnicas basadas en XFEM, mientras que la carga de cálculo se distribuye entre una etapa off-line (previa a la ejecución interactiva) y otra on-line (en tiempo de ejecución). Durante la fase off-line, para el órgano en cuestión se precalculan tanto un vademécum computacional para cualquier posición de una carga, como los desplazamientos producidos por un conjunto de cortes. Así, durante la etapa on-line, los resultados precalculados se combinan de la forma más adecuada para obtener en tiempo real la respuesta a las acciones dirigidas por el usuario. En cuanto al rasgado, a partir de una ecuación paramétrica basada en mecánica del daño continuo, se obtiene un vademécum computacional. La complejidad del modelo se reduce mediante técnicas de Descomposición Ortogonal Propia (POD en inglés), y el vademécum se incorpora a una formulación incremental explícita que se puede interpretar como una especie de integrador temporal.A modo de ejemplo, el método para el corte se aplica a la simulación de un procedimiento quirúrgico refractivo de la córnea conocido como queratotomía radial, mientras que el método para el rasgado se centra en la simulación de la colecistectomía laparoscópica (la extirpación de la vesícula biliar mediante laparoscopia). En ambos casos, los métodos implementados ofrecen excelentes resultados en términos de velocidades de respuesta y producen simulaciones muy realistas desde los puntos de vista visual y háptico.The real-time computer-based simulation of surgery has proven to be an appealing alternative to traditional surgical simulators. Amongst other advantages, computer-based simulators provide considerable savings on time and maintenance costs, and allow trainees to practice their surgical skills in a safe environment as often as necessary. However, in spite of the current computer capabilities, computational surgery continues to be a challenging field of research. One of its major issues is the high speed at which complex problems in continuum mechanics have to be solved so that haptic interfaces can render a realistic sense of touch (generally, feedback rates of 500–1 000 Hz are required). This thesis introduces some novel numerical methods for the interactive simulation of two usual surgical procedures: cutting and tearing of soft tissues. The common framework of the presented methods is the use of the Proper Generalised Decomposition (PGD) for the generation of computational vademecums, i. e. general meta-solutions of parametric high-dimensional problems that can be evaluated at feedback rates compatible with haptic environments. In the case of cutting, computational vademecums are used jointly with XFEM-based techniques, and the computing workload is distributed into an off-line and an on-line stage. During the off-line stage, both a computational vademecum for any position of a load and the displacements produced by a set of cuts are pre-computed for the organ under consideration. Thus, during the on-line stage, the pre-computed results are properly combined together to obtain in real-time the response to the actions driven by the user. Concerning tearing, a computational vademecum is obtained from a parametric equation based on continuum damage mechanics. The complexity of the model is reduced by Proper Orthogonal Decomposition (POD) techniques, and the vademecum is incorporated into an explicit incremental formulation that can be viewed as a sort of time integrator. By way of example, the cutting method is applied to the simulation of a corneal refractive surgical procedure known as radial keratotomy, whereas the tearing method focuses on the simulation of laparoscopic cholecystectomy (i. e. the removal of the gallbladder). In both cases, the implemented methods offer excellent performances in terms of feedback rates, and produce.<br /

Virtual environments for medical training : graphic and haptic simulation of tool-tissue interactions

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Mechanical Engineering, 2004.Includes bibliographical references (leaves 122-127).For more than 2,500 years, surgical teaching has been based on the so called "see one, do one, teach one" paradigm, in which the surgical trainee learns by operating on patients under close supervision of peers and superiors. However, higher demands on the quality of patient care and rising malpractice costs have made it increasingly risky to train on patients. Minimally invasive surgery, in particular, has made it more difficult for an instructor to demonstrate the required manual skills. It has been recognized that, similar to flight simulators for pilots, virtual reality (VR) based surgical simulators promise a safer and more comprehensive way to train manual skills of medical personnel in general and surgeons in particular. One of the major challenges in the development of VR-based surgical trainers is the real-time and realistic simulation of interactions between surgical instruments and biological tissues. It involves multi-disciplinary research areas including soft tissue mechanical behavior, tool-tissue contact mechanics, computer haptics, computer graphics and robotics integrated into VR-based training systems. The research described in this thesis addresses many of the problems of simulating tool-tissue interactions in medical virtual environments. First, two kinds of physically based real time soft tissue models - the local deformation and the hybrid deformation model - were developed to compute interaction forces and visual deformation fields that provide real-time feed back to the user. Second, a system to measure in vivo mechanical properties of soft tissues was designed, and eleven sets of animal experiments were performed to measure in vivo and in vitro biomechanical properties of porcine intra-abdominal organs. Viscoelastic tissue(cont.) parameters were then extracted by matching finite element model predictions with the empirical data. Finally, the tissue parameters were combined with geometric organ models segmented from the Visible Human Dataset and integrated into a minimally invasive surgical simulation system consisting of haptic interface devices inside a mannequin and a graphic display. This system was used to demonstrate deformation and cutting of the esophagus, where the user can haptically interact with the virtual soft tissues and see the corresponding organ deformation on the visual display at the same time.by Jung Kim.Ph.D