Virtual reality surgery simulation: A survey on patient specific solution

For surgeons, the precise anatomy structure and its dynamics are important in the surgery interaction, which is critical for generating the immersive experience in VR based surgical training applications. Presently, a normal therapeutic scheme might not be able to be straightforwardly applied to a specific patient, because the diagnostic results are based on averages, which result in a rough solution. Patient Specific Modeling (PSM), using patient-specific medical image data (e.g. CT, MRI, or Ultrasound), could deliver a computational anatomical model. It provides the potential for surgeons to practice the operation procedures for a particular patient, which will improve the accuracy of diagnosis and treatment, thus enhance the prophetic ability of VR simulation framework and raise the patient care. This paper presents a general review based on existing literature of patient specific surgical simulation on data acquisition, medical image segmentation, computational mesh generation, and soft tissue real time simulation

BioPARR:A software system for estimating the rupture potential index for abdominal aortic aneurysms

An abdominal aortic aneurysm (AAA) is a permanent and irreversible dilation of the lower region of the aorta. It is a symptomless condition that, if left untreated, can expand until rupture. Despite ongoing efforts, an efficient tool for accurate estimation of AAA rupture risk is still not available. Furthermore, a lack of standardisation across current approaches and specific obstacles within computational workflows limit the translation of existing methods to the clinic. This paper presents BioPARR (Biomechanics based Prediction of Aneurysm Rupture Risk), a software system to facilitate the analysis of AAA using a finite element analysis based approach. Except semi-automatic segmentation of the AAA and intraluminal thrombus (ILT) from medical images, the entire analysis is performed automatically. The system is modular and easily expandable, allows the extraction of information from images of different modalities (e.g. CT and MRI) and the simulation of different modelling scenarios (e.g. with/without thrombus). The software uses contemporary methods that eliminate the need for patient-specific material properties, overcoming perhaps the key limitation to all previous patient-specific analysis methods. The software system is robust, free, and will allow researchers to perform comparative evaluation of AAA using a standardised approach. We report preliminary data from 48 cases

An Introductory Module in Medical Image Segmentation for BME Students

To support recent trends toward the use of patient-specific anatomical models from medical imaging data, we present a learning module for use in the undergraduate BME curriculum that introduces image segmentation, the process of partitioning digital images to isolate specific anatomical features. Five commercially available software packages were evaluated based on their perceived learning curve, ease of use, tools for segmentation and rendering, special tools, and cost: ITK-SNAP, 3D Slicer, OsiriX, Mimics, and Amira. After selecting the package best suited for a stand-alone course module on medical image segmentation, instructional materials were developed that included a general introduction to imaging, a tutorial guiding students through a step-by-step process to extract a skull from a provided stack of CT images, and a culminating assignment where students extract a different body part from clinical imaging data. This module was implemented in three different engineering courses, impacting more than 150 students, and student achievement of learning goals was assessed. ITK-SNAP was identified as the best software package for this application because it is free, easiest to learn, and includes a powerful, semi-automated segmentation tool. After completing the developed module based on ITK-SNAP, all students attained sufficient mastery of the image segmentation process to independently apply the technique to extract a new body part from clinical imaging data. This stand-alone module provides a low-cost, flexible way to bring the clinical and industry trends combining medical image segmentation, CAD, and 3D printing into the undergraduate BME curriculum

Image-based biomechanical models of the musculoskeletal system

Finite element modeling is a precious tool for the investigation of the biomechanics of the musculoskeletal system. A key element for the development of anatomically accurate, state-of-the art finite element models is medical imaging. Indeed, the workflow for the generation of a finite element model includes steps which require the availability of medical images of the subject of interest: segmentation, which is the assignment of each voxel of the images to a specific material such as bone and cartilage, allowing for a three-dimensional reconstruction of the anatomy; meshing, which is the creation of the computational mesh necessary for the approximation of the equations describing the physics of the problem; assignment of the material properties to the various parts of the model, which can be estimated for example from quantitative computed tomography for the bone tissue and with other techniques (elastography, T1rho, and T2 mapping from magnetic resonance imaging) for soft tissues. This paper presents a brief overview of the techniques used for image segmentation, meshing, and assessing the mechanical properties of biological tissues, with focus on finite element models of the musculoskeletal system. Both consolidated methods and recent advances such as those based on artificial intelligence are described

Constructing a Computer Model of the Human Eye Based on Tissue Slice Images

Computer simulation of the biomechanical and biological heat transfer in ophthalmology greatly relies on having a reliable computer model of the human eye. This paper proposes a novel method on the construction of a geometric model of the human eye based on tissue slice images. Slice images were obtained from an in vitro Chinese human eye through an embryo specimen processing methods. A level set algorithm was used to extract contour points of eye tissues while a principle component analysis was used to detect the central axis of the image. The two-dimensional contour was rotated around the central axis to obtain a three-dimensional model of the human eye. Refined geometric models of the cornea, sclera, iris, lens, vitreous, and other eye tissues were then constructed with their position and ratio relationships kept intact. A preliminary study of eye tissue deformation in eye virtual surgery was simulated by a mass-spring model based on the computer models developed

Multi-Material Mesh Representation of Anatomical Structures for Deep Brain Stimulation Planning

The Dual Contouring algorithm (DC) is a grid-based process used to generate surface meshes from volumetric data. However, DC is unable to guarantee 2-manifold and watertight meshes due to the fact that it produces only one vertex for each grid cube. We present a modified Dual Contouring algorithm that is capable of overcoming this limitation. The proposed method decomposes an ambiguous grid cube into a set of tetrahedral cells and uses novel polygon generation rules that produce 2-manifold and watertight surface meshes with good-quality triangles. These meshes, being watertight and 2-manifold, are geometrically correct, and therefore can be used to initialize tetrahedral meshes. The 2-manifold DC method has been extended into the multi-material domain. Due to its multi-material nature, multi-material surface meshes will contain non-manifold elements along material interfaces or shared boundaries. The proposed multi-material DC algorithm can (1) generate multi-material surface meshes where each material sub-mesh is a 2-manifold and watertight mesh, (2) preserve the non-manifold elements along the material interfaces, and (3) ensure that the material interface or shared boundary between materials is consistent. The proposed method is used to generate multi-material surface meshes of deep brain anatomical structures from a digital atlas of the basal ganglia and thalamus. Although deep brain anatomical structures can be labeled as functionally separate, they are in fact continuous tracts of soft tissue in close proximity to each other. The multi-material meshes generated by the proposed DC algorithm can accurately represent the closely-packed deep brain structures as a single mesh consisting of multiple material sub-meshes. Each sub-mesh represents a distinct functional structure of the brain. Printed and/or digital atlases are important tools for medical research and surgical intervention. While these atlases can provide guidance in identifying anatomical structures, they do not take into account the wide variations in the shape and size of anatomical structures that occur from patient to patient. Accurate, patient-specific representations are especially important for surgical interventions like deep brain stimulation, where even small inaccuracies can result in dangerous complications. The last part of this research effort extends the discrete deformable 2-simplex mesh into the multi-material domain where geometry-based internal forces and image-based external forces are used in the deformation process. This multi-material deformable framework is used to segment anatomical structures of the deep brain region from Magnetic Resonance (MR) data