Physical and statistical shape modelling in craniomaxillofacial surgery: a personalised approach for outcome prediction

Orthognathic surgery involves repositioning of the jaw bones to restore face function and shape for patients who require an operation as a result of a syndrome, due to growth disturbances in childhood or after trauma. As part of the preoperative assessment, three-dimensional medical imaging and computer-assisted surgical planning help to improve outcomes, and save time and cost. Computer-assisted surgical planning involves visualisation and manipulation of the patient anatomy and can be used to aid objective diagnosis, patient communication, outcome evaluation, and surgical simulation. Despite the benefits, the adoption of three-dimensional tools has remained limited beyond specialised hospitals and traditional two-dimensional cephalometric analysis is still the gold standard. This thesis presents a multidisciplinary approach to innovative surgical simulation involving clinical patient data, medical image analysis, engineering principles, and state-of-the-art machine learning and computer vision algorithms. Two novel three-dimensional computational models were developed to overcome the limitations of current computer-assisted surgical planning tools. First, a physical modelling approach – based on a probabilistic finite element model – provided patient-specific simulations and, through training and validation, population-specific parameters. The probabilistic model was equally accurate compared to two commercial programs whilst giving additional information regarding uncertainties relating to the material properties and the mismatch in bone position between planning and surgery. Second, a statistical modelling approach was developed that presents a paradigm shift in its modelling formulation and use. Specifically, a 3D morphable model was constructed from 5,000 non-patient and orthognathic patient faces for fully-automated diagnosis and surgical planning. Contrary to traditional physical models that are limited to a finite number of tests, the statistical model employs machine learning algorithms to provide the surgeon with a goal-driven patient-specific surgical plan. The findings in this thesis provide markers for future translational research and may accelerate the adoption of the next generation surgical planning tools to further supplement the clinical decision-making process and ultimately to improve patients’ quality of life

Computer Assisted Planning in Cranio-Maxillofacial Surgery

In cranio-maxillofacial surgery physicians are often faced with the reconstruction of massively destroyed or radically resected tissue structures caused by trauma or tumours. Also corrections of dislocated bone fragments up to the complete modeling of facial regions in cases of complex congenital malformations are common tasks of plastic and reconstructive surgeons. With regard to the individual anatomy and physiology, such procedures have to be planned and executed thoroughly in order to achieve the best functional as well as an optimal aesthetic rehabilitation. On this account a computer assisted modeling, planning and simulation approach is presented that allows for preoperative assessment of different therapeutic strategies on basis of three-dimensional patient models. Bone structures can be mobilized and relocated under consideration of anatomical and functional constraints. The resulting facial appearance is simulated via finite-element methods on basis of a biomechanical tissue model, and visualized using high quality rendering techniques. Such an approach is not only important for preoperative mental preparation, but also for vivid patient information, documentation, quality assurance as well as for surgical education and training

PRELIMINARY FINDINGS OF A POTENZIATED PIEZOSURGERGICAL DEVICE AT THE RABBIT SKULL

The number of available ultrasonic osteotomes has remarkably increased. In vitro and in vivo studies have revealed differences between conventional osteotomes, such as rotating or sawing devices, and ultrasound-supported osteotomes (Piezosurgery®) regarding the micromorphology and roughness values of osteotomized bone surfaces. Objective: the present study compares the micro-morphologies and roughness values of osteotomized bone surfaces after the application of rotating and sawing devices, Piezosurgery Medical® and Piezosurgery Medical New Generation Powerful Handpiece. Methods: Fresh, standard-sized bony samples were taken from a rabbit skull using the following osteotomes: rotating and sawing devices, Piezosurgery Medical® and a Piezosurgery Medical New Generation Powerful Handpiece. The required duration of time for each osteotomy was recorded. Micromorphologies and roughness values to characterize the bone surfaces following the different osteotomy methods were described. The prepared surfaces were examined via light microscopy, environmental surface electron microscopy (ESEM), transmission electron microscopy (TEM), confocal laser scanning microscopy (CLSM) and atomic force microscopy. The selective cutting of mineralized tissues while preserving adjacent soft tissue (dura mater and nervous tissue) was studied. Bone necrosis of the osteotomy sites and the vitality of the osteocytes near the sectional plane were investigated, as well as the proportion of apoptosis or cell degeneration. Results and Conclusions: The potential positive effects on bone healing and reossification associated with different devices were evaluated and the comparative analysis among the different devices used was performed, in order to determine the best osteotomes to be employed during cranio-facial surgery

3D statistical shape analysis of the face in Apert syndrome

Timely diagnosis of craniofacial syndromes as well as adequate timing and choice of surgical technique are essential for proper care management. Statistical shape models and machine learning approaches are playing an increasing role in Medicine and have proven its usefulness. Frameworks that automate processes have become more popular. The use of 2D photographs for automated syndromic identification has shown its potential with the Face2Gene application. Yet, using 3D shape information without texture has not been studied in such depth. Moreover, the use of these models to understand shape change during growth and its applicability for surgical outcome measurements have not been analysed at length. This thesis presents a framework using state-of-the-art machine learning and computer vision algorithms to explore possibilities for automated syndrome identification based on shape information only. The purpose of this was to enhance understanding of the natural development of the Apert syndromic face and its abnormality as compared to a normative group. An additional method was used to objectify changes as result of facial bipartition distraction, a common surgical correction technique, providing information on the successfulness and on inadequacies in terms of facial normalisation. Growth curves were constructed to further quantify facial abnormalities in Apert syndrome over time along with 3D shape models for intuitive visualisation of the shape variations. Post-operative models were built and compared with age-matched normative data to understand where normalisation is coming short. The findings in this thesis provide markers for future translational research and may accelerate the adoption of the next generation diagnostics and surgical planning tools to further supplement the clinical decision-making process and ultimately to improve patients’ quality of life

Advanced Applications of Rapid Prototyping Technology in Modern Engineering

Rapid prototyping (RP) technology has been widely known and appreciated due to its flexible and customized manufacturing capabilities. The widely studied RP techniques include stereolithography apparatus (SLA), selective laser sintering (SLS), three-dimensional printing (3DP), fused deposition modeling (FDM), 3D plotting, solid ground curing (SGC), multiphase jet solidification (MJS), laminated object manufacturing (LOM). Different techniques are associated with different materials and/or processing principles and thus are devoted to specific applications. RP technology has no longer been only for prototype building rather has been extended for real industrial manufacturing solutions. Today, the RP technology has contributed to almost all engineering areas that include mechanical, materials, industrial, aerospace, electrical and most recently biomedical engineering. This book aims to present the advanced development of RP technologies in various engineering areas as the solutions to the real world engineering problems

Grid simulation services for the medical community

The first part of this paper presents a selection of medical simulation applications, including image reconstruction, near real-time registration for neuro-surgery, enhanced dose distribution calculation for radio-therapy, inhaled drug delivery prediction, plastic surgery planning and cardio-vascular system simulation. The latter two topics are discussed in some detail. In the second part, we show how such services can be made available to the clinical practitioner using Grid technology. We discuss the developments and experience made during the EU project GEMSS, which provides reliable, efficient, secure and lawful medical Grid services

Soft tissue modelling and facial movement simulation using the finite element method

This thesis presents a framework for soft tissue modelling, facial surgery simulation, and facial movement synthesis based on the volumetric finite element method. Assessment of facial appearance pre- and post-surgery is of major concern for both patients and clinicians. Pre-surgical planning is a prerequisite for successful surgical procedures and outcomes. Early computer-assisted facial models have been geometrically based. They are computationally efficient, but cannot give an accurate prediction for facial surgery simulation. Therefore, in this thesis, the emphasis is placed on physically-based methods, especially the finite element technique. To achieve realistic surgery simulation, soft tissue modelling is of crucial importance. Thus, in this thesis, considerable effort has been directed to develop constitutive equations for facial skeletal muscles. The skeletal muscle model subsequently developed is able to capture the complex mechanical properties of skeletal muscle, which are active, quasi-incompressible, fibre-reinforced and hyperelastic. In addition, to improve the characterisation of in-vivo muscle behaviour, a technique has been developed to visualise the internal fibre arrangement of skeletal muscle using the FEM-NURBS method, which is the combination of the finite element method and the non-uniform rational B-spline solid mathematical representation. Another principal contribution made in this thesis is the three-dimensional finite element facial model, which can be used for the simulations of facial surgery and facial movement. The procedure of one cranio-facial surgery is simulated by using this facial model and the numerical predictions show a good agreement with the patient post-surgical data. In addition, it would be very helpful to also simulate the facial movement and facial expressions. In this thesis, two facial expressions (smile and disgust) and the mouth opening are simulated to assess the post-surgical appearance and test the muscle-driven facial movement simulation method

Facial soft tissue segmentation

The importance of the face for socio-ecological interaction is the cause for a high demand on any surgical intervention on the facial musculo-skeletal system. Bones and soft-tissues are of major importance for any facial surgical treatment to guarantee an optimal, functional and aesthetical result. For this reason, surgeons want to pre-operatively plan, simulate and predict the outcome of the surgery allowing for shorter operation times and improved quality. Accurate simulation requires exact segmentation knowledge of the facial tissues. Thus semi-automatic segmentation techniques are required. This thesis proposes semi-automatic methods for segmentation of the facial soft-tissues, such as muscles, skin and fat, from CT and MRI datasets, using a Markov Random Fields (MRF) framework. Due to image noise, artifacts, weak edges and multiple objects of similar appearance in close proximity, it is difficult to segment the object of interest by using image information alone. Segmentations would leak at weak edges into neighboring structures that have a similar intensity profile. To overcome this problem, additional shape knowledge is incorporated in the energy function which can then be minimized using Graph-Cuts (GC). Incremental approaches by incorporating additional prior shape knowledge are presented. The proposed approaches are not object specific and can be applied to segment any class of objects be that anatomical or non-anatomical from medical or non-medical image datasets, whenever a statistical model is present. In the first approach a 3D mean shape template is used as shape prior, which is integrated into the MRF based energy function. Here, the shape knowledge is encoded into the data and the smoothness terms of the energy function that constrains the segmented parts to a reasonable shape. In the second approach, to improve handling of shape variations naturally found in the population, the fixed shape template is replaced by a more robust 3D statistical shape model based on Probabilistic Principal Component Analysis (PPCA). The advantages of using the Probabilistic PCA are that it allows reconstructing the optimal shape and computing the remaining variance of the statistical model from partial information. By using an iterative method, the statistical shape model is then refined using image based cues to get a better fitting of the statistical model to the patient's muscle anatomy. These image cues are based on the segmented muscle, edge information and intensity likelihood of the muscle. Here, a linear shape update mechanism is used to fit the statistical model to the image based cues. In the third approach, the shape refinement step is further improved by using a non-linear shape update mechanism where vertices of the 3D mesh of the statistical model incur the non-linear penalty depending on the remaining variability of the vertex. The non-linear shape update mechanism provides a more accurate shape update and helps in a finer shape fitting of the statistical model to the image based cues in areas where the shape variability is high. Finally, a unified approach is presented to segment the relevant facial muscles and the remaining facial soft-tissues (skin and fat). One soft-tissue layer is removed at a time such as the head and non-head regions followed by the skin. In the next step, bones are removed from the dataset, followed by the separation of the brain and non-brain regions as well as the removal of air cavities. Afterwards, facial fat is segmented using the standard Graph-Cuts approach. After separating the important anatomical structures, finally, a 3D fixed shape template mesh of the facial muscles is used to segment the relevant facial muscles. The proposed methods are tested on the challenging example of segmenting the masseter muscle. The datasets were noisy with almost all possessing mild to severe imaging artifacts such as high-density artifacts caused by e.g. dental fillings and dental implants. Qualitative and quantitative experimental results show that by incorporating prior shape knowledge leaking can be effectively constrained to obtain better segmentation results