The accuracy of three-dimensional prediction of soft tissue changes following the surgical correction of facial asymmetry: an innovative concept

The accuracy of three-dimensional (3D) predictions of soft tissue changes in the surgical correction of facial asymmetry was evaluated in this study. Preoperative (T1) and 6–12-month postoperative (T2) cone beam computed tomography scans of 13 patients were studied. All patients underwent surgical correction of facial asymmetry as part of a multidisciplinary treatment protocol. The magnitude of the surgical movement was measured; virtual surgery was performed on the preoperative scans using Maxilim software. The predicted soft tissue changes were compared to the actual postoperative appearance (T2). Mean (signed) distances and mean (absolute) distances between the predicted and actual 3D surface meshes for each region were calculated. The one-sample t-test was applied to test the alternative hypothesis that the mean absolute distances had a value of <2.0 mm. A novel directional analysis was applied to analyse the accuracy of the prediction of soft tissue changes. The results showed that the distances between the predicted and actual postoperative soft tissue changes were less than 2.0 mm in all regions. The predicted facial morphology was narrower than the actual surgical changes in the cheek regions. 3D soft tissue prediction using Maxilim software in patients undergoing the correction of facial asymmetry is clinically acceptable

Three-dimensional virtual-reality surgical planning and soft-tissue prediction for orthognathic surgery

Complex maxillofacial malformations continue to present challenges in analysis and correction beyond modern technology. The purpose of this paper is to present a virtual-reality workbench for surgeons to perform virtual orthognathic surgical planning and soft-tissue prediction in three dimensions. A resulting surgical planning system, i.e., three-dimensional virtual-reality surgical-planning and soft-tissue prediction for orthognathic surgery, consists of four major stages: computed tomography (CT) data post-processing and reconstruction, three-dimensional (3-D) color facial soft-tissue model generation, virtual surgical planning and simulation, soft-tissue-change preoperative prediction. The surgical planning and simulation are based on a 3-D CT reconstructed bone model, whereas the soft-tissue prediction is based on color texture-mapped and individualized facial soft-tissue model. Our approach is able to provide a quantitative osteotomy-simulated bone model and prediction of postoperative appearance with photorealistic quality. The prediction appearance can be visualized from any arbitrary viewing point using a low-cost personal-computer-based system. This cost-effective solution can be easily adopted in any hospital for daily use.published_or_final_versio

Robotic simulators for tissue examination training with multimodal sensory feedback

Tissue examination by hand remains an essential technique in clinical practice. The effective application depends on skills in sensorimotor coordination, mainly involving haptic, visual, and auditory feedback. The skills clinicians have to learn can be as subtle as regulating finger pressure with breathing, choosing palpation action, monitoring involuntary facial and vocal expressions in response to palpation, and using pain expressions both as a source of information and as a constraint on physical examination. Patient simulators can provide a safe learning platform to novice physicians before trying real patients. This paper reviews state-of-the-art medical simulators for the training for the first time with a consideration of providing multimodal feedback to learn as many manual examination techniques as possible. The study summarizes current advances in tissue examination training devices simulating different medical conditions and providing different types of feedback modalities. Opportunities with the development of pain expression, tissue modeling, actuation, and sensing are also analyzed to support the future design of effective tissue examination simulators

A physically based trunk soft tissue modeling for scoliosis surgery planning systems

One of the major concerns of scoliotic patients undergoing spinal correction surgery is the trunk's external appearance after the surgery. This paper presents a novel incremental approach for simulating postoperative trunk shape in scoliosis surgery. Preoperative and postoperative trunk shapes data were obtained using three-dimensional medical imaging techniques for seven patients with adolescent idiopathic scoliosis. Results of qualitative and quantitative evaluations, based on the comparison of the simulated and actual postoperative trunk surfaces, showed an adequate accuracy of the method. Our approach provides a candidate simulation tool to be used in a clinical environment for the surgery planning process.IRSC / CIH

Detailing patient specific modelling to aid clinical decision-making

The anatomy of the craniofacial skeleton has been described through the aid of dissection identifying hard and soft tissue structures. Although the macro and microscopic investigation of internal facial tissues have provided invaluable information on constitution of the tissues it is important to inspect and model facial tissues in the living individual. Detailing the form and function of facial tissues will be invaluable in clinical diagnoses and planned corrective surgical interventions such as management of facial palsies and craniofacial disharmony/anomalies. Recent advances in lower-cost, non-invasive imaging and computing power (surface scanning, Cone Beam Computerized Tomography (CBCT) and Magnetic Resonance (MRI)) has enabled the ability to capture and process surface and internal structures to a high resolution. The three-dimensional surface facial capture has enabled characterization of facial features all of which will influence subtleties in facial movement and surgical planning. This chapter will describe the factors that influence facial morphology in terms of gender and age differences, facial movement—surface and underlying structures, modeling based on average structures, orientation of facial muscle fibers, biomechanics of movement—proof of principle and surgical intervention

3D-Guided Face Manipulation of 2D Images for the Prediction of Post-Operative Outcome after Cranio-Maxillofacial Surgery

Cranio-maxillofacial surgery often alters the aesthetics of the face which can be a heavy burden for patients to decide whether or not to undergo surgery. Today, physicians can predict the post-operative face using surgery planning tools to support the patient\u27s decision-making. While these planning tools allow a simulation of the post-operative face, the facial texture must usually be captured by another 3D texture scan and subsequently mapped on the simulated face. This approach often results in face predictions that do not appear realistic or lively looking and are therefore ill-suited to guide the patient\u27s decision-making. Instead, we propose a method using a generative adversarial network to modify a facial image according to a 3D soft-tissue estimation of the post-operative face. To circumvent the lack of available data pairs between pre- and post-operative measurements we propose a semi-supervised training strategy using cycle losses that only requires paired open-source data of images and 3D surfaces of the face\u27s shape. After training on "in-the-wild" images we show that our model can realistically manipulate local regions of a face in a 2D image based on a modified 3D shape. We then test our model on four clinical examples where we predict the post-operative face according to a 3D soft-tissue prediction of surgery outcome, which was simulated by a surgery planning tool. As a result, we aim to demonstrate the potential of our approach to predict realistic post-operative images of faces without the need of paired clinical data, physical models, or 3D texture scans

Physical and statistical shape modelling in craniomaxillofacial surgery: a personalised approach for outcome prediction

Orthognathic surgery involves repositioning of the jaw bones to restore face function and shape for patients who require an operation as a result of a syndrome, due to growth disturbances in childhood or after trauma. As part of the preoperative assessment, three-dimensional medical imaging and computer-assisted surgical planning help to improve outcomes, and save time and cost. Computer-assisted surgical planning involves visualisation and manipulation of the patient anatomy and can be used to aid objective diagnosis, patient communication, outcome evaluation, and surgical simulation. Despite the benefits, the adoption of three-dimensional tools has remained limited beyond specialised hospitals and traditional two-dimensional cephalometric analysis is still the gold standard. This thesis presents a multidisciplinary approach to innovative surgical simulation involving clinical patient data, medical image analysis, engineering principles, and state-of-the-art machine learning and computer vision algorithms. Two novel three-dimensional computational models were developed to overcome the limitations of current computer-assisted surgical planning tools. First, a physical modelling approach – based on a probabilistic finite element model – provided patient-specific simulations and, through training and validation, population-specific parameters. The probabilistic model was equally accurate compared to two commercial programs whilst giving additional information regarding uncertainties relating to the material properties and the mismatch in bone position between planning and surgery. Second, a statistical modelling approach was developed that presents a paradigm shift in its modelling formulation and use. Specifically, a 3D morphable model was constructed from 5,000 non-patient and orthognathic patient faces for fully-automated diagnosis and surgical planning. Contrary to traditional physical models that are limited to a finite number of tests, the statistical model employs machine learning algorithms to provide the surgeon with a goal-driven patient-specific surgical plan. The findings in this thesis provide markers for future translational research and may accelerate the adoption of the next generation surgical planning tools to further supplement the clinical decision-making process and ultimately to improve patients’ quality of life

Statistical model based 3D shape prediction of postoperative trunks for non-invasive scoliosis surgery planning

One of the major concerns of scoliosis patients undergoing surgical treatment is the aesthetic aspect of the surgery outcome. It would be useful to predict the postoperative appearance of the patient trunk in the course of a surgery planning process in order to take into account the expectations of the patient. In this paper, we propose to use least squares support vector regression for the prediction of the postoperative trunk 3D shape after spine surgery for adolescent idiopathic scoliosis. Five dimensionality reduction techniques used in conjunction with the support vector machine are compared. The methods are evaluated in terms of their accuracy, based on the leave-one-out cross-validation performed on a database of 141 cases. The results indicate that the 3D shape predictions using a dimensionality reduction obtained by simultaneous decomposition of the predictors and response variables have the best accuracy.CIHR / IRS

Accuracy and characteristics of cephalometric software programs for outcome prediction of orthognathic treatments: A review

Objectives: Several software programs have been designed for outcome prediction of orthodontic and surgical treatments. This study aimed to review the accuracy and characteristics of cephalometric software programs for outcome prediction of orthognathic surgeries.Methods: This study reviewed studies that compared cephalometric software programs in terms of accuracy and characteristics for outcome prediction of orthognathic surgeries. The results of studies regarding some two-dimensional (2D) and three-dimensional (3D) software programs for this purpose were collected and reported.Conclusion: Use of diagnostic software programs for prediction of treatment outcome is an inseparable part of orthognathic treatment. Some studies have reported acceptable diagnostic accuracy of these software programs and their optimal efficacy for guiding the patients towards accepting or rejecting a treatment. However, using the manual technique to demonstrate the outcome of orthognathic treatment is still efficacious. Several factors such as updating the primary versions, their compatibility with the new operating systems, education and customer service are important in continuation of use of these software programs