Automatic image analysis of C-arm Computed Tomography images for ankle joint surgeries

Open reduction and internal fixation is a standard procedure in ankle surgery for treating a fractured fibula. Since fibula fractures are often accompanied by an injury of the syndesmosis complex, it is essential to restore the correct relative pose of the fibula relative to the adjoining tibia for the ligaments to heal. Otherwise, the patient might experience instability of the ankle leading to arthritis and ankle pain and ultimately revision surgery. Incorrect positioning referred to as malreduction of the fibula is assumed to be one of the major causes of unsuccessful ankle surgery. 3D C-arm imaging is the current standard procedure for revealing malreduction of fractures in the operating room. However, intra-operative visual inspection of the reduction result is complicated due to high inter-individual variation of the ankle anatomy and rather based on the subjective experience of the surgeon. A contralateral side comparison with the patient’s uninjured ankle is recommended but has not been integrated into clinical routine due to the high level of radiation exposure it incurs. This thesis presents the first approach towards a computer-assisted intra-operative contralateral side comparison of the ankle joint. The focus of this thesis was the design, development and validation of a software-based prototype for a fully automatic intra-operative assistance system for orthopedic surgeons. The implementation does not require an additional 3D C-arm scan of the uninjured ankle, thus reducing time consumption and cumulative radiation dose. A 3D statistical shape model (SSM) is used to reconstruct a 3D surface model from three 2D fluoroscopic projections representing the uninjured ankle. To this end, a 3D SSM segmentation is performed on the 3D image of the injured ankle to gain prior knowledge of the ankle. A 3D convolutional neural network (CNN) based initialization method was developed and its outcome was incorporated into the SSM adaption step. Segmentation quality was shown to be improved in terms of accuracy and robustness compared to the pure intensity-based SSM. This allows us to overcome the limitations of the previously proposed methods, namely inaccuracy due to metal artifacts and the lack of device-to-patient orientation of the C-arm. A 2D-CNN is employed to extract semantic knowledge from all fluoroscopic projection images. This step of the pipeline both creates features for the subsequent reconstruction and also helps to pre-initialize the 3D-SSM without user interaction. A 2D-3D multi-bone reconstruction method has been developed which uses distance maps of the 2D features for fast and accurate correspondence optimization and SSM adaption. This is the central and most crucial component of the workflow. This is the first time that a bone reconstruction method has been applied to the complex ankle joint and the first reconstruction method using CNN based segmentations as features. The reconstructed 3D-SSM of the uninjured ankle can be back-projected and visualized in a workflow-oriented manner to procure clear visualization of the region of interest, which is essential for the evaluation of the reduction result. The surgeon can thus directly compare an overlay of the contralateral ankle with the injured ankle. The developed methods were evaluated individually using data sets acquired during a cadaver study and representative clinical data acquired during fibular reduction. A hierarchical evaluation was designed to assess the inaccuracies of the system on different levels and to identify major sources of error. The overall evaluation performed on eleven challenging clinical datasets acquired for manual contralateral side comparison showed that the system is capable of accurately reconstructing 3D surface models of the uninjured ankle solely using three projection images. A mean Hausdorff distance of 1.72 mm was measured when comparing the reconstruction result to the ground truth segmentation and almost achieved the high required clinical accuracy of 1-2 mm. The overall error of the pipeline was mainly attributed to inaccuracies in the 2D-CNN segmentation. The consistency of these results requires further validation on a larger dataset. The workflow proposed in this thesis establishes the first approach to enable automatic computer-assisted contralateral side comparison in ankle surgery. The feasibility of the proposed approach was proven on a limited amount of clinical cases and has already yielded good results. The next important step is to alleviate the identified bottlenecks in the approach by providing more training data in order to further improve the accuracy. In conclusion, the new approach presented gives the chance to guide the surgeon during the reduction process, improve the surgical outcome while avoiding additional radiation exposure and reduce the number of revision surgeries in the long term

Computer assisted surgery for fracture reduction and deformity correction of the pelvis and long bones

Many orthopaedic operations, for example osteotomies, are not preoperative planned. The operation result depends on the experience of the operating surgeon. In the industry new developments are not longer curried out without CAD planning or computer simulations. Only in medicine the operation technology of corrective osteotomies are still in their infant stage in the last 30 years. Two dimensional analysis is not accurate that results in operation errors in the operating room. The surgeon usually obtains the preoperative information about the current bone state by radiographs. In case of complex operations (also inserting implants) planning is required. Planning based on radiographs has some system-dependent disadvantages like small accuracy, requirement of time for corrections ( distortions due to the projection) and restrictions, if complex corrections are necessary. Today the computer tomography is used as a solution. It is the only modality that allows to reach the accuracy and the resolution required for a good 3D-planning. However its a high dose rate for the patient is the serious disadvantage. Therefore in dilemma between the low dose rate and an adequate planning the first is often preferred. However in future it is expected that good operation results are guarantied only with implementation of 3D-planung. MR systems provide image information too, from which indirectly bones can be extracted. But due to their large distortions (susceptibility, non non-homogeneity of magnetic field), small spatial dissolution and the high costs, it is not expected that MRI represents an alternative in next time. The solution is the use of other image modalities. Ultrasound is here a good compromise both of the costs of the accuracy. In this work I developed an algorithm, which can produce 3D bone models from ultrasonic data. They have good resolution and accuracy compared with CT, and therefore can be used for 3D planning. In the work an improved procedure for segmenting bone surfaces is realised in combination with methods for the fusion for a three-dimensional model. The novelty of the presented work is in new approaches to realising an operation planning system, based on 3D computations, and implementing the intraoperative control by a guided ultrasound system for bone tracking. To realise these ideas the following tasks are solved: - bone modelling from CT data; - real-time extraction of bone surfaces from ultrasound imaging; - tracking the bone with respect to CT bone model. - integrating and implementing the above results in the development of an operation planning system for osteotomy corrections that supports on-line measurements, different types of deformity correction, a bone geometry design and a high level of automation. The developed osteotomy planning system allows to investigate the pathology, makes its analysis, finds an optimal way to realise surgery and provides visual and quantitative information about the results of the virtual operation. Therefore, the implementation of the proposed system can be considered as an additional significant tool for the diagnosis and orthopaedic surgery. The major parts of the planning system are: bone modelling from 3D data derived from CT, MRI or other modalities, visualisation of the elements of the 3D scene in real-time, and the geometric design of bone elements. A high level of automation allows the surgeon to reduce significantly the time of the operation plane development

Injury and Skeletal Biomechanics

This book covers many aspects of Injury and Skeletal Biomechanics. As the title represents, the aspects of force, motion, kinetics, kinematics, deformation, stress and strain are examined in a range of topics such as human muscles and skeleton, gait, injury and risk assessment under given situations. Topics range from image processing to articular cartilage biomechanical behavior, gait behavior under different scenarios, and training, to musculoskeletal and injury biomechanics modeling and risk assessment to motion preservation. This book, together with "Human Musculoskeletal Biomechanics", is available for free download to students and instructors who may find it suitable to develop new graduate level courses and undergraduate teaching in biomechanics

Anatomical and functional custom made restoration techniques with Direct Metal Laser Forming technology: systematic workflow and CAD-CAM

Introduction Bone defects are usually repaired by the body’s healing process itself. If severe fracture, tumor or infection occur on large bones, it poses a serious challenge to the regeneration ability of the bones. One of the latest advancement in medical science is the rapid prototyping technologies. Therefore, the aim of the present study was the developing and testing of a reliable workflow to fabricate custom-made grafts in the field craniofacial surgery. Material and Methods In this study 14 patients with different cranio-facial bone defects were enrolled. Two evaluation methods were associated to test the results of the workflow. Surveys were given to patients undergone surgery and their surgeons to have a subjective analysis of the workflow. For each patient the produced prosthesis was superimposed on the original prosthesis design, the displacement between was evaluated. Results Significant level of discomfort at 4 weeks after surgery compared to 2 days after surgery, aesthetic improvement significant improved 1 year after surgery compared to 4 weeks after surgery. Aesthetic improvement 1 year after surgery and aesthetic improvement according to expectations showed correlation, aesthetic improvement 1 year after surgery and aesthetic improvement according to expectations showed correlation. The mean distance of the printed model was significant smaller than the virtual model, with a mean difference of -0.075 mm. Conclusion According to the results of the present study custom made bone graft made with laser sintering technique represents a valid alternative to traditional bone grafts with high clinical accuracy and the advantage to avoid morbidity of the donor site or of the patient due to animal grafting

Advanced Applications of Rapid Prototyping Technology in Modern Engineering

Rapid prototyping (RP) technology has been widely known and appreciated due to its flexible and customized manufacturing capabilities. The widely studied RP techniques include stereolithography apparatus (SLA), selective laser sintering (SLS), three-dimensional printing (3DP), fused deposition modeling (FDM), 3D plotting, solid ground curing (SGC), multiphase jet solidification (MJS), laminated object manufacturing (LOM). Different techniques are associated with different materials and/or processing principles and thus are devoted to specific applications. RP technology has no longer been only for prototype building rather has been extended for real industrial manufacturing solutions. Today, the RP technology has contributed to almost all engineering areas that include mechanical, materials, industrial, aerospace, electrical and most recently biomedical engineering. This book aims to present the advanced development of RP technologies in various engineering areas as the solutions to the real world engineering problems

Augmented Reality and Artificial Intelligence in Image-Guided and Robot-Assisted Interventions

In minimally invasive orthopedic procedures, the surgeon places wires, screws, and surgical implants through the muscles and bony structures under image guidance. These interventions require alignment of the pre- and intra-operative patient data, the intra-operative scanner, surgical instruments, and the patient. Suboptimal interaction with patient data and challenges in mastering 3D anatomy based on ill-posed 2D interventional images are essential concerns in image-guided therapies. State of the art approaches often support the surgeon by using external navigation systems or ill-conditioned image-based registration methods that both have certain drawbacks. Augmented reality (AR) has been introduced in the operating rooms in the last decade; however, in image-guided interventions, it has often only been considered as a visualization device improving traditional workflows. Consequently, the technology is gaining minimum maturity that it requires to redefine new procedures, user interfaces, and interactions. This dissertation investigates the applications of AR, artificial intelligence, and robotics in interventional medicine. Our solutions were applied in a broad spectrum of problems for various tasks, namely improving imaging and acquisition, image computing and analytics for registration and image understanding, and enhancing the interventional visualization. The benefits of these approaches were also discovered in robot-assisted interventions. We revealed how exemplary workflows are redefined via AR by taking full advantage of head-mounted displays when entirely co-registered with the imaging systems and the environment at all times. The proposed AR landscape is enabled by co-localizing the users and the imaging devices via the operating room environment and exploiting all involved frustums to move spatial information between different bodies. The system's awareness of the geometric and physical characteristics of X-ray imaging allows the exploration of different human-machine interfaces. We also leveraged the principles governing image formation and combined it with deep learning and RGBD sensing to fuse images and reconstruct interventional data. We hope that our holistic approaches towards improving the interface of surgery and enhancing the usability of interventional imaging, not only augments the surgeon's capabilities but also augments the surgical team's experience in carrying out an effective intervention with reduced complications

Investigating the effect of mechanical loading in a total reversed shoulder implant

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.The shoulder joint is a multi-axis synovial ball and socket joint, by having a loose connection it provides a wide degree of freedom; however this means the joint lacks robustness and is prone to damage most commonly from shoulder dislocations. A rotator cuff tear causes major problems in allowing the arm to be lifted beyond a 90˚ abduction position. It is common that this insufficiency aggravates arthritis problems that may have occurred due the rotator cuff tear problem. The study focuses on investigating, describing and quantifying the implant geometric properties to evaluate the joint contact characteristics and use the outcome in redesign the implant. The investigation presents results of finite element analysis on a heavy loading condition on a Verso (reverse) shoulder implant which is validated using experimental data on the same prosthesis. The results are validated within a 5% error margin. A Verso implant is modelled using MIMICS (materialise) and imported into ABAQUS (Simulia, Providence, USA) to analyse the distribution of stress, strain and displacement across the Humerus and Scapula. Details of interaction, boundary conditions, loads and material properties are all obtained from research and applied to the model to portray realistic behaviour. The resulting stress, strain and displacement from this simulation are indicated to show the magnitude and distribution across the entire bone region. This validates the benefits of a Verso implant compared to conventional and long stemmed reverse shoulder implants, as well as provide a basis from which improved designs can be built upon and allow further accurate methods to be developed in analysing shoulder implants effectively

TrauMAP - Integrating Anatomical and Physiological Simulation (Dissertation Proposal)

In trauma, many injuries impact anatomical structures, which may in turn affect physiological processes - not only those processes within the structure, but also ones occurring in physical proximity to them. Our goal with this research is to model mechanical interactions of different body systems and their impingement on underlying physiological processes. We are particularly concerned with pathological situations in which body system functions that normally do not interact become dependent as a result of mechanical behavior. Towards that end, the proposed TRAUMAP system (Trauma Modeling of Anatomy and Physiology) consists of three modules: (1) a hypothesis generator for suggesting possible structural changes that result from the direct injuries sustained; (2) an information source for responding to operator querying about anatomical structures, physiological processes, and pathophysiological processes; and (3) a continuous system simulator for simulating and illustrating anatomical and physiological changes in three dimensions. Models that can capture such changes may serve as an infrastructure for more detailed modeling and benefit surgical planning, surgical training, and general medical education, enabling students to visualize better, in an interactive environment, certain basic anatomical and physiological dependencies