Reconstruction 3D personnalisée de la colonne vertébrale à partir d'images radiographiques non-calibrées

Les systèmes de reconstruction stéréo-radiographique 3D -- La colonne vertébrale -- La scoliose idiopathique adolescente -- Évolution des systèmes de reconstruction 3D -- Filtres de rehaussement d'images -- Techniques de segmentation -- Les méthodes de calibrage -- Les méthodes de reconstruction 3D -- Problématique, hypothèses, objectifs et méthode générale -- Three-dimensional reconstruction of the scoliotic spine and pelvis from uncalibrated biplanar X-ray images -- A versatile 3D reconstruction system of the spine and pelvis for clinical assessment of spinal deformities -- Simulation experiments -- Clinical validation -- A three-dimensional retrospective analysis of the evolution of spinal instrumentation for the correction of adolescent idiopathic scoliosis -- Auto-calibrage d'un système à rayons-X à partir de primitives de haut niveau -- Segmentation de la colonne vertébrale -- Approche hiérarchique d'auto-calibrage d'un système d'acquisition à rayons-X -- Personalized 3D reconstruction of the scoliotic spine from hybrid statistical and X-ray image-based models -- Validation protocol

Three-Dimensional Biplanar Reconstruction of the Scoliotic Spine for Standard Clinical Setup

Tese de Doutoramento. Engenharia Informática. Faculdade de Engenharia. Universidade do Porto. 201

A 3D computer assisted Orthopedic Surgery Planning approach based on planar radiography

Dissertação de mestrado integrado em Engenharia Biomédica (área de especialização em Informática Médica)The main goal of this work consisted in develop a system to perform the 3D reconstruction of bone models from radiographic images. This system can be then integrated with a commercial software that performs pre-operative planning of orthopedic surgeries. The benefit of performing this 3D reconstruction from planar radiography is that this modality has some advantages over other modalities that perform this reconstruction directly, like CT and MRI. To develop the system it was used radiographic images of the femur obtained from medical image databases online. It was also used a generic model of the femur available in the online repository BEL. This generic model completes the information missing in the radiographic images. It was developed two methods to perform the 3D reconstruction through the deformation of the generic model, one uses triangulation of extracted edge points and the other don't. The first method was not successful, the final model had very low thickness, possibly because the triangulation process was not performed correctly. With the second method it was obtained a 3D bone model of the femur aligned with the radiographic images of the patient and with the same size as the patient's bone. However, the obtained model still needs some adjustment to coincide fully with reality. To perform this is necessary to enhance the deformation step of the model so that it will have the same shape as the patient's bone. The second method is more advantageous because it doesn't need the parameters of the x-ray imaging system. However, it's necessary to enhance the step deformation of this method so that the final model matches patient's anatomy.O principal objetivo deste trabalho consistiu em desenvolver um sistema capaz de realizar a reconstrução 3D de modelos ósseos a partir de imagens radiográficas. Este sistema pode posteriormente ser integrado num produto comercial que realiza o planeamento pré-operativo de cirurgias ortopédicas. O benefício de realizar esta reconstrução 3D a partir de radiografias está relacionado com o facto desta modalidade ter vantagens em relação às outras modalidades que fazem esta reconstrução diretamente, como as modalidades CT e MRI. Para desenvolver este sistema foram usadas imagens radiográficas do fémur obtidas através de bases de dados online de imagens médicas. Também foi usado um modelo genérico do fémur disponível no repositório online BEL. Este modelo genérico completa a informação que está em falta nas imagens radiográficas. Foram desenvolvidos dois métodos, que realizam a reconstrução 3D através da deformação do modelo genérico sendo que num é feita a triangulação de pontos dos contornos e noutro não. O primeiro método não foi bem sucedido, visto que o modelo final tinha uma espessura muito pequena, possivelmente devido ao facto do processo de triangulação não ter sido executado corretamente. Com o segundo método foi obtido um modelo 3D do fémur alinhado com as imagens radiográficas do paciente e com o mesmo tamanho do osso do paciente. No entanto, o modelo obtido carece ainda de alguma afinação de modo a coincidir na íntegra com a realidade. Para fazer isto é necessário melhorar o passo de deformação do modelo, para que este fique com a mesma forma do osso do paciente. O segundo método é mais vantajoso porque não necessita dos parâmetros dos sistema de raios- X. No entanto, é necessário melhorar o passo de deformação deste método para que o modelo final coincida com a anatomia do paciente

Augmented Reality and Artificial Intelligence in Image-Guided and Robot-Assisted Interventions

In minimally invasive orthopedic procedures, the surgeon places wires, screws, and surgical implants through the muscles and bony structures under image guidance. These interventions require alignment of the pre- and intra-operative patient data, the intra-operative scanner, surgical instruments, and the patient. Suboptimal interaction with patient data and challenges in mastering 3D anatomy based on ill-posed 2D interventional images are essential concerns in image-guided therapies. State of the art approaches often support the surgeon by using external navigation systems or ill-conditioned image-based registration methods that both have certain drawbacks. Augmented reality (AR) has been introduced in the operating rooms in the last decade; however, in image-guided interventions, it has often only been considered as a visualization device improving traditional workflows. Consequently, the technology is gaining minimum maturity that it requires to redefine new procedures, user interfaces, and interactions. This dissertation investigates the applications of AR, artificial intelligence, and robotics in interventional medicine. Our solutions were applied in a broad spectrum of problems for various tasks, namely improving imaging and acquisition, image computing and analytics for registration and image understanding, and enhancing the interventional visualization. The benefits of these approaches were also discovered in robot-assisted interventions. We revealed how exemplary workflows are redefined via AR by taking full advantage of head-mounted displays when entirely co-registered with the imaging systems and the environment at all times. The proposed AR landscape is enabled by co-localizing the users and the imaging devices via the operating room environment and exploiting all involved frustums to move spatial information between different bodies. The system's awareness of the geometric and physical characteristics of X-ray imaging allows the exploration of different human-machine interfaces. We also leveraged the principles governing image formation and combined it with deep learning and RGBD sensing to fuse images and reconstruct interventional data. We hope that our holistic approaches towards improving the interface of surgery and enhancing the usability of interventional imaging, not only augments the surgeon's capabilities but also augments the surgical team's experience in carrying out an effective intervention with reduced complications

Porcine Spine Finite Element Model of Progressive Experimental Scoliosis and Assessment of a New Dual-Epiphyseal Growth Modulating Implant

RÉSUMÉ La scoliose est une déformation tridimensionnelle de la colonne vertébrale dont l’étiologie reste encore à élucider. Il est généralement admis que la progression de la déformation scoliotique pédiatrique est liée au principe d’Hueter-Volkmann qui stipule une réduction de la croissance suite à des contraintes en compression excessives au niveau de la concavité de la courbure scoliotique vs. sa convexité. Les stratégies de traitement des courbures sont difficiles, surtout chez les jeunes enfants. Typiquement, une intervention chirurgicale avec une instrumentation rachidienne accompagnée d’une arthrodèse segmentaire est nécessaire pour des courbures progressant au-delà de 40° d’angle de Cobb. De nouveaux dispositifs visent à manipuler la croissance vertébrale en exploitant le principe d’Hueter-Volkmann pour contrôler la progression de et corriger la courbure. Ces implants sans fusion exploitent la croissance vertébrale résiduelle en manipulant des gradients de croissance pour localement inverser la cunéiformisation vertébrale et, au fil du temps, réaligner la colonne vertébrale globalement. Des essais cliniques ont démontré une correction prometteuse pour les courbures généralement inférieures à 45°; cependant, les dispositifs actuels chevauchent l’espace du disque intervertébral et le compriment augmentant les risques de dégénérescence du disque à long terme. Par ailleurs, les implants nouvellement conçus sont généralement testés en utilisant des modèles animaux équivalents pour évaluer leur efficacité à corriger des déformations par l'intermédiaire de l’approche inverse (création d'une déformation) ou l’approche à 2- étapes (création d'une déformation suivie d’une correction). Néanmoins, une plate-forme de conception efficace est nécessaire pour évaluer la manipulation de la croissance à court et long termes par de nouveaux implants et de raccourcir le transfert de connaissances vers des applications cliniques. L’objectif général de cette thèse était de développer et de vérifier un modèle par éléments finis porcin (MEFp) unique en tant qu’une plateforme alternative pour la simulation de scolioses expérimentales progressives et des implants sans fusion, et d’évaluer un nouvel implant double-épiphysaire local ne chevauchant pas l’espace du disque sur des porcs immatures. Ainsi, les objectifs spécifiques suivants ont été complétés : 1) développer et----------ABSTRACT Scoliosis is a complex three-dimensional deformity of the spine whose etiology is yet to be elucidated. The pathomechanism of scoliosis progression is believed to be linked to the Hueter-Volkmann principle, by which growth is reduced due to increased growth plate compression, with the inverse also valid. Treatment strategies are challenging, especially in young children. Curves progressing beyond 40° Cobb angle are typically treated via invasive surgical interventions requiring spinal instrumentation accompanied by segmental spinal arthrodesis, impairing spinal mobility. New devices aim at manipulating vertebral growth by exploiting the Hueter-Volkmann principle to control curvature progression. These fusionless implants harness remaining vertebral growth by manipulating growth gradients to reverse vertebral wedging locally and, over time, globally realign the spine. Clinical trials have demonstrated promising deformity correction for curves generally below 45°; however, current devices bridge the intervertebral disc gap and predominantly compress the disc increasing the risks of longterm disc degeneration. Moreover, in a time-consuming manner, newly designed implants are commonly tested using equivalent animal models to assess their efficacy in correcting spinal deformities via the inverse (creation of a deformity) or the 2-step approaches (creation of a deformity followed by its subsequent correction). Nevertheless, a solid design platform is required to evaluate the short- and long-term growth manipulating efficacy of new implant designs and shorten knowledge transfer to clinical applications. The general objective of this thesis was to develop and verify a unique porcine spine finite element model (pFEM) as an alternative testing platform for the simulation of progressive experimental scoliosis and fusionless implants, and assess a new localized dualepiphyseal implant on immature pigs. Thus, specific objectives were devised as follows: 1) develop and verify a distinctive pFEM of the spine and ribcage, 2) develop and test, in vivo, a dual-epiphyseal implant incorporating a custom expansion mechanism, 3) exploit the developed pFEM to investigate differences between the inverse and 2-step fusionless implant testing approaches, and 4) exploit the pFEM to evaluate the biomechanical contribution of the ribcage in fusionless scoliosis surgery

CT Scanning

Since its introduction in 1972, X-ray computed tomography (CT) has evolved into an essential diagnostic imaging tool for a continually increasing variety of clinical applications. The goal of this book was not simply to summarize currently available CT imaging techniques but also to provide clinical perspectives, advances in hybrid technologies, new applications other than medicine and an outlook on future developments. Major experts in this growing field contributed to this book, which is geared to radiologists, orthopedic surgeons, engineers, and clinical and basic researchers. We believe that CT scanning is an effective and essential tools in treatment planning, basic understanding of physiology, and and tackling the ever-increasing challenge of diagnosis in our society

Development of ultrasound to measure deformation of functional spinal units in cervical spine

Neck pain is a pervasive problem in the general population, especially in those working in vibrating environments, e.g. military troops and truck drivers. Previous studies showed neck pain was strongly associated with the degeneration of intervertebral disc, which is commonly caused by repetitive loading in the work place. Currently, there is no existing method to measure the in-vivo displacement and loading condition of cervical spine on the site. Therefore, there is little knowledge about the alternation of cervical spine functionality and biomechanics in dynamic environments. In this thesis, a portable ultrasound system was explored as a tool to measure the vertebral motion and functional spinal unit deformation. It is hypothesized that the time sequences of ultrasound imaging signals can be used to characterize the deformation of cervical spine functional spinal units in response to applied displacements and loading. Specifically, a multi-frame tracking algorithm is developed to measure the dynamic movement of vertebrae, which is validated in ex-vivo models. The planar kinematics of the functional spinal units is derived from a dual ultrasound system, which applies two ultrasound systems to image C-spine anteriorly and posteriorly. The kinematics is reconstructed from the results of the multi-frame movement tracking algorithm and a method to co-register ultrasound vertebrae images to MRI scan. Using the dual ultrasound, it is shown that the dynamic deformation of functional spinal unit is affected by the biomechanics properties of intervertebral disc ex-vivo and different applied loading in activities in-vivo. It is concluded that ultrasound is capable of measuring functional spinal units motion, which allows rapid in-vivo evaluation of C-spine in dynamic environments where X-Ray, CT or MRI cannot be used.2020-02-20T00:00:00

Automated shape analysis and visualization of the human back.

Spinal and back deformities can lead to pain and discomfort, disrupting productivity, and may require prolonged treatment. The conventional method of assessing and monitoring tile de-formity using radiographs has known radiation hazards. An alternative approach for monitoring the deformity is to base the assessment on the shape of back surface. Though three-dimensional data acquisition methods exist, techniques to extract relevant information for clinical use have not been widely developed. Thi's thesis presentsthe content and progression of research into automated analysis and visu-alization of three-dimensional laser scans of the human back. Using mathematical shape analysis, methods have been developed to compute stable curvature of the back surface and to detect the anatomic landmarks from the curvature maps. Compared with manual palpation, the landmarks have been detected to within accuracy of 1.15mm and precision of 0.8111m.Based on the detected spinous process landmarks, the back midline which is the closest surface approximation of the spine, has been derived using constrained polynomial fitting and statistical techniques. Three-dimensional geometric measurementsbasedon the midline were then corn-puted to quantify the deformity. Visualization plays a crucial role in back shape analysis since it enables the exploration of back deformities without the need for physical manipulation of the subject. In the third phase,various visualization techniques have been developed, namely, continuous and discrete colour maps, contour maps and three-dimensional views. In the last phase of the research,a software system has been developed for automating the tasks involved in analysing, visualizing and quantifying of the back shape. The novel aspectsof this research lie in the development of effective noise smoothing methods for stable curvature computation; improved shape analysis and landmark detection algorithm; effective techniques for visualizing the shape of the back; derivation of the back midline using constrained polynomials and computation of three dimensional surface measurements.

Automatic image analysis of C-arm Computed Tomography images for ankle joint surgeries

Open reduction and internal fixation is a standard procedure in ankle surgery for treating a fractured fibula. Since fibula fractures are often accompanied by an injury of the syndesmosis complex, it is essential to restore the correct relative pose of the fibula relative to the adjoining tibia for the ligaments to heal. Otherwise, the patient might experience instability of the ankle leading to arthritis and ankle pain and ultimately revision surgery. Incorrect positioning referred to as malreduction of the fibula is assumed to be one of the major causes of unsuccessful ankle surgery. 3D C-arm imaging is the current standard procedure for revealing malreduction of fractures in the operating room. However, intra-operative visual inspection of the reduction result is complicated due to high inter-individual variation of the ankle anatomy and rather based on the subjective experience of the surgeon. A contralateral side comparison with the patient’s uninjured ankle is recommended but has not been integrated into clinical routine due to the high level of radiation exposure it incurs. This thesis presents the first approach towards a computer-assisted intra-operative contralateral side comparison of the ankle joint. The focus of this thesis was the design, development and validation of a software-based prototype for a fully automatic intra-operative assistance system for orthopedic surgeons. The implementation does not require an additional 3D C-arm scan of the uninjured ankle, thus reducing time consumption and cumulative radiation dose. A 3D statistical shape model (SSM) is used to reconstruct a 3D surface model from three 2D fluoroscopic projections representing the uninjured ankle. To this end, a 3D SSM segmentation is performed on the 3D image of the injured ankle to gain prior knowledge of the ankle. A 3D convolutional neural network (CNN) based initialization method was developed and its outcome was incorporated into the SSM adaption step. Segmentation quality was shown to be improved in terms of accuracy and robustness compared to the pure intensity-based SSM. This allows us to overcome the limitations of the previously proposed methods, namely inaccuracy due to metal artifacts and the lack of device-to-patient orientation of the C-arm. A 2D-CNN is employed to extract semantic knowledge from all fluoroscopic projection images. This step of the pipeline both creates features for the subsequent reconstruction and also helps to pre-initialize the 3D-SSM without user interaction. A 2D-3D multi-bone reconstruction method has been developed which uses distance maps of the 2D features for fast and accurate correspondence optimization and SSM adaption. This is the central and most crucial component of the workflow. This is the first time that a bone reconstruction method has been applied to the complex ankle joint and the first reconstruction method using CNN based segmentations as features. The reconstructed 3D-SSM of the uninjured ankle can be back-projected and visualized in a workflow-oriented manner to procure clear visualization of the region of interest, which is essential for the evaluation of the reduction result. The surgeon can thus directly compare an overlay of the contralateral ankle with the injured ankle. The developed methods were evaluated individually using data sets acquired during a cadaver study and representative clinical data acquired during fibular reduction. A hierarchical evaluation was designed to assess the inaccuracies of the system on different levels and to identify major sources of error. The overall evaluation performed on eleven challenging clinical datasets acquired for manual contralateral side comparison showed that the system is capable of accurately reconstructing 3D surface models of the uninjured ankle solely using three projection images. A mean Hausdorff distance of 1.72 mm was measured when comparing the reconstruction result to the ground truth segmentation and almost achieved the high required clinical accuracy of 1-2 mm. The overall error of the pipeline was mainly attributed to inaccuracies in the 2D-CNN segmentation. The consistency of these results requires further validation on a larger dataset. The workflow proposed in this thesis establishes the first approach to enable automatic computer-assisted contralateral side comparison in ankle surgery. The feasibility of the proposed approach was proven on a limited amount of clinical cases and has already yielded good results. The next important step is to alleviate the identified bottlenecks in the approach by providing more training data in order to further improve the accuracy. In conclusion, the new approach presented gives the chance to guide the surgeon during the reduction process, improve the surgical outcome while avoiding additional radiation exposure and reduce the number of revision surgeries in the long term