Recent trends, technical concepts and components of computer-assisted orthopedic surgery systems: A comprehensive review

Computer-assisted orthopedic surgery (CAOS) systems have become one of the most important and challenging types of system in clinical orthopedics, as they enable precise treatment of musculoskeletal diseases, employing modern clinical navigation systems and surgical tools. This paper brings a comprehensive review of recent trends and possibilities of CAOS systems. There are three types of the surgical planning systems, including: systems based on the volumetric images (computer tomography (CT), magnetic resonance imaging (MRI) or ultrasound images), further systems utilize either 2D or 3D fluoroscopic images, and the last one utilizes the kinetic information about the joints and morphological information about the target bones. This complex review is focused on three fundamental aspects of CAOS systems: their essential components, types of CAOS systems, and mechanical tools used in CAOS systems. In this review, we also outline the possibilities for using ultrasound computer-assisted orthopedic surgery (UCAOS) systems as an alternative to conventionally used CAOS systems.Web of Science1923art. no. 519

The residual STL volume as a metric to evaluate accuracy and reproducibility of anatomic models for 3D printing: application in the validation of 3D-printable models of maxillofacial bone from reduced radiation dose CT images.

BackgroundThe effects of reduced radiation dose CT for the generation of maxillofacial bone STL models for 3D printing is currently unknown. Images of two full-face transplantation patients scanned with non-contrast 320-detector row CT were reconstructed at fractions of the acquisition radiation dose using noise simulation software and both filtered back-projection (FBP) and Adaptive Iterative Dose Reduction 3D (AIDR3D). The maxillofacial bone STL model segmented with thresholding from AIDR3D images at 100 % dose was considered the reference. For all other dose/reconstruction method combinations, a "residual STL volume" was calculated as the topologic subtraction of the STL model derived from that dataset from the reference and correlated to radiation dose.ResultsThe residual volume decreased with increasing radiation dose and was lower for AIDR3D compared to FBP reconstructions at all doses. As a fraction of the reference STL volume, the residual volume decreased from 2.9 % (20 % dose) to 1.4 % (50 % dose) in patient 1, and from 4.1 % to 1.9 %, respectively in patient 2 for AIDR3D reconstructions. For FBP reconstructions it decreased from 3.3 % (20 % dose) to 1.0 % (100 % dose) in patient 1, and from 5.5 % to 1.6 %, respectively in patient 2. Its morphology resembled a thin shell on the osseous surface with average thickness <0.1 mm.ConclusionThe residual volume, a topological difference metric of STL models of tissue depicted in DICOM images supports that reduction of CT dose by up to 80 % of the clinical acquisition in conjunction with iterative reconstruction yields maxillofacial bone models accurate for 3D printing

Finite element model set-up of colorectal tissue for analyzing surgical scenarios

Finite Element Analysis (FEA) has gained an extensive application in the medical field, such as soft tissues simulations. In particular, colorectal simulations can be used to understand the interaction with the surrounding tissues, or with instruments used in surgical procedures. Although several works have been introduced considering small displacements, as a result of the forces exerted on adjacent tissues, FEA applied to colorectal surgical scenarios is still a challenge. Therefore, this work aims to provide a sensitivity analysis on three geometric models, taking in mind different bioengineering tasks. In this way, a set of simulations has been performed using three mechanical models named Linear Elastic, Hyper-Elastic with a Mooney-Rivlin material model, and Hyper-Elastic with a YEOH material model

Segmentation and Fracture Detection in CT Images for Traumatic Pelvic Injuries

In recent decades, more types and quantities of medical data have been collected due to advanced technology. A large number of significant and critical information is contained in these medical data. High efficient and automated computational methods are urgently needed to process and analyze all available medical data in order to provide the physicians with recommendations and predictions on diagnostic decisions and treatment planning. Traumatic pelvic injury is a severe yet common injury in the United States, often caused by motor vehicle accidents or fall. Information contained in the pelvic Computed Tomography (CT) images is very important for assessing the severity and prognosis of traumatic pelvic injuries. Each pelvic CT scan includes a large number of slices. Meanwhile, each slice contains a large quantity of data that may not be thoroughly and accurately analyzed via simple visual inspection with the desired accuracy and speed. Hence, a computer-assisted pelvic trauma decision-making system is needed to assist physicians in making accurate diagnostic decisions and determining treatment planning in a short period of time. Pelvic bone segmentation is a vital step in analyzing pelvic CT images and assisting physicians with diagnostic decisions in traumatic pelvic injuries. In this study, a new hierarchical segmentation algorithm is proposed to automatically extract multiplelevel bone structures using a combination of anatomical knowledge and computational techniques. First, morphological operations, image enhancement, and edge detection are performed for preliminary bone segmentation. The proposed algorithm then uses a template-based best shape matching method that provides an entirely automated segmentation process. This is followed by the proposed Registered Active Shape Model (RASM) algorithm that extracts pelvic bone tissues using more robust training models than the Standard ASM algorithm. In addition, a novel hierarchical initialization process for RASM is proposed in order to address the shortcoming of the Standard ASM, i.e. high sensitivity to initialization. Two suitable measures are defined to evaluate the segmentation results: Mean Distance and Mis-segmented Area to quantify the segmentation accuracy. Successful segmentation results indicate effectiveness and robustness of the proposed algorithm. Comparison of segmentation performance is also conducted using both the proposed method and the Snake method. A cross-validation process is designed to demonstrate the effectiveness of the training models. 3D pelvic bone models are built after pelvic bone structures are segmented from consecutive 2D CT slices. Automatic and accurate detection of the fractures from segmented bones in traumatic pelvic injuries can help physicians detect the severity of injuries in patients. The extraction of fracture features (such as presence and location of fractures) as well as fracture displacement measurement, are vital for assisting physicians in making faster and more accurate decisions. In this project, after bone segmentation, fracture detection is performed using a hierarchical algorithm based on wavelet transformation, adaptive windowing, boundary tracing and masking. Also, a quantitative measure of fracture severity based on pelvic CT scans is defined and explored. The results are promising, demonstrating that the proposed method not only capable of automatically detecting both major and minor fractures, but also has potentials to be used for clinical applications

Automatic analysis of transperineal ultrasound images

This thesis focuses on the automatic image analysis of transperineal ultrasound (TPUS) data, which is used to investigate female pelvic floor problems. These problems have a high prevalence, but the understanding of pelvic floor (dys-)function is limited. TPUS analysis of the pelvic floor is done manually, which is time-consuming and observer dependent. This hinders both the research into interpretation of TPUS data and its clinical use. To overcome these problems we use automatic image analysis. Currently, one of the main methods used, to analyse the TPUS is manually selecting and segmenting the slice of minimal hiatal dimensions (SMHD). In the first chapter of this thesis we show that reliable automatic segmentation of the urogenital hiatus and the puborectalis muscle in the SMHD can be successfully implemented, using deep learning. Furthermore, we show that this can also be used to successfully automate the process of selecting and segmenting the SMHD. 4D TPUS is available in the clinical practice but by the aforementioned method only provides 1D and 2D parameters. Therefore, information stored within TPUS about the volume appearance of the pelvic floor muscles and muscle functionality is not analyzed. In the third chapter of this thesis we propose a reproducible manual 3D segmentation protocol of the puborectalis muscle. The resulting manual segmentations can be used to train active appearance models and convolutional neural networks, these algorithms can be used for reliable automatic 3D segmentation. In the fifth chapter of we show that on this data it is possible to identify all subdivisions of the main pelvic floor muscle group, the levator ani muscles, on new TPUS data. In the last chapter we apply unsupervised deep learning to our data and show that this can be used for classification of the TPUS data. The segmentation results presented in this thesis are an important step to reduce the TPUS analysis time and will therefore ease the study of large populations and clinical TPUS analysis. The 3D identification and segmentation of the levator ani muscle subdivisions helps to identify if they are still intact. This is an important step to better informed clinical decision-making

Intensity modulated radiation therapy and arc therapy: validation and evolution as applied to tumours of the head and neck, abdominal and pelvic regions

Intensiteitsgemoduleerde radiotherapie (IMRT) laat een betere controle over de dosisdistributie (DD) toe dan meer conventionele bestralingstechnieken. Zo is het met IMRT mogelijk om concave DDs te bereiken en om de risico-organen conformeel uit te sparen. IMRT werd in het UZG klinisch toegepast voor een hele waaier van tumorlocalisaties. De toepassing van IMRT voor de bestraling van hoofd- en halstumoren (HHT) vormt het onderwerp van het eerste deel van deze thesis. De planningsstrategie voor herbestralingen en bestraling van HHT, uitgaande van de keel en de mondholte wordt beschreven, evenals de eerste klinische resultaten hiervan. IMRT voor tumoren van de neus(bij)holten leidt tot minstens even goede lokale controle (LC) en overleving als conventionele bestralingstechnieken, en dit zonder stralingsgeïnduceerde blindheid. IMRT leidt dus tot een gunstiger toxiciteitprofiel maar heeft nog geen bewijs kunnen leveren van een gunstig effect op LC of overleving. De meeste hervallen van HHT worden gezien in het gebied dat tot een hoge dosis bestraald werd, wat erop wijst dat deze “hoge dosis” niet volstaat om alle clonogene tumorcellen uit te schakelen. We startten een studie op, om de mogelijkheid van dosisescalatie op geleide van biologische beeldvorming uit te testen. Naast de toepassing en klinische validatie van IMRT bestond het werk in het kader van deze thesis ook uit de ontwikkeling en het klinisch opstarten van intensiteitgemoduleerde arc therapie (IMAT). IMAT is een rotationele vorm van IMRT (d.w.z. de gantry draait rond tijdens de bestraling), waarbij de modulatie van de intensiteit bereikt wordt door overlappende arcs. IMAT heeft enkele duidelijke voordelen ten opzichte van IMRT in bepaalde situaties. Als het doelvolume concaaf rond een risico-orgaan ligt met een grote diameter, biedt IMAT eigenlijk een oneindig aantal bundelrichtingen aan. Een planningsstrategie voor IMAT werd ontwikkeld, en type-oplossingen voor totaal abdominale bestraling en rectumbestraling werden onderzocht en klinisch toegepast

Segmentation of pelvic structures from preoperative images for surgical planning and guidance

Prostate cancer is one of the most frequently diagnosed malignancies globally and the second leading cause of cancer-related mortality in males in the developed world. In recent decades, many techniques have been proposed for prostate cancer diagnosis and treatment. With the development of imaging technologies such as CT and MRI, image-guided procedures have become increasingly important as a means to improve clinical outcomes. Analysis of the preoperative images and construction of 3D models prior to treatment would help doctors to better localize and visualize the structures of interest, plan the procedure, diagnose disease and guide the surgery or therapy. This requires efficient and robust medical image analysis and segmentation technologies to be developed. The thesis mainly focuses on the development of segmentation techniques in pelvic MRI for image-guided robotic-assisted laparoscopic radical prostatectomy and external-beam radiation therapy. A fully automated multi-atlas framework is proposed for bony pelvis segmentation in MRI, using the guidance of MRI AE-SDM. With the guidance of the AE-SDM, a multi-atlas segmentation algorithm is used to delineate the bony pelvis in a new \ac{MRI} where there is no CT available. The proposed technique outperforms state-of-the-art algorithms for MRI bony pelvis segmentation. With the SDM of pelvis and its segmented surface, an accurate 3D pelvimetry system is designed and implemented to measure a comprehensive set of pelvic geometric parameters for the examination of the relationship between these parameters and the difficulty of robotic-assisted laparoscopic radical prostatectomy. This system can be used in both manual and automated manner with a user-friendly interface. A fully automated and robust multi-atlas based segmentation has also been developed to delineate the prostate in diagnostic MR scans, which have large variation in both intensity and shape of prostate. Two image analysis techniques are proposed, including patch-based label fusion with local appearance-specific atlases and multi-atlas propagation via a manifold graph on a database of both labeled and unlabeled images when limited labeled atlases are available. The proposed techniques can achieve more robust and accurate segmentation results than other multi-atlas based methods. The seminal vesicles are also an interesting structure for therapy planning, particularly for external-beam radiation therapy. As existing methods fail for the very onerous task of segmenting the seminal vesicles, a multi-atlas learning framework via random decision forests with graph cuts refinement has further been proposed to solve this difficult problem. Motivated by the performance of this technique, I further extend the multi-atlas learning to segment the prostate fully automatically using multispectral (T1 and T2-weighted) MR images via hybrid \ac{RF} classifiers and a multi-image graph cuts technique. The proposed method compares favorably to the previously proposed multi-atlas based prostate segmentation. The work in this thesis covers different techniques for pelvic image segmentation in MRI. These techniques have been continually developed and refined, and their application to different specific problems shows ever more promising results.Open Acces

Automatic segmentation of whole-body bone scintigrams as a preprocessing step for computer assisted diagnostics

Bone scintigraphy or whole-body bone scan is one of the most common diagnostic procedures in nuclear medicine used in the last 25 years. Pathological conditions, technically poor quality images and artifacts necessitate that algorithms use su±cient background knowledge of anatomy and spatial relations of bones in order to work satisfactorily. We present a robust knowledge based methodology for detecting reference points of the main skeletal regions that simultaneously processes anterior and posterior whole-body bone scintigrams. Expert knowledge is represented as a set of parameterized rules which are used to support standard image processing algorithms. Our study includes 467 consecutive, non-selected scintigrams, which is to our knowledge the largest number of images ever used in such studies. Automatic analysis of whole-body bone scans using our knowledge based segmentation algorithm gives more accurate and reliable results than previous studies. Obtained reference points are used for automatic segmentation of the skeleton, which is used for automatic (machine learning) or manual (expert physicians) diagnostics. Preliminary experiments show that an expert system based on machine learning closely mimics the results of expert physicians

A Hierarchical Method Based on Active Shape Models and Directed Hough Transform for Segmentation of Noisy Biomedical Images; Application in Segmentation of Pelvic X-ray Images

Background Traumatic pelvic injuries are often associated with severe, life-threatening hemorrhage, and immediate medical treatment is therefore vital. However, patient prognosis depends heavily on the type, location and severity of the bone fracture, and the complexity of the pelvic structure presents diagnostic challenges. Automated fracture detection from initial patient X-ray images can assist physicians in rapid diagnosis and treatment, and a first and crucial step of such a method is to segment key bone structures within the pelvis; these structures can then be analyzed for specific fracture characteristics. Active Shape Model has been applied for this task in other bone structures but requires manual initialization by the user. This paper describes a algorithm for automatic initialization and segmentation of key pelvic structures - the iliac crests, pelvic ring, left and right pubis and femurs - using a hierarchical approach that combines directed Hough transform and Active Shape Models. Results Performance of the automated algorithm is compared with results obtained via manual initialization. An error measures is calculated based on the shapes detected with each method and the gold standard shapes. ANOVA results on these error measures show that the automated algorithm performs at least as well as the manual method. Visual inspection by two radiologists and one trauma surgeon also indicates generally accurate performance. Conclusion The hierarchical algorithm described in this paper automatically detects and segments key structures from pelvic X-rays. Unlike various other x-ray segmentation methods, it does not require manual initialization or input. Moreover, it handles the inconsistencies between x-ray images in a clinical environment and performs successfully in the presence of fracture. This method and the segmentation results provide a valuable base for future work in fracture detection

Semi-Automatic Segmentation of Normal Female Pelvic Floor Structures from Magnetic Resonance Images

Stress urinary incontinence (SUI) and pelvic organ prolapse (POP) are important health issues affecting millions of American women. Investigation of the cause of SUI and POP requires a better understand of the anatomy of female pelvic floor. In addition, pre-surgical planning and individualized treatment plans require development of patient-specific three-dimensional or virtual reality models. The biggest challenge in building those models is to segment pelvic floor structures from magnetic resonance images because of their complex shapes, which make manual segmentation labor-intensive and inaccurate. In this dissertation, a quick and reliable semi-automatic segmentation method based on a shape model is proposed. The model is built on statistical analysis of the shapes of structures in a training set. A local feature map of the target image is obtained by applying a filtering pipeline, including contrast enhancement, noise reduction, smoothing, and edge extraction. With the shape model and feature map, automatic segmentation is performed by matching the model to the border of the structure using an optimization technique called evolution strategy. Segmentation performance is evaluated by calculating a similarity coefficient between semi-automatic and manual segmentation results. Taguchi analysis is performed to investigate the significance of segmentation parameters and provide tuning trends for better performance. The proposed method was successfully tested on both two-dimensional and three-dimensional image segmentation using the levator ani and obturator muscles as examples. Although the method is designed for segmentation of female pelvic floor structures, it can also be applied to other structures or organs without large shape variatio