2,204 research outputs found

    Development, Implementation and Pre-clinical Evaluation of Medical Image Computing Tools in Support of Computer-aided Diagnosis: Respiratory, Orthopedic and Cardiac Applications

    Get PDF
    Over the last decade, image processing tools have become crucial components of all clinical and research efforts involving medical imaging and associated applications. The imaging data available to the radiologists continue to increase their workload, raising the need for efficient identification and visualization of the required image data necessary for clinical assessment. Computer-aided diagnosis (CAD) in medical imaging has evolved in response to the need for techniques that can assist the radiologists to increase throughput while reducing human error and bias without compromising the outcome of the screening, diagnosis or disease assessment. More intelligent, but simple, consistent and less time-consuming methods will become more widespread, reducing user variability, while also revealing information in a more clear, visual way. Several routine image processing approaches, including localization, segmentation, registration, and fusion, are critical for enhancing and enabling the development of CAD techniques. However, changes in clinical workflow require significant adjustments and re-training and, despite the efforts of the academic research community to develop state-of-the-art algorithms and high-performance techniques, their footprint often hampers their clinical use. Currently, the main challenge seems to not be the lack of tools and techniques for medical image processing, analysis, and computing, but rather the lack of clinically feasible solutions that leverage the already developed and existing tools and techniques, as well as a demonstration of the potential clinical impact of such tools. Recently, more and more efforts have been dedicated to devising new algorithms for localization, segmentation or registration, while their potential and much intended clinical use and their actual utility is dwarfed by the scientific, algorithmic and developmental novelty that only result in incremental improvements over already algorithms. In this thesis, we propose and demonstrate the implementation and evaluation of several different methodological guidelines that ensure the development of image processing tools --- localization, segmentation and registration --- and illustrate their use across several medical imaging modalities --- X-ray, computed tomography, ultrasound and magnetic resonance imaging --- and several clinical applications: Lung CT image registration in support for assessment of pulmonary nodule growth rate and disease progression from thoracic CT images. Automated reconstruction of standing X-ray panoramas from multi-sector X-ray images for assessment of long limb mechanical axis and knee misalignment. Left and right ventricle localization, segmentation, reconstruction, ejection fraction measurement from cine cardiac MRI or multi-plane trans-esophageal ultrasound images for cardiac function assessment. When devising and evaluating our developed tools, we use clinical patient data to illustrate the inherent clinical challenges associated with highly variable imaging data that need to be addressed before potential pre-clinical validation and implementation. In an effort to provide plausible solutions to the selected applications, the proposed methodological guidelines ensure the development of image processing tools that help achieve sufficiently reliable solutions that not only have the potential to address the clinical needs, but are sufficiently streamlined to be potentially translated into eventual clinical tools provided proper implementation. G1: Reducing the number of degrees of freedom (DOF) of the designed tool, with a plausible example being avoiding the use of inefficient non-rigid image registration methods. This guideline addresses the risk of artificial deformation during registration and it clearly aims at reducing complexity and the number of degrees of freedom. G2: The use of shape-based features to most efficiently represent the image content, either by using edges instead of or in addition to intensities and motion, where useful. Edges capture the most useful information in the image and can be used to identify the most important image features. As a result, this guideline ensures a more robust performance when key image information is missing. G3: Efficient method of implementation. This guideline focuses on efficiency in terms of the minimum number of steps required and avoiding the recalculation of terms that only need to be calculated once in an iterative process. An efficient implementation leads to reduced computational effort and improved performance. G4: Commence the workflow by establishing an optimized initialization and gradually converge toward the final acceptable result. This guideline aims to ensure reasonable outcomes in consistent ways and it avoids convergence to local minima, while gradually ensuring convergence to the global minimum solution. These guidelines lead to the development of interactive, semi-automated or fully-automated approaches that still enable the clinicians to perform final refinements, while they reduce the overall inter- and intra-observer variability, reduce ambiguity, increase accuracy and precision, and have the potential to yield mechanisms that will aid with providing an overall more consistent diagnosis in a timely fashion

    Augmented Image-Guidance for Transcatheter Aortic Valve Implantation

    Get PDF
    The introduction of transcatheter aortic valve implantation (TAVI), an innovative stent-based technique for delivery of a bioprosthetic valve, has resulted in a paradigm shift in treatment options for elderly patients with aortic stenosis. While there have been major advancements in valve design and access routes, TAVI still relies largely on single-plane fluoroscopy for intraoperative navigation and guidance, which provides only gross imaging of anatomical structures. Inadequate imaging leading to suboptimal valve positioning contributes to many of the early complications experienced by TAVI patients, including valve embolism, coronary ostia obstruction, paravalvular leak, heart block, and secondary nephrotoxicity from contrast use. A potential method of providing improved image-guidance for TAVI is to combine the information derived from intra-operative fluoroscopy and TEE with pre-operative CT data. This would allow the 3D anatomy of the aortic root to be visualized along with real-time information about valve and prosthesis motion. The combined information can be visualized as a `merged\u27 image where the different imaging modalities are overlaid upon each other, or as an `augmented\u27 image, where the location of key target features identified on one image are displayed on a different imaging modality. This research develops image registration techniques to bring fluoroscopy, TEE, and CT models into a common coordinate frame with an image processing workflow that is compatible with the TAVI procedure. The techniques are designed to be fast enough to allow for real-time image fusion and visualization during the procedure, with an intra-procedural set-up requiring only a few minutes. TEE to fluoroscopy registration was achieved using a single-perspective TEE probe pose estimation technique. The alignment of CT and TEE images was achieved using custom-designed algorithms to extract aortic root contours from XPlane TEE images, and matching the shape of these contours to a CT-derived surface model. Registration accuracy was assessed on porcine and human images by identifying targets (such as guidewires or coronary ostia) on the different imaging modalities and measuring the correspondence of these targets after registration. The merged images demonstrated good visual alignment of aortic root structures, and quantitative assessment measured an accuracy of less than 1.5mm error for TEE-fluoroscopy registration and less than 6mm error for CT-TEE registration. These results suggest that the image processing techniques presented have potential for development into a clinical tool to guide TAVI. Such a tool could potentially reduce TAVI complications, reducing morbidity and mortality and allowing for a safer procedure

    Computer integrated system: medical imaging & visualization

    Get PDF
    The intent of this book’s conception is to present research work using a user centered design approach. Due to space constraints, the story of the journey, included in this book is relatively brief. However we believe that it manages to adequately represent the story of the journey, from its humble beginnings in 2008 to the point where it visualizes future trends amongst both researchers and practitioners across the Computer Science and Medical disciplines. This book aims not only to present a representative sampling of real-world collaboration between said disciplines but also to provide insights into the different aspects related to the use of real-world Computer Assisted Medical applications. Readers and potential clients should find the information particularly useful in analyzing the benefits of collaboration between these two fields, the products in and of their institutions. The work discussed here is a compilation of the work of several PhD students under my supervision, who have since graduated and produced several publications either in journals or proceedings of conferences. As their work has been published, this book will be more focused on the research methodology based on medical technology used in their research. The research work presented in this book partially encompasses the work under the MOA for collaborative Research and Development in the field of Computer Assisted Surgery and Diagnostics pertaining to Thoracic and Cardiovascular Diseases between UPM, UKM and IJN, spanning five years beginning from 15 Feb 2013

    Augmented reality (AR) for surgical robotic and autonomous systems: State of the art, challenges, and solutions

    Get PDF
    Despite the substantial progress achieved in the development and integration of augmented reality (AR) in surgical robotic and autonomous systems (RAS), the center of focus in most devices remains on improving end-effector dexterity and precision, as well as improved access to minimally invasive surgeries. This paper aims to provide a systematic review of different types of state-of-the-art surgical robotic platforms while identifying areas for technological improvement. We associate specific control features, such as haptic feedback, sensory stimuli, and human-robot collaboration, with AR technology to perform complex surgical interventions for increased user perception of the augmented world. Current researchers in the field have, for long, faced innumerable issues with low accuracy in tool placement around complex trajectories, pose estimation, and difficulty in depth perception during two-dimensional medical imaging. A number of robots described in this review, such as Novarad and SpineAssist, are analyzed in terms of their hardware features, computer vision systems (such as deep learning algorithms), and the clinical relevance of the literature. We attempt to outline the shortcomings in current optimization algorithms for surgical robots (such as YOLO and LTSM) whilst providing mitigating solutions to internal tool-to-organ collision detection and image reconstruction. The accuracy of results in robot end-effector collisions and reduced occlusion remain promising within the scope of our research, validating the propositions made for the surgical clearance of ever-expanding AR technology in the future

    DYNAMIC MEASUREMENT OF THREE-DIMENSIONAL MOTION FROM SINGLE-PERSPECTIVE TWO-DIMENSIONAL RADIOGRAPHIC PROJECTIONS

    Get PDF
    The digital evolution of the x-ray imaging modality has spurred the development of numerous clinical and research tools. This work focuses on the design, development, and validation of dynamic radiographic imaging and registration techniques to address two distinct medical applications: tracking during image-guided interventions, and the measurement of musculoskeletal joint kinematics. Fluoroscopy is widely employed to provide intra-procedural image-guidance. However, its planar images provide limited information about the location of surgical tools and targets in three-dimensional space. To address this limitation, registration techniques, which extract three-dimensional tracking and image-guidance information from planar images, were developed and validated in vitro. The ability to accurately measure joint kinematics in vivo is an important tool in studying both normal joint function and pathologies associated with injury and disease, however it still remains a clinical challenge. A technique to measure joint kinematics from single-perspective x-ray projections was developed and validated in vitro, using clinically available radiography equipmen

    Analysis of first pass myocardial perfusion imaging with magnetic resonance

    Get PDF
    Early diagnosis and localisation of myocardial perfusion defects is an important step in the treatment of coronary artery disease. Thus far, coronary angiography is the conventional standard investigation for patients with known or suspected coronary artery disease and it provides information about the presence and location of coronary stenoses. In recent years, the development of myocardial perfusion CMR has extended the role of MR in the evaluation of ischaemic heart disease beyond the situations where there have already been gross myocardial changes such as acute infarction or scarring. The ability to non-invasively evaluate cardiac perfusion abnormalities before pathologic effects occur, or as follow-up to therapy, is important to the management of patients with coronary artery disease. Whilst limited multi-slice 2D CMR perfusion studies are gaining increased clinical usage for quantifying gross ischaemic burden, research is now directed towards complete 3D coverage of the myocardium for accurate localisation of the extent of possible defects. In 3D myocardial perfusion imaging, a complete volumetric data set has to be acquired for each cardiac cycle in order to study the first pass of the contrast bolus. This normally requires a relatively large acquisition window within each cardiac cycle to ensure a comprehensive coverage of the myocardium and reasonably high resolution of the images. With multi-slice imaging, long axis cardiac motion during this large acquisition window can cause the myocardium imaged in different cross- sections to be mis-registered, i.e., some part of the myocardium may be imaged more than twice whereas other parts may be missed out completely. This type of mis-registration is difficult to correct for by using post-processing techniques. The purpose of this thesis is to investigate techniques for tracking through plane motion during 3D myocardial perfusion imaging, and a novel technique for extracting intrinsic relationships between 3D cardiac deformation due to respiration and multiple ID real-time measurable surface intensity traces is developed. Despite the fact that these surface intensity traces can be strongly coupled with each other but poorly correlated with respiratory induced cardiac deformation, we demonstrate how they can be used to accurately predict cardiac motion through the extraction of latent variables of both the input and output of the model. The proposed method allows cross-modality reconstruction of patient specific models for dense motion field prediction, which after initial modelling can be use in real-time prospective motion tracking or correction. In CMR, new imaging sequences have significantly reduced the acquisition window whilst maintaining the desired spatial resolution. Further improvements in perfusion imaging will require the application of parallel imaging techniques or making full use of the information content of the ¿-space data. With this thesis, we have proposed RR-UNFOLD and RR-RIGR for significantly reducing the amount of data that is required to reconstruct the perfusion image series. The methods use prospective diaphragmatic navigator echoes to ensure UNFOLD and RIGR are carried out on a series of images that are spatially registered. An adaptive real-time re-binning algorithm is developed for the creation of static image sub-series related to different levels of respiratory motion. Issues concerning temporal smoothing of tracer kinetic signals and residual motion artefact are discussed, and we have provided a critical comparison of the relative merit and potential pitfalls of the two techniques. In addition to the technical and theoretical descriptions of the new methods developed, we have also provided in this thesis a detailed literature review of the current state-of-the-art in myocardial perfusion imaging and some of the key technical challenges involved. Issues concerning the basic background of myocardial ischaemia and its functional significance are discussed. Practical solutions to motion tracking during imaging, predictive motion modelling, tracer kinetic modelling, RR-UNFOLD and RR-RIGR are discussed, all with validation using patient and normal subject data to demonstrate both the strength and potential clinical value of the proposed techniques.Open acces

    Computer-Assisted Electroanatomical Guidance for Cardiac Electrophysiology Procedures

    Get PDF
    Cardiac arrhythmias are serious life-threatening episodes affecting both the aging population and younger patients with pre-existing heart conditions. One of the most effective therapeutic procedures is the minimally-invasive catheter-driven endovascular electrophysiology study, whereby electrical potentials and activation patterns in the affected cardiac chambers are measured and subsequent ablation of arrhythmogenic tissue is performed. Despite emerging technologies such as electroanatomical mapping and remote intraoperative navigation systems for improved catheter manipulation and stability, successful ablation of arrhythmias is still highly-dependent on the operator’s skills and experience. This thesis proposes a framework towards standardisation in the electroanatomical mapping and ablation planning by merging knowledge transfer from previous cases and patient-specific data. In particular, contributions towards four different procedural aspects were made: optimal electroanatomical mapping, arrhythmia path computation, catheter tip stability analysis, and ablation simulation and optimisation. In order to improve the intraoperative electroanatomical map, anatomical areas of high mapping interest were proposed, as learned from previous electrophysiology studies. Subsequently, the arrhythmic wave propagation on the endocardial surface and potential ablation points were computed. The ablation planning is further enhanced, firstly by the analysis of the catheter tip stability and the probability of slippage at sparse locations on the endocardium and, secondly, by the simulation of the ablation result from the computation of convolutional matrices which model mathematically the ablation process. The methods proposed by this thesis were validated on data from patients with complex congenital heart disease, who present unusual cardiac anatomy and consequently atypical arrhythmias. The proposed methods also build a generic framework for computer guidance of electrophysiology, with results showing complementary information that can be easily integrated into the clinical workflow.Open Acces

    Exploiting Temporal Image Information in Minimally Invasive Surgery

    Get PDF
    Minimally invasive procedures rely on medical imaging instead of the surgeons direct vision. While preoperative images can be used for surgical planning and navigation, once the surgeon arrives at the target site real-time intraoperative imaging is needed. However, acquiring and interpreting these images can be challenging and much of the rich temporal information present in these images is not visible. The goal of this thesis is to improve image guidance for minimally invasive surgery in two main areas. First, by showing how high-quality ultrasound video can be obtained by integrating an ultrasound transducer directly into delivery devices for beating heart valve surgery. Secondly, by extracting hidden temporal information through video processing methods to help the surgeon localize important anatomical structures. Prototypes of delivery tools, with integrated ultrasound imaging, were developed for both transcatheter aortic valve implantation and mitral valve repair. These tools provided an on-site view that shows the tool-tissue interactions during valve repair. Additionally, augmented reality environments were used to add more anatomical context that aids in navigation and in interpreting the on-site video. Other procedures can be improved by extracting hidden temporal information from the intraoperative video. In ultrasound guided epidural injections, dural pulsation provides a cue in finding a clear trajectory to the epidural space. By processing the video using extended Kalman filtering, subtle pulsations were automatically detected and visualized in real-time. A statistical framework for analyzing periodicity was developed based on dynamic linear modelling. In addition to detecting dural pulsation in lumbar spine ultrasound, this approach was used to image tissue perfusion in natural video and generate ventilation maps from free-breathing magnetic resonance imaging. A second statistical method, based on spectral analysis of pixel intensity values, allowed blood flow to be detected directly from high-frequency B-mode ultrasound video. Finally, pulsatile cues in endoscopic video were enhanced through Eulerian video magnification to help localize critical vasculature. This approach shows particular promise in identifying the basilar artery in endoscopic third ventriculostomy and the prostatic artery in nerve-sparing prostatectomy. A real-time implementation was developed which processed full-resolution stereoscopic video on the da Vinci Surgical System
    corecore