Preoperative Systems for Computer Aided Diagnosis based on Image Registration: Applications to Breast Cancer and Atherosclerosis

Computer Aided Diagnosis (CAD) systems assist clinicians including radiologists and cardiologists to detect abnormalities and highlight conspicuous possible disease. Implementing a pre-operative CAD system contains a framework that accepts related technical as well as clinical parameters as input by analyzing the predefined method and demonstrates the prospective output. In this work we developed the Computer Aided Diagnostic System for biomedical imaging analysis of two applications on Breast Cancer and Atherosclerosis. The aim of the first CAD application is to optimize the registration strategy specifically for Breast Dynamic Infrared Imaging and to make it user-independent. Base on the fact that automated motion reduction in dynamic infrared imaging is on demand in clinical applications, since movement disarranges time-temperature series of each pixel, thus originating thermal artifacts that might bias the clinical decision. All previously proposed registration methods are feature based algorithms requiring manual intervention. We implemented and evaluated 3 different 3D time-series registration methods: 1. Linear affine, 2. Non-linear Bspline, 3. Demons applied to 12 datasets of healthy breast thermal images. The results are evaluated through normalized mutual information with average values of 0.70±0.03, 0.74±0.03 and 0.81±0.09 (out of 1) for Affine, BSpline and Demons registration, respectively, as well as breast boundary overlap and Jacobian determinant of the deformation field. The statistical analysis of the results showed that symmetric diffeomorphic Demons registration method outperforms also with the best breast alignment and non-negative Jacobian values which guarantee image similarity and anatomical consistency of the transformation, due to homologous forces enforcing the pixel geometric disparities to be shortened on all the frames. We propose Demons registration as an effective technique for time-series dynamic infrared registration, to stabilize the local temperature oscillation. The aim of the second implemented CAD application is to assess contribution of calcification in plaque vulnerability and wall rupture and to find its maximum resistance before break in image-based models of carotid artery stenting. The role of calcification inside fibroatheroma during carotid artery stenting operation is controversial in which cardiologists face two major problems during the placement: (i) “plaque protrusion” (i.e. elastic fibrous caps containing early calcifications that penetrate inside the stent); (ii) “plaque vulnerability” (i.e. stiff plaques with advanced calcifications that break the arterial wall or stent). Finite Element Analysis was used to simulate the balloon and stent expansion as a preoperative patient-specific virtual framework. A nonlinear static structural analysis was performed on 20 patients acquired using in vivo MDCT angiography. The Agatston Calcium score was obtained for each patient and subject-specific local Elastic Modulus (EM) was calculated. The in silico results showed that by imposing average ultimate external load of 1.1MPa and 2.3MPa on balloon and stent respectively, average ultimate stress of 55.7±41.2kPa and 171±41.2kPa are obtained on calcifications. The study reveals that a significant positive correlation (R=0.85, p<0.0001) exists on stent expansion between EM of calcification and ultimate stress as well as Plaque Wall Stress (PWS) (R=0.92, p<0.0001), comparing to Ca score that showed insignificant associations with ultimate stress (R=0.44, p=0.057) and PWS (R=0.38, p=0.103), suggesting minor impact of Ca score in plaque rupture. These average data are in good agreement with results obtained by other research groups and we believe this approach enriches the arsenal of tools available for pre-operative prediction of carotid artery stenting procedure in the presence of calcified plaques

Development and validation of real-time simulation of X-ray imaging with respiratory motion

International audienceWe present a framework that combines evolutionary optimisation, soft tissue modelling and ray tracing on GPU to simultaneously compute the respiratory motion and X-ray imaging in real-time. Our aim is to provide validated building blocks with high fidelity to closely match both the human physiology and the physics of X-rays. A CPU-based set of algorithms is presented to model organ behaviours during respiration. Soft tissue deformation is computed with an extension of the Chain Mail method. Rigid elements move according to kinematic laws. A GPU-based surface rendering method is proposed to compute the X-ray image using the Beer-Lambert law. It is provided as an open-source library. A quantitative validation study is provided to objectively assess the accuracy of both components: i) the respiration against anatomical data, and ii) the X-ray against the Beer-Lambert law and the results of Monte Carlo simulations. Our implementation can be used in various applications, such as interactive medical virtual environment to train percutaneous transhepatic cholangiography in interventional radiology, 2D/3D registration, computation of digitally reconstructed radiograph, simulation of 4D sinograms to test tomography reconstruction tools

Multi-Modality Breast MRI Segmentation Using nn-UNet for Preoperative Planning of Robotic Surgery Navigation

Segmentation of the chest region and breast tissues is essential for surgery planning and navigation. This paper proposes the foundation for preoperative segmentation based on two cascaded architectures of deep neural networks (DNN) based on the state-of-the-art nnU-Net. Additionally, this study introduces a polyvinyl alcohol cryogel (PVA-C) breast phantom based on the segmentation of the DNN automated approach, enabling the experiments of navigation system for robotic breast surgery. Multi-modality breast MRI datasets of T2W and STIR images were acquired from 10 patients. Segmentation evaluation utilized the Dice Similarity Coefficient (DSC), segmentation accuracy, sensitivity, and specificity. First, a single class labeling was used to segment the breast region. Then it was employed as an input for three-class labeling to segment fat, fibroglandular (FGT) tissues, and tumorous lesions. The first architecture has a 0.95 DCS, while the second has a 0.95, 0.83, and 0.41 for fat, FGT, and tumor classes, respectively

Bioengineering Analysis of Traumatic Brain Injury

Traumatic brain injury (TBI) is a serious health concern affecting over a million people in the UK. Brain shift and herniation, which are closely related to severe disability or death, are important signs of abnormally elevated intracranial pressure (ICP) or space-occupying intracranial mass after trauma. This research aims to use medical image computing and biomechanical modelling techniques to characterise the specific deformation field of brain tissues under various TBI scenarios and strengthen the biomechanical understanding across the full spectrum of TBI. Medical image computing provides the research with a solid clinical grounding. To better interpret the neuro-images, three computational tools have been developed, including a CT preprocessing pipeline, an automatic mid-sagittal plane detector and an automatic brain extractor. Using these tools, a novel concept of midplane shift (MPS) is developed to quantitatively evaluate the brain herniation condition across the mid-sagittal plane. In the meantime, a lesion heatmap is generated to quantify the asymmetric haematoma volumes across the mid-sagittal plane. The MPS heatmaps generated for 33 TBI patients with heterogeneous brain pathologies demonstrate highly similar shift patterns. Together with the lesion heatmap, a brain deformation mechanism has been presented: the brain will not deform randomly in response to trauma, instead, it will only deform in a regulated mechanism so that the deformation is directed and restricted to the soft ventricular region, thanks to the anatomic structures of the head such as the falx. The MPS heatmap, the lesion heatmap, together with the novel CT parameters derived from them, provide a rich abundance of information on intracranial brain herniation, for a more complete overview of TBI from medical images. Biomechanical modelling, being one of the most important tools in trauma biomechanics, has been used to quantitatively simulate the brain shift and herniation condition caused by various intracranial lesions and increasing ICP. Preliminary finite element models reconstructed from the Virtual Human Project have demonstrated some limitations. To resolve the observed deficiencies, an advanced high-fidelity patient-specific FE brain model is constructed and explicitly assessed to optimise its injury simulation performance with the help of the developed medical image computing tools. During simulation, the patient-specific traumatic injuries have been reconstructed by imposing both the primary lesion and the secondary injury. The primary lesion simulation is achieved mechanically by ``indenting" a rigid lesion surface simulating the shape of the haematoma to the brain model. While the secondary swelling is modelled with a thermal-expansion-based method to simulate the bulging brain. Using this approach, the observed brain herniation can be decomposed into a deformation due to pure mass effect of space-occupying primary lesion and a shift as a result of secondary swelling. The head injuries of six different TBI patients have been reconstructed and simulated using the prescribed method. The realistic case study suggested that the subdural haematoma patients, as compared to the epidural haematoma patients, were exposed to more significant secondary swelling, which agrees well with the historical clinical findings. In addition to the realistic TBI case studies, an idealised traumatic lesion simulation is performed to investigate the role of lesion morphology and the lesion locations of onsets, in brain herniations during TBI. It is suggested by the idealised TBI cases that the brain is more sensitive to lesion that is more concentrated spatially, if lesion volumes and lesion locations were exactly the same. Moreover, in terms of lesion locations, lesions that strikes on the temporal region and the anterior region are more likely to lead to greater brain deformation, if other lesion morphologies were equal and no secondary swelling considered. Ultimately, the developed tools are expected to help clinicians better understand and predict the brain behaviour after the onset of TBI and during subsequent injury evolution.WD Armstrong Trus