A 3D discrete model of the diaphragm and human trunk

In this paper, a 3D discrete model is presented to model the movements of the trunk during breathing. In this model, objects are represented by physical particles on their contours. A simple notion of force generated by a linear actuator allows the model to create forces on each particle by way of a geometrical attractor. Tissue elasticity and contractility are modeled by local shape memory and muscular fibers attractors. A specific dynamic MRI study was used to build a simple trunk model comprised of by three compartments: lungs, diaphragm and abdomen. This model was registered on the real geometry. Simulation results were compared qualitatively as well as quantitatively to the experimental data, in terms of volume and geometry. A good correlation was obtained between the model and the real data. Thanks to this model, pathology such as hemidiaphragm paralysis can also be simulated.Comment: published in: "Lung Modelling", France (2006

Informative sample generation using class aware generative adversarial networks for classification of chest Xrays

Training robust deep learning (DL) systems for disease detection from medical images is challenging due to limited images covering different disease types and severity. The problem is especially acute, where there is a severe class imbalance. We propose an active learning (AL) framework to select most informative samples for training our model using a Bayesian neural network. Informative samples are then used within a novel class aware generative adversarial network (CAGAN) to generate realistic chest xray images for data augmentation by transferring characteristics from one class label to another. Experiments show our proposed AL framework is able to achieve state-of-the-art performance by using about $35\%$ of the full dataset, thus saving significant time and effort over conventional methods

Impact of Soft Tissue Heterogeneity on Augmented Reality for Liver Surgery

International audienceThis paper presents a method for real-time augmented reality of internal liver structures during minimally invasive hepatic surgery. Vessels and tumors computed from pre-operative CT scans can be overlaid onto the laparoscopic view for surgery guidance. Compared to current methods, our method is able to locate the in-depth positions of the tumors based on partial three-dimensional liver tissue motion using a real-time biomechanical model. This model permits to properly handle the motion of internal structures even in the case of anisotropic or heterogeneous tissues, as it is the case for the liver and many anatomical structures. Experimentations conducted on phantom liver permits to measure the accuracy of the augmentation while real-time augmentation on in vivo human liver during real surgery shows the benefits of such an approach for minimally invasive surgery

Image-guided Simulation of Heterogeneous Tissue Deformation For Augmented Reality during Hepatic Surgery

International audienceThis paper presents a method for real-time augmentation of vas- cular network and tumors during minimally invasive liver surgery. Internal structures computed from pre-operative CT scans can be overlaid onto the laparoscopic view for surgery guidance. Com- pared to state-of-the-art methods, our method uses a real-time biomechanical model to compute a volumetric displacement field from partial three-dimensional liver surface motion. This permits to properly handle the motion of internal structures even in the case of anisotropic or heterogeneous tissues, as it is the case for the liver and many anatomical structures. Real-time augmentation results are presented on in vivo and ex vivo data and illustrate the benefits of such an approach for minimally invasive surgery

Ball-Scale Based Hierarchical Multi-Object Recognition in 3D Medical Images

This paper investigates, using prior shape models and the concept of ball scale (b-scale), ways of automatically recognizing objects in 3D images without performing elaborate searches or optimization. That is, the goal is to place the model in a single shot close to the right pose (position, orientation, and scale) in a given image so that the model boundaries fall in the close vicinity of object boundaries in the image. This is achieved via the following set of key ideas: (a) A semi-automatic way of constructing a multi-object shape model assembly. (b) A novel strategy of encoding, via b-scale, the pose relationship between objects in the training images and their intensity patterns captured in b-scale images. (c) A hierarchical mechanism of positioning the model, in a one-shot way, in a given image from a knowledge of the learnt pose relationship and the b-scale image of the given image to be segmented. The evaluation results on a set of 20 routine clinical abdominal female and male CT data sets indicate the following: (1) Incorporating a large number of objects improves the recognition accuracy dramatically. (2) The recognition algorithm can be thought as a hierarchical framework such that quick replacement of the model assembly is defined as coarse recognition and delineation itself is known as finest recognition. (3) Scale yields useful information about the relationship between the model assembly and any given image such that the recognition results in a placement of the model close to the actual pose without doing any elaborate searches or optimization. (4) Effective object recognition can make delineation most accurate.Comment: This paper was published and presented in SPIE Medical Imaging 201

Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions

In vivo measurement of human brain elasticity using a light aspiration device

The brain deformation that occurs during neurosurgery is a serious issue impacting the patient "safety" as well as the invasiveness of the brain surgery. Model-driven compensation is a realistic and efficient solution to solve this problem. However, a vital issue is the lack of reliable and easily obtainable patient-specific mechanical characteristics of the brain which, according to clinicians' experience, can vary considerably. We designed an aspiration device that is able to meet the very rigorous sterilization and handling process imposed during surgery, and especially neurosurgery. The device, which has no electronic component, is simple, light and can be considered as an ancillary instrument. The deformation of the aspirated tissue is imaged via a mirror using an external camera. This paper describes the experimental setup as well as its use during a specific neurosurgery. The experimental data was used to calibrate a continuous model. We show that we were able to extract an in vivo constitutive law of the brain elasticity: thus for the first time, measurements are carried out per-operatively on the patient, just before the resection of the brain parenchyma. This paper discloses the results of a difficult experiment and provide for the first time in-vivo data on human brain elasticity. The results point out the softness as well as the highly non-linear behavior of the brain tissue.Comment: Medical Image Analysis (2009) accept\'

An End-to-end Deep Learning Approach for Landmark Detection and Matching in Medical Images

Anatomical landmark correspondences in medical images can provide additional guidance information for the alignment of two images, which, in turn, is crucial for many medical applications. However, manual landmark annotation is labor-intensive. Therefore, we propose an end-to-end deep learning approach to automatically detect landmark correspondences in pairs of two-dimensional (2D) images. Our approach consists of a Siamese neural network, which is trained to identify salient locations in images as landmarks and predict matching probabilities for landmark pairs from two different images. We trained our approach on 2D transverse slices from 168 lower abdominal Computed Tomography (CT) scans. We tested the approach on 22,206 pairs of 2D slices with varying levels of intensity, affine, and elastic transformations. The proposed approach finds an average of 639, 466, and 370 landmark matches per image pair for intensity, affine, and elastic transformations, respectively, with spatial matching errors of at most 1 mm. Further, more than 99% of the landmark pairs are within a spatial matching error of 2 mm, 4 mm, and 8 mm for image pairs with intensity, affine, and elastic transformations, respectively. To investigate the utility of our developed approach in a clinical setting, we also tested our approach on pairs of transverse slices selected from follow-up CT scans of three patients. Visual inspection of the results revealed landmark matches in both bony anatomical regions as well as in soft tissues lacking prominent intensity gradients.Comment: SPIE Medical Imaging Conference - 202

Using averaged models from 4D ultrasound strain imaging allows to signifcantly diferentiate local wall strains in calcifed regions of abdominal aortic aneurysms

Abdominal aortic aneurysms are a degenerative disease of the aorta associated with high mortality. To date, in vivo information to characterize the individual elastic properties of the aneurysm wall in terms of rupture risk is lacking. We have used time-resolved 3D ultrasound strain imaging to calculate spatially resolved in-plane strain distributions characterized by mean and local maximum strains, as well as indices of local variations in strains. Likewise, we here present a method to generate averaged models from multiple segmentations. Strains were then calculated for single segmentations and averaged models. After registration with aneurysm geometries based on CT-A imaging, local strains were divided into two groups with and without calcifications and compared. Geometry comparison from both imaging modalities showed good agreement with a root mean squared error of 1.22 ± 0.15 mm and Hausdorff Distance of 5.45 ± 1.56 mm (mean ± sd, respectively). Using averaged models, circumferential strains in areas with calcifications were 23.2 ± 11.7% (mean ± sd) smaller and significantly distinguishable at the 5% level from areas without calcifications. For single segmentations, this was possible only in 50% of cases. The areas without calcifications showed greater heterogeneity, larger maximum strains, and smaller strain ratios when computed by use of the averaged models. Using these averaged models, reliable conclusions can be made about the local elastic properties of individual aneurysm (and long-term observations of their change), rather than just group comparisons. This is an important prerequisite for clinical application and provides qualitatively new information about the change of an abdominal aortic aneurysm in the course of disease progression compared to the diameter criterion