337 research outputs found

    Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery

    Get PDF
    One of the main challenges for computer-assisted surgery (CAS) is to determine the intra-opera- tive morphology and motion of soft-tissues. This information is prerequisite to the registration of multi-modal patient-specific data for enhancing the surgeon’s navigation capabilites by observ- ing beyond exposed tissue surfaces and for providing intelligent control of robotic-assisted in- struments. In minimally invasive surgery (MIS), optical techniques are an increasingly attractive approach for in vivo 3D reconstruction of the soft-tissue surface geometry. This paper reviews the state-of-the-art methods for optical intra-operative 3D reconstruction in laparoscopic surgery and discusses the technical challenges and future perspectives towards clinical translation. With the recent paradigm shift of surgical practice towards MIS and new developments in 3D opti- cal imaging, this is a timely discussion about technologies that could facilitate complex CAS procedures in dynamic and deformable anatomical regions

    Probe-based Rapid Hybrid Hyperspectral and Tissue Surface Imaging Aided by Fully Convolutional Networks

    Get PDF
    Tissue surface shape and reflectance spectra provide rich intra-operative information useful in surgical guidance. We propose a hybrid system which displays an endoscopic image with a fast joint inspection of tissue surface shape using structured light (SL) and hyperspectral imaging (HSI). For SL a miniature fibre probe is used to project a coloured spot pattern onto the tissue surface. In HSI mode standard endoscopic illumination is used, with the fibre probe collecting reflected light and encoding the spatial information into a linear format that can be imaged onto the slit of a spectrograph. Correspondence between the arrangement of fibres at the distal and proximal ends of the bundle was found using spectral encoding. Then during pattern decoding, a fully convolutional network (FCN) was used for spot detection, followed by a matching propagation algorithm for spot identification. This method enabled fast reconstruction (12 frames per second) using a GPU. The hyperspectral image was combined with the white light image and the reconstructed surface, showing the spectral information of different areas. Validation of this system using phantom and ex vivo experiments has been demonstrated.Comment: This paper has been submitted to MICCAI2016 on 17 March, 2016, and conditionally accepted on 2 June, 201

    Multispectral imaging of organ viability during uterine transplantation surgery in rabbits and sheep

    Get PDF
    Uterine transplantation surgery (UTx) has been proposed as a treatment for permanent absolute uterine factor infertility (AUFI) in the case of the congenital absence or surgical removal of the uterus. Successful surgical attachment of the organ and its associated vasculature is essential for the organ’s reperfusion and long-term viability. Spectral imaging techniques have demonstrated the potential for the measurement of hemodynamics in medical applications. These involve the measurement of reflectance spectra by acquiring images of the tissue in different wavebands. Measures of tissue constituents at each pixel can then be extracted from these spectra through modeling of the light–tissue interaction. A multispectral imaging (MSI) laparoscope was used in sheep and rabbit UTx models to study short- and long-term changes in oxygen saturation following surgery. The whole organ was imaged in the donor and recipient animals in parallel with point measurements from a pulse oximeter. Imaging results confirmed the re-establishment of adequate perfusion in the transplanted organ after surgery. Cornual oxygenation trends measured with MSI are consistent with pulse oximeter readings, showing decreased StO2 immediately after anastomosis of the blood vessels. Long-term results show recovery of StO2 to preoperative levels

    Multiscale Functional and Molecular Photoacoustic Tomography

    Get PDF
    Photoacoustic tomography (PAT) combines rich optical absorption contrast with the high spatial resolution of ultrasound at depths in tissue. The high scalability of PAT has enabled anatomical imaging of biological structures ranging from organelles to organs. The inherent functional and molecular imaging capabilities of PAT have further allowed it to measure important physiological parameters and track critical cellular activities. Integration of PAT with other imaging technologies provides complementary capabilities and can potentially accelerate the clinical translation of PAT

    Real-time tissue viability assessment using near-infrared light

    Get PDF
    Despite significant advances in medical imaging technologies, there currently exist no tools to effectively assist healthcare professionals during surgical procedures. In turn, procedures remain subjective and dependent on experience, resulting in avoidable failure and significant quality of care disparities across hospitals. Optical techniques are gaining popularity in clinical research because they are low cost, non-invasive, portable, and can retrieve both fluorescence and endogenous contrast information, providing physiological information relative to perfusion, oxygenation, metabolism, hydration, and sub-cellular content. Near-infrared (NIR) light is especially well suited for biological tissue and does not cause tissue damage from ionizing radiation or heat. My dissertation has been focused on developing rapid imaging techniques for mapping endogenous tissue constituents to aid surgical guidance. These techniques allow, for the first time, video-rate quantitative acquisition over a large field of view (> 100 cm2) in widefield and endoscopic implementations. The optical system analysis has been focused on the spatial-frequency domain for its ease of quantitative measurements over large fields of view and for its recent development in real-time acquisition, single snapshot of optical properties (SSOP) imaging. Using these methods, this dissertation provides novel improvements and implementations to SSOP, including both widefield and endoscopic instrumentations capable of video-rate acquisition of optical properties and sample surface profile maps. In turn, these measures generate profile-corrected maps of hemoglobin concentration that are highly beneficial for perfusion and overall tissue viability. Also utilizing optical property maps, a novel technique for quantitative fluorescence imaging was also demonstrated, showing large improvement over standard and ratiometric methods. To enable real-time feedback, rapid processing algorithms were designed using lookup tables that provide a 100x improvement in processing speed. Finally, these techniques were demonstrated in vivo to investigate their ability for early detection of tissue failure due to ischemia. Both pre-clinical studies show endogenous contrast imaging can provide early measures of future tissue viability. The goal of this work has been to provide the foundation for real-time imaging systems that provide tissue constituent quantification for tissue viability assessments.2018-01-09T00:00:00

    Surgical spectral imaging

    Get PDF
    Recent technological developments have resulted in the availability of miniaturised spectral imaging sensors capable of operating in the multi- (MSI) and hyperspectral imaging (HSI) regimes. Simultaneous advances in image-processing techniques and artificial intelligence (AI), especially in machine learning and deep learning, have made these data-rich modalities highly attractive as a means of extracting biological information non-destructively. Surgery in particular is poised to benefit from this, as spectrally-resolved tissue optical properties can offer enhanced contrast as well as diagnostic and guidance information during interventions. This is particularly relevant for procedures where inherent contrast is low under standard white light visualisation. This review summarises recent work in surgical spectral imaging (SSI) techniques, taken from Pubmed, Google Scholar and arXiv searches spanning the period 2013–2019. New hardware, optimised for use in both open and minimally-invasive surgery (MIS), is described, and recent commercial activity is summarised. Computational approaches to extract spectral information from conventional colour images are reviewed, as tip-mounted cameras become more commonplace in MIS. Model-based and machine learning methods of data analysis are discussed in addition to simulation, phantom and clinical validation experiments. A wide variety of surgical pilot studies are reported but it is apparent that further work is needed to quantify the clinical value of MSI/HSI. The current trend toward data-driven analysis emphasises the importance of widely-available, standardised spectral imaging datasets, which will aid understanding of variability across organs and patients, and drive clinical translation

    Ultrason Imaging

    Get PDF
    Photoacoustic tomography (PAT) combines rich optical absorption contrast with the high spatial resolution of ultrasound at depths in tissue. The high scalability of PAT has enabled anatomical imaging of biological structures ranging from organelles to organs. The inherent functional and molecular imaging capabilities of PAT have further allowed it to measure important physiological parameters and track critical cellular activities. Integration of PAT with other imaging technologies provides complementary capabilities and can potentially accelerate the clinical translation of PAT.DP1 EB016986/EB/NIBIB NIH HHS/United StatesR01 CA186567/CA/NCI NIH HHS/United StatesU01 NS090579/NS/NINDS NIH HHS/United StatesDP1 EB016986/DP/NCCDPHP CDC HHS/United States2016-01-01T00:00:00Z25933617PMC462890
    • …
    corecore