The angular spectrum of the scattering coefficient map reveals subsurface colorectal cancer

Abstract Colorectal cancer diagnosis currently relies on histological detection of endoluminal neoplasia in biopsy specimens. However, clinical visual endoscopy provides no quantitative subsurface cancer information. In this ex vivo study of nine fresh human colon specimens, we report the first use of quantified subsurface scattering coefficient maps acquired by swept-source optical coherence tomography to reveal subsurface abnormities. We generate subsurface scattering coefficient maps with a novel wavelet-based-curve-fitting method that provides significantly improved accuracy. The angular spectra of scattering coefficient maps of normal tissues exhibit a spatial feature distinct from those of abnormal tissues. An angular spectrum index to quantify the differences between the normal and abnormal tissues is derived, and its strength in revealing subsurface cancer in ex vivo samples is statistically analyzed. The study demonstrates that the angular spectrum of the scattering coefficient map can effectively reveal subsurface colorectal cancer and potentially provide a fast and more accurate diagnosis

Two-photon imaging through a multimode fiber

In this work we demonstrate 3D imaging using two-photon excitation through a 20 cm long multimode optical fiber (MMF) of 350 micrometers diameter. The imaging principle is similar to single photon fluorescence through a MMF, except that a focused femtosecond pulse is delivered and scanned over the sample. In our approach, focusing and scanning through the fiber is accomplished by digital phase conjugation using mode selection by time gating with an ultra-fast reference pulse. The excited two-photon emission is collected through the same fiber. We demonstrate depth sectioning by scanning the focused pulse in a 3D volume over a sample consisting of fluorescent beads suspended in a polymer. The achieved resolution is 1 micrometer laterally and 15 micrometers axially. Scanning is performed over an 80x80 micrometers field of view. To our knowledge, this is the first demonstration of high-resolution three-dimensional imaging using two-photon fluorescence through a multimode fiber

Endoscopic Vision Augmentation Using Multiscale Bilateral-Weighted Retinex for Robotic Surgery

医疗机器人手术视觉是微创外科手术成功与否的关键所在。由于手术器械医学电子内镜自身内在的局限性，导致了手术视野不清晰、光照不均、多烟雾等诸多问题，使得外科医生无法准确快速感知与识别人体内部器官中的神经血管以及病灶位置等结构信息，这无疑增加了手术风险和手术时间。针对这些手术视觉问题，本论文提出了一种基于双边滤波权重分析的多尺度Retinex模型方法，对达芬奇医疗机器人手术过程中所采集到的病患视频进行处理与分析。经过外科医生对实验结果的主观评价，一致认为该方法能够大幅度地增强手术视野质量；同时客观评价实验结果表明本论文所提出方法优于目前计算机视觉领域内的图像增强与恢复方法。 厦门大学信息科学与技术学院计算机科学系罗雄彪教授为本文第一作者。【Abstract】Endoscopic vision plays a significant role in minimally invasive surgical procedures. The visibility and maintenance of such direct in-situ vision is paramount not only for safety by preventing inadvertent injury, but also to improve precision and reduce operating time. Unfortunately, endoscopic vision is unavoidably degraded due to illumination variations during surgery. This work aims to restore or augment such degraded visualization and quantitatively evaluate it during robotic surgery. A multiscale bilateral-weighted retinex method is proposed to remove non-uniform and highly directional illumination and enhance surgical vision, while an objective noreference image visibility assessment method is defined in terms of sharpness, naturalness, and contrast, to quantitatively and objectively evaluate endoscopic visualization on surgical video sequences. The methods were validated on surgical data, with the experimental results showing that our method outperforms existent retinex approaches. In particular, the combined visibility was improved from 0.81 to 1.06, while three surgeons generally agreed that the results were restored with much better visibility.The authors thank the assistance of Dr. Stephen Pautler for facilitating the data acquisition, Dr. A. Jonathan McLeod and Dr.Uditha Jayarathne for helpful discussions

Developments in molecular and advanced endoscopic imaging in esophageal cancer

Esophageal cancer, including esophageal squamous cell carcinoma (ESCC) and esophageal adenocarcinoma (EAC), shows high incidence and poor prognosis. The early detection and endoscopic treatment of (pre)malignant lesions of esophageal cancer significantly improve disease outcomes of patients. However, the high-definition white-light endoscopy followed by random biopsy is reported with a non-ignorable miss rate. The development of advanced endoscopic techniques, such as fluorescence molecular endoscopy (FME) and endocytoscopy, can aid endoscopists in diagnosing early (pre)malignant lesions in vivo. FME realizes wide-field molecular imaging under endoscopy, which serves as a red flag technique for endoscopists by fluorescently highlighting the disease-specific molecule. In Chapter 3 and 4, we identified suitable target proteins and developed near-infrared fluorescent tracers for FME to detect ESCC and EAC at an early stage. In Chapter 6, we investigated the feasibility of assessing pathological response of EAC patients after neoadjuvant chemoradiotherapy by Bevacizumab-800CW guided FME.Endocytoscopy is a pin-point imaging technique that provides endoscopists with magnified optical cellular morphology and subcellular characteristics, referred to as an optical biopsy. In Chapter 5, we developed a classification criteria, an online training module for clinicians and a computer-aided diagnosis (CAD) algorithm based on in vivo images of fourth-generation endocytoscopy to distinguish dysplastic from non-dysplastic Barrett's esophagus tissue. We further investigated the interaction of this CAD algorithm with the clinicians