Prospects for Theranostics in Neurosurgical Imaging: Empowering Confocal Laser Endomicroscopy Diagnostics via Deep Learning

Confocal laser endomicroscopy (CLE) is an advanced optical fluorescence imaging technology that has the potential to increase intraoperative precision, extend resection, and tailor surgery for malignant invasive brain tumors because of its subcellular dimension resolution. Despite its promising diagnostic potential, interpreting the gray tone fluorescence images can be difficult for untrained users. In this review, we provide a detailed description of bioinformatical analysis methodology of CLE images that begins to assist the neurosurgeon and pathologist to rapidly connect on-the-fly intraoperative imaging, pathology, and surgical observation into a conclusionary system within the concept of theranostics. We present an overview and discuss deep learning models for automatic detection of the diagnostic CLE images and discuss various training regimes and ensemble modeling effect on the power of deep learning predictive models. Two major approaches reviewed in this paper include the models that can automatically classify CLE images into diagnostic/nondiagnostic, glioma/nonglioma, tumor/injury/normal categories and models that can localize histological features on the CLE images using weakly supervised methods. We also briefly review advances in the deep learning approaches used for CLE image analysis in other organs. Significant advances in speed and precision of automated diagnostic frame selection would augment the diagnostic potential of CLE, improve operative workflow and integration into brain tumor surgery. Such technology and bioinformatics analytics lend themselves to improved precision, personalization, and theranostics in brain tumor treatment.Comment: See the final version published in Frontiers in Oncology here: https://www.frontiersin.org/articles/10.3389/fonc.2018.00240/ful

A Three-dimensional Deformable Brain Atlas for DBS Targeting. I. Methodology for Atlas Creation and Artifact Reduction.

BackgroundTargeting in deep brain stimulation (DBS) relies heavily on the ability to accurately localize particular anatomic brain structures. Direct targeting of subcortical structures has been limited by the ability to visualize relevant DBS targets.Methods and resultsIn this work, we describe the development and implementation, of a methodology utilized to create a three dimensional deformable atlas for DBS surgery. This atlas was designed to correspond to the print version of the Schaltenbrand-Bailey atlas structural contours. We employed a smoothing technique to reduce artifacts inherent in the print version.ConclusionsWe present the methodology used to create a three dimensional patient specific DBS atlas which may in the future be tested for clinical utility

3D-printing techniques in a medical setting : a systematic literature review

Background: Three-dimensional (3D) printing has numerous applications and has gained much interest in the medical world. The constantly improving quality of 3D-printing applications has contributed to their increased use on patients. This paper summarizes the literature on surgical 3D-printing applications used on patients, with a focus on reported clinical and economic outcomes. Methods: Three major literature databases were screened for case series (more than three cases described in the same study) and trials of surgical applications of 3D printing in humans. Results: 227 surgical papers were analyzed and summarized using an evidence table. The papers described the use of 3D printing for surgical guides, anatomical models, and custom implants. 3D printing is used in multiple surgical domains, such as orthopedics, maxillofacial surgery, cranial surgery, and spinal surgery. In general, the advantages of 3D-printed parts are said to include reduced surgical time, improved medical outcome, and decreased radiation exposure. The costs of printing and additional scans generally increase the overall cost of the procedure. Conclusion: 3D printing is well integrated in surgical practice and research. Applications vary from anatomical models mainly intended for surgical planning to surgical guides and implants. Our research suggests that there are several advantages to 3D- printed applications, but that further research is needed to determine whether the increased intervention costs can be balanced with the observable advantages of this new technology. There is a need for a formal cost-effectiveness analysis

Implantation of 3D-Printed Patient-Specific Aneurysm Models into Cadaveric Specimens: A New Training Paradigm to Allow for Improvements in Cerebrovascular Surgery and Research.

AimTo evaluate the feasibility of implanting 3D-printed brain aneurysm model in human cadavers and to assess their utility in neurosurgical research, complex case management/planning, and operative training.MethodsTwo 3D-printed aneurysm models, basilar apex and middle cerebral artery, were generated and implanted in four cadaveric specimens. The aneurysms were implanted at the same anatomical region as the modeled patient. Pterional and orbitozygomatic approaches were done on each specimen. The aneurysm implant, manipulation capabilities, and surgical clipping were evaluated.ResultsThe 3D aneurysm models were successfully implanted to the cadaveric specimens' arterial circulation in all cases. The features of the neck in terms of flexibility and its relationship with other arterial branches allowed for the practice of surgical maneuvering characteristic to aneurysm clipping. Furthermore, the relationship of the aneurysm dome with the surrounding structures allowed for better understanding of the aneurysmal local mass effect. Noticeably, all of these observations were done in a realistic environment provided by our customized embalming model for neurosurgical simulation.Conclusion3D aneurysms models implanted in cadaveric specimens may represent an untapped training method for replicating clip technique; for practicing certain approaches to aneurysms specific to a particular patient; and for improving neurosurgical research

Improving utility of brain tumor confocal laser endomicroscopy: objective value assessment and diagnostic frame detection with convolutional neural networks

Confocal laser endomicroscopy (CLE), although capable of obtaining images at cellular resolution during surgery of brain tumors in real time, creates as many non-diagnostic as diagnostic images. Non-useful images are often distorted due to relative motion between probe and brain or blood artifacts. Many images, however, simply lack diagnostic features immediately informative to the physician. Examining all the hundreds or thousands of images from a single case to discriminate diagnostic images from nondiagnostic ones can be tedious. Providing a real-time diagnostic value assessment of images (fast enough to be used during the surgical acquisition process and accurate enough for the pathologist to rely on) to automatically detect diagnostic frames would streamline the analysis of images and filter useful images for the pathologist/surgeon. We sought to automatically classify images as diagnostic or non-diagnostic. AlexNet, a deep-learning architecture, was used in a 4-fold cross validation manner. Our dataset includes 16,795 images (8572 nondiagnostic and 8223 diagnostic) from 74 CLE-aided brain tumor surgery patients. The ground truth for all the images is provided by the pathologist. Average model accuracy on test data was 91% overall (90.79 % accuracy, 90.94 % sensitivity and 90.87 % specificity). To evaluate the model reliability we also performed receiver operating characteristic (ROC) analysis yielding 0.958 average for the area under ROC curve (AUC). These results demonstrate that a deeply trained AlexNet network can achieve a model that reliably and quickly recognizes diagnostic CLE images.Comment: SPIE Medical Imaging: Computer-Aided Diagnosis 201

Robot Autonomy for Surgery

Autonomous surgery involves having surgical tasks performed by a robot operating under its own will, with partial or no human involvement. There are several important advantages of automation in surgery, which include increasing precision of care due to sub-millimeter robot control, real-time utilization of biosignals for interventional care, improvements to surgical efficiency and execution, and computer-aided guidance under various medical imaging and sensing modalities. While these methods may displace some tasks of surgical teams and individual surgeons, they also present new capabilities in interventions that are too difficult or go beyond the skills of a human. In this chapter, we provide an overview of robot autonomy in commercial use and in research, and present some of the challenges faced in developing autonomous surgical robots

Hacia el modelado 3d de tumores cerebrales mediante endoneurosonografía y redes neuronales

Las cirugías mínimamente invasivas se han vuelto populares debido a que implican menos riesgos con respecto a las intervenciones tradicionales. En neurocirugía, las tendencias recientes sugieren el uso conjunto de la endoscopia y el ultrasonido, técnica llamada endoneurosonografía (ENS), para la virtualización 3D de las estructuras del cerebro en tiempo real. La información ENS se puede utilizar para generar modelos 3D de los tumores del cerebro durante la cirugía. En este trabajo, presentamos una metodología para el modelado 3D de tumores cerebrales con ENS y redes neuronales. Específicamente, se estudió el uso de mapas auto-organizados (SOM) y de redes neuronales tipo gas (NGN). En comparación con otras técnicas, el modelado 3D usando redes neuronales ofrece ventajas debido a que la morfología del tumor se codifica directamente sobre los pesos sinápticos de la red, no requiere ningún conocimiento a priori y la representación puede ser desarrollada en dos etapas: entrenamiento fuera de línea y adaptación en línea. Se realizan pruebas experimentales con maniquíes médicos de tumores cerebrales. Al final del documento, se presentan los resultados del modelado 3D a partir de una base de datos ENS.Minimally invasive surgeries have become popular because they reduce the typical risks of traditional interventions. In neurosurgery, recent trends suggest the combined use of endoscopy and ultrasound (endoneurosonography or ENS) for 3D virtualization of brain structures in real time. The ENS information can be used to generate 3D models of brain tumors during a surgery. This paper introduces a methodology for 3D modeling of brain tumors using ENS and unsupervised neural networks. The use of self-organizing maps (SOM) and neural gas networks (NGN) is particularly studied. Compared to other techniques, 3D modeling using neural networks offers advantages, since tumor morphology is directly encoded in synaptic weights of the network, no a priori knowledge is required, and the representation can be developed in two stages: off-line training and on-line adaptation. Experimental tests were performed using virtualized phantom brain tumors. At the end of the paper, the results of 3D modeling from an ENS database are presented

Prevalence of haptic feedback in robot-mediated surgery : a systematic review of literature

© 2017 Springer-Verlag. This is a post-peer-review, pre-copyedit version of an article published in Journal of Robotic Surgery. The final authenticated version is available online at: https://doi.org/10.1007/s11701-017-0763-4With the successful uptake and inclusion of robotic systems in minimally invasive surgery and with the increasing application of robotic surgery (RS) in numerous surgical specialities worldwide, there is now a need to develop and enhance the technology further. One such improvement is the implementation and amalgamation of haptic feedback technology into RS which will permit the operating surgeon on the console to receive haptic information on the type of tissue being operated on. The main advantage of using this is to allow the operating surgeon to feel and control the amount of force applied to different tissues during surgery thus minimising the risk of tissue damage due to both the direct and indirect effects of excessive tissue force or tension being applied during RS. We performed a two-rater systematic review to identify the latest developments and potential avenues of improving technology in the application and implementation of haptic feedback technology to the operating surgeon on the console during RS. This review provides a summary of technological enhancements in RS, considering different stages of work, from proof of concept to cadaver tissue testing, surgery in animals, and finally real implementation in surgical practice. We identify that at the time of this review, while there is a unanimous agreement regarding need for haptic and tactile feedback, there are no solutions or products available that address this need. There is a scope and need for new developments in haptic augmentation for robot-mediated surgery with the aim of improving patient care and robotic surgical technology further.Peer reviewe