Improving utility of brain tumor confocal laser endomicroscopy: objective value assessment and diagnostic frame detection with convolutional neural networks

Confocal laser endomicroscopy (CLE), although capable of obtaining images at cellular resolution during surgery of brain tumors in real time, creates as many non-diagnostic as diagnostic images. Non-useful images are often distorted due to relative motion between probe and brain or blood artifacts. Many images, however, simply lack diagnostic features immediately informative to the physician. Examining all the hundreds or thousands of images from a single case to discriminate diagnostic images from nondiagnostic ones can be tedious. Providing a real-time diagnostic value assessment of images (fast enough to be used during the surgical acquisition process and accurate enough for the pathologist to rely on) to automatically detect diagnostic frames would streamline the analysis of images and filter useful images for the pathologist/surgeon. We sought to automatically classify images as diagnostic or non-diagnostic. AlexNet, a deep-learning architecture, was used in a 4-fold cross validation manner. Our dataset includes 16,795 images (8572 nondiagnostic and 8223 diagnostic) from 74 CLE-aided brain tumor surgery patients. The ground truth for all the images is provided by the pathologist. Average model accuracy on test data was 91% overall (90.79 % accuracy, 90.94 % sensitivity and 90.87 % specificity). To evaluate the model reliability we also performed receiver operating characteristic (ROC) analysis yielding 0.958 average for the area under ROC curve (AUC). These results demonstrate that a deeply trained AlexNet network can achieve a model that reliably and quickly recognizes diagnostic CLE images.Comment: SPIE Medical Imaging: Computer-Aided Diagnosis 201

In vivo measurement of human brain elasticity using a light aspiration device

The brain deformation that occurs during neurosurgery is a serious issue impacting the patient "safety" as well as the invasiveness of the brain surgery. Model-driven compensation is a realistic and efficient solution to solve this problem. However, a vital issue is the lack of reliable and easily obtainable patient-specific mechanical characteristics of the brain which, according to clinicians' experience, can vary considerably. We designed an aspiration device that is able to meet the very rigorous sterilization and handling process imposed during surgery, and especially neurosurgery. The device, which has no electronic component, is simple, light and can be considered as an ancillary instrument. The deformation of the aspirated tissue is imaged via a mirror using an external camera. This paper describes the experimental setup as well as its use during a specific neurosurgery. The experimental data was used to calibrate a continuous model. We show that we were able to extract an in vivo constitutive law of the brain elasticity: thus for the first time, measurements are carried out per-operatively on the patient, just before the resection of the brain parenchyma. This paper discloses the results of a difficult experiment and provide for the first time in-vivo data on human brain elasticity. The results point out the softness as well as the highly non-linear behavior of the brain tissue.Comment: Medical Image Analysis (2009) accept\'

Intraoperative detection of blood vessels with an imaging needle during neurosurgery in humans

Intracranial hemorrhage can be a devastating complication associated with needle biopsies of the brain. Hemorrhage can occur to vessels located adjacent to the biopsy needle as tissue is aspirated into the needle and removed. No intraoperative technology exists to reliably identify blood vessels that are at risk of damage. To address this problem, we developed an “imaging needle” that can visualize nearby blood vessels in real time. The imaging needle contains a miniaturized optical coherence tomography probe that allows differentiation of blood flow and tissue. In 11 patients, we were able to intraoperatively detect blood vessels (diameter, \u3e500 μm) with a sensitivity of 91.2% and a specificity of 97.7%. This is the first reported use of an optical coherence tomography needle probe in human brain in vivo. These results suggest that imaging needles may serve as a valuable tool in a range of neurosurgical needle interventions

A comparison of resting state functional magnetic resonance imaging to invasive electrocortical stimulation for sensorimotor mapping in pediatric patients

Localizing neurologic function within the brain remains a significant challenge in clinical neurosurgery. Invasive mapping with direct electrocortical stimulation currently is the clinical gold standard but is impractical in young or cognitively delayed patients who are unable to reliably perform tasks. Resting state functional magnetic resonance imaging non-invasively identifies resting state networks without the need for task performance, hence, is well suited to pediatric patients. We compared sensorimotor network localization by resting state fMRI to cortical stimulation sensory and motor mapping in 16 pediatric patients aged 3.1 to 18.6 years. All had medically refractory epilepsy that required invasive electrographic monitoring and stimulation mapping. The resting state fMRI data were analyzed using a previously trained machine learning classifier that has previously been evaluated in adults. We report comparable functional localization by resting state fMRI compared to stimulation mapping. These results provide strong evidence for the utility of resting state functional imaging in the localization of sensorimotor cortex across a wide range of pediatric patients

Recent trends, technical concepts and components of computer-assisted orthopedic surgery systems: A comprehensive review

Computer-assisted orthopedic surgery (CAOS) systems have become one of the most important and challenging types of system in clinical orthopedics, as they enable precise treatment of musculoskeletal diseases, employing modern clinical navigation systems and surgical tools. This paper brings a comprehensive review of recent trends and possibilities of CAOS systems. There are three types of the surgical planning systems, including: systems based on the volumetric images (computer tomography (CT), magnetic resonance imaging (MRI) or ultrasound images), further systems utilize either 2D or 3D fluoroscopic images, and the last one utilizes the kinetic information about the joints and morphological information about the target bones. This complex review is focused on three fundamental aspects of CAOS systems: their essential components, types of CAOS systems, and mechanical tools used in CAOS systems. In this review, we also outline the possibilities for using ultrasound computer-assisted orthopedic surgery (UCAOS) systems as an alternative to conventionally used CAOS systems.Web of Science1923art. no. 519

Dynamic Thermal Imaging for Intraoperative Monitoring of Neuronal Activity and Cortical Perfusion

Neurosurgery is a demanding medical discipline that requires a complex interplay of several neuroimaging techniques. This allows structural as well as functional information to be recovered and then visualized to the surgeon. In the case of tumor resections this approach allows more fine-grained differentiation of healthy and pathological tissue which positively influences the postoperative outcome as well as the patient's quality of life. In this work, we will discuss several approaches to establish thermal imaging as a novel neuroimaging technique to primarily visualize neural activity and perfusion state in case of ischaemic stroke. Both applications require novel methods for data-preprocessing, visualization, pattern recognition as well as regression analysis of intraoperative thermal imaging. Online multimodal integration of preoperative and intraoperative data is accomplished by a 2D-3D image registration and image fusion framework with an average accuracy of 2.46 mm. In navigated surgeries, the proposed framework generally provides all necessary tools to project intraoperative 2D imaging data onto preoperative 3D volumetric datasets like 3D MR or CT imaging. Additionally, a fast machine learning framework for the recognition of cortical NaCl rinsings will be discussed throughout this thesis. Hereby, the standardized quantification of tissue perfusion by means of an approximated heating model can be achieved. Classifying the parameters of these models yields a map of connected areas, for which we have shown that these areas correlate with the demarcation caused by an ischaemic stroke segmented in postoperative CT datasets. Finally, a semiparametric regression model has been developed for intraoperative neural activity monitoring of the somatosensory cortex by somatosensory evoked potentials. These results were correlated with neural activity of optical imaging. We found that thermal imaging yields comparable results, yet doesn't share the limitations of optical imaging. In this thesis we would like to emphasize that thermal imaging depicts a novel and valid tool for both intraoperative functional and structural neuroimaging

Improving language mapping in clinical fMRI through assessment of grammar.

IntroductionBrain surgery in the language dominant hemisphere remains challenging due to unintended post-surgical language deficits, despite using pre-surgical functional magnetic resonance (fMRI) and intraoperative cortical stimulation. Moreover, patients are often recommended not to undergo surgery if the accompanying risk to language appears to be too high. While standard fMRI language mapping protocols may have relatively good predictive value at the group level, they remain sub-optimal on an individual level. The standard tests used typically assess lexico-semantic aspects of language, and they do not accurately reflect the complexity of language either in comprehension or production at the sentence level. Among patients who had left hemisphere language dominance we assessed which tests are best at activating language areas in the brain.MethodWe compared grammar tests (items testing word order in actives and passives, wh-subject and object questions, relativized subject and object clauses and past tense marking) with standard tests (object naming, auditory and visual responsive naming), using pre-operative fMRI. Twenty-five surgical candidates (13 females) participated in this study. Sixteen patients presented with a brain tumor, and nine with epilepsy. All participants underwent two pre-operative fMRI protocols: one including CYCLE-N grammar tests (items testing word order in actives and passives, wh-subject and object questions, relativized subject and object clauses and past tense marking); and a second one with standard fMRI tests (object naming, auditory and visual responsive naming). fMRI activations during performance in both protocols were compared at the group level, as well as in individual candidates.ResultsThe grammar tests generated more volume of activation in the left hemisphere (left/right angular gyrus, right anterior/posterior superior temporal gyrus) and identified additional language regions not shown by the standard tests (e.g., left anterior/posterior supramarginal gyrus). The standard tests produced more activation in left BA 47. Ten participants had more robust activations in the left hemisphere in the grammar tests and two in the standard tests. The grammar tests also elicited substantial activations in the right hemisphere and thus turned out to be superior at identifying both right and left hemisphere contribution to language processing.ConclusionThe grammar tests may be an important addition to the standard pre-operative fMRI testing