A Sparse Intraoperative Data-Driven Biomechanical Model to Compensate for Brain Shift during Neuronavigation

BACKGROUND AND PURPOSE: Intraoperative brain deformation is an important factor compromising the accuracy of image-guided neurosurgery. The purpose of this study was to elucidate the role of a model-updated image in the compensation of intraoperative brain shift. MATERIALS AND METHODS: An FE linear elastic model was built and evaluated in 11 patients with craniotomies. To build this model, we provided a novel model-guided segmentation algorithm. After craniotomy, the sparse intraoperative data (the deformed cortical surface) were tracked by a 3D LRS. The surface deformation, calculated by an extended RPM algorithm, was applied on the FE model as a boundary condition to estimate the entire brain shift. The compensation accuracy of this model was validated by the real-time image data of brain deformation acquired by intraoperative MR imaging. RESULTS: The prediction error of this model ranged from 1.29 to 1.91 mm (mean, 1.62 +/- 0.22 mm), and the compensation accuracy ranged from 62.8% to 81.4% (mean, 69.2 +/- 5.3%). The compensation accuracy on the displacement of subcortical structures was higher than that of deep structures (71.3 +/- 6.1%; 66.8 +/- 5.0%, P \u3c .01). In addition, the compensation accuracy in the group with a horizontal bone window was higher than that in the group with a nonhorizontal bone window (72.0 +/- 5.3%; 65.7 +/- 2.9%, P \u3c .05). CONCLUSIONS: Combined with our novel model-guided segmentation and extended RPM algorithms, this sparse data-driven biomechanical model is expected to be a reliable, efficient, and convenient approach for compensation of intraoperative brain shift in image-guided surgery

Respiratory organ motion in interventional MRI : tracking, guiding and modeling

Respiratory organ motion is one of the major challenges in interventional MRI, particularly in interventions with therapeutic ultrasound in the abdominal region. High-intensity focused ultrasound found an application in interventional MRI for noninvasive treatments of different abnormalities. In order to guide surgical and treatment interventions, organ motion imaging and modeling is commonly required before a treatment start. Accurate tracking of organ motion during various interventional MRI procedures is prerequisite for a successful outcome and safe therapy. In this thesis, an attempt has been made to develop approaches using focused ultrasound which could be used in future clinically for the treatment of abdominal organs, such as the liver and the kidney. Two distinct methods have been presented with its ex vivo and in vivo treatment results. In the first method, an MR-based pencil-beam navigator has been used to track organ motion and provide the motion information for acoustic focal point steering, while in the second approach a hybrid imaging using both ultrasound and magnetic resonance imaging was combined for advanced guiding capabilities. Organ motion modeling and four-dimensional imaging of organ motion is increasingly required before the surgical interventions. However, due to the current safety limitations and hardware restrictions, the MR acquisition of a time-resolved sequence of volumetric images is not possible with high temporal and spatial resolution. A novel multislice acquisition scheme that is based on a two-dimensional navigator, instead of a commonly used pencil-beam navigator, was devised to acquire the data slices and the corresponding navigator simultaneously using a CAIPIRINHA parallel imaging method. The acquisition duration for four-dimensional dataset sampling is reduced compared to the existing approaches, while the image contrast and quality are improved as well. Tracking respiratory organ motion is required in interventional procedures and during MR imaging of moving organs. An MR-based navigator is commonly used, however, it is usually associated with image artifacts, such as signal voids. Spectrally selective navigators can come in handy in cases where the imaging organ is surrounding with an adipose tissue, because it can provide an indirect measure of organ motion. A novel spectrally selective navigator based on a crossed-pair navigator has been developed. Experiments show the advantages of the application of this novel navigator for the volumetric imaging of the liver in vivo, where this navigator was used to gate the gradient-recalled echo sequence

A Neural Model of Visually Guided Steering, Obstacle Avoidance, and Route Selection

A neural model is developed to explain how humans can approach a goal object on foot while steering around obstacles to avoid collisions in a cluttered environment. The model uses optic flow from a 3D virtual reality environment to determine the position of objects based on motion discotinuities, and computes heading direction, or the direction of self-motion, from global optic flow. The cortical representation of heading interacts with the representations of a goal and obstacles such that the goal acts as an attractor of heading, while obstacles act as repellers. In addition the model maintains fixation on the goal object by generating smooth pursuit eye movements. Eye rotations can distort the optic flow field, complicating heading perception, and the model uses extraretinal signals to correct for this distortion and accurately represent heading. The model explains how motion processing mechanisms in cortical areas MT, MST, and VIP can be used to guide steering. The model quantitatively simulates human psychophysical data about visually-guided steering, obstacle avoidance, and route selection.Air Force Office of Scientific Research (F4960-01-1-0397); National Geospatial-Intelligence Agency (NMA201-01-1-2016); National Science Foundation (NSF SBE-0354378); Office of Naval Research (N00014-01-1-0624

The Future of Emotional Harm

Why should tort law treat claims for emotional harm as a second-class citizen? Judicial skepticism about these claims is long entrenched, justified by an amalgam of perceived problems ranging from proof difficulties for causation and the need to constrain fraudulent claims, to the ubiquity of the injury, and a concern about open-ended liability. To address this jumble of justifications, the law has developed a series of duty limitations to curb the claims and preclude them from reaching the jury for individualized analysis. The limited duty approach to emotional harm is maintained by the latest iteration of the Restatement (Third) of Torts. This Article argues that many of the justifications for curtailing this tort have been discredited by scientific developments. In particular, the rapid advances in neuroscience give greater insight into the changes that occur in the brain from emotional harm. Limited duty tests should no longer be used as proxies for validity or justified by the presumed untrustworthiness of the claim. Instead, validity evidence for emotional harm claims—like evidence of physical harm—should be entrusted to juries. This approach will reassert the jury’s role as the traditional factfinder, promote corrective justice and deterrence values, and lead to greater equity for negligent infliction of emotional distress (NIED) claimants. The traditional limitations on tort recovery, including the rules of evidence and causation, are more than adequate to avoid opening the floodgates to emotional distress claims

The Future of Emotional Harm

Why should tort law treat claims for emotional harm as a second-class citizen? Judicial skepticism about these claims is long entrenched, justified by an amalgam of perceived problems ranging from proof difficulties for causation and the need to constrain fraudulent claims, to the ubiquity of the injury, and a concern about open-ended liability. To address this jumble of justifications, the law has developed a series of duty limitations to curb the claims and preclude them from reaching the jury for individualized analysis. The limited duty approach to emotional harm is maintained by the latest iteration of the Restatement (Third) of Torts. This Article argues that many of the justifications for curtailing this tort have been discredited by scientific developments. In particular, the rapid advances in neuroscience give greater insight into the changes that occur in the brain from emotional harm. Limited duty tests should no longer be used as proxies for validity or justified by the presumed untrustworthiness of the claim. Instead, validity evidence for emotional harm claims—like evidence of physical harm—should be entrusted to juries. This approach will reassert the jury’s role as the traditional factfinder, promote corrective justice and deterrence values, and lead to greater equity for negligent infliction of emotional distress (NIED) claimants. The traditional limitations on tort recovery, including the rules of evidence and causation, are more than adequate to avoid opening the floodgates to emotional distress claims

Event-based Vision: A Survey

Event cameras are bio-inspired sensors that differ from conventional frame cameras: Instead of capturing images at a fixed rate, they asynchronously measure per-pixel brightness changes, and output a stream of events that encode the time, location and sign of the brightness changes. Event cameras offer attractive properties compared to traditional cameras: high temporal resolution (in the order of microseconds), very high dynamic range (140 dB vs. 60 dB), low power consumption, and high pixel bandwidth (on the order of kHz) resulting in reduced motion blur. Hence, event cameras have a large potential for robotics and computer vision in challenging scenarios for traditional cameras, such as low-latency, high speed, and high dynamic range. However, novel methods are required to process the unconventional output of these sensors in order to unlock their potential. This paper provides a comprehensive overview of the emerging field of event-based vision, with a focus on the applications and the algorithms developed to unlock the outstanding properties of event cameras. We present event cameras from their working principle, the actual sensors that are available and the tasks that they have been used for, from low-level vision (feature detection and tracking, optic flow, etc.) to high-level vision (reconstruction, segmentation, recognition). We also discuss the techniques developed to process events, including learning-based techniques, as well as specialized processors for these novel sensors, such as spiking neural networks. Additionally, we highlight the challenges that remain to be tackled and the opportunities that lie ahead in the search for a more efficient, bio-inspired way for machines to perceive and interact with the world