ECoG correlates of visuomotor transformation, neural plasticity, and application to a force-based brain computer interface

Electrocorticography: ECoG) has gained increased notoriety over the past decade as a possible recording modality for Brain-Computer Interface: BCI) applications that offers a balance of minimal invasiveness to the patient in addition to robust spectral information over time. More recently, the scale of ECoG devices has begun to shrink to the order of micrometer diameter contacts and millimeter spacings with the intent of extracting more independent signals for BCI control within less cortical real-estate. However, most control signals to date, whether within the field of ECoG or any of the more seasoned recording techniques, have translated their control signals to kinematic control parameters: i.e. position or velocity of an object) which may not be practical for certain BCI applications such as functional neuromuscular stimulation: FNS). Thus, the purpose of this dissertation was to present a novel application of ECoG signals to a force-based control algorithm and address its feasibility for such a BCI system. Micro-ECoG arrays constructed from thin-film polyimide were implanted epidurally over areas spanning premotor, primary motor, and parietal cortical areas of two monkeys: three hemispheres, three arrays). Monkeys first learned to perform a classic center-out task using a brain signal-to-velocity mapping for control of a computer cursor. The BCI algorithm utilized day-to-day adaptation of the decoding model to match the task intention of the monkeys with no need for pre-screeening of movement-related ECoG signals. Using this strategy, subjects showed notable 2-D task profiency and increased task-related modulation of ECoG features within five training sessions. After fixing the last model trained for velocity control of the cursor, the monkeys then utilized this decoding model to control the acceleration of the cursor in the same center-out task. Cursor movement profiles under this mapping paralleled those demonstrated using velocity control, and neural control signal profiles revealed the monkeys actively accelerated and decelerated the cursor within a limited time window: 1-1.5 seconds). The fixed BCI decoding model was recast once again to control the force on a virtual cursor in a novel mass-grab task. This task required targets not only to reach to peripheral targets but also account for an additional virtual mass as they grabbed each target and moved it to a second target location in the presence of the external force of gravity. Examination of the ensemble control signals showed neural adaptation to variations in the perceived mass of the target as well as the presence or absence of gravity. Finally, short rest periods were interleaved within blocks of each task type to elucidate differences between active BCI intention and rest. Using a post-hoc state-decoder model, periods of active BCI task control could be distinguished from periods of rest with a very high degree of accuracy: ~99%). Taken together, the results from these experiments present a first step toward the design of a dynamics-based BCI system suitable for FNS applications as well as a framework for implementation of an asyncrhonous ECoG BCI

Mapping Sensorimotor Function and Controlling Upper Limb Neuroprosthetics with Electrocorticography

Electrocorticography (ECoG) occupies a unique intermediate niche between microelectrode recordings of single neurons and recordings of whole brain activity via functional magnetic resonance imaging (fMRI). ECoG’s combination of high temporal resolution and wide area coverage make it an ideal modality for both functional brain mapping and brain-machine interface (BMI) for control of prosthetic devices. This thesis demonstrates the utility of ECoG, particularly in high gamma frequencies (70-120 Hz), for passive online mapping of language and motor behaviors, online control of reaching and grasping of an advanced robotic upper limb, and mapping somatosensory digit representations in the postcentral gyrus. The dissertation begins with a brief discussion of the framework for neuroprosthetic control developed by the collaboration between Johns Hopkins and JHU Applied Physics Laboratory (JHU/APL). Second, the methodology behind an online spatial-temporal functional mapping (STFM) system is described. Trial-averaged spatiotemporal maps of high gamma activity were computed during a visual naming and a word reading task. The system output is subsequently shown and compared to stimulation mapping. Third, simultaneous and independent ECoG-based control of reaching and grasping is demonstrated with the Modular Prosthetic Limb (MPL). The STFM system was used to identify channels whose high gamma power significantly and selectively increases during either reaching or grasping. Using this technique, two patients were able to rapidly achieve naturalistic control over simple movements by the MPL. Next, high-density ECoG (hdECoG) was used to map the cortical responses to mechanical vibration of the fingertips. High gamma responses exhibited a strong yet overlapping somatotopy that was not well replicated in other frequency bands. These responses are strong enough to be detected in single trials and used to classify the finger being stimulated with over 98% accuracy. Finally, the role of ECoG is discussed for functional mapping and BMI applications. ECoG occupies a unique role among neural recording modalities as a tool for functional mapping, but must prove its value relative to stimulation mapping. For BMI, ECoG lags microelectrode arrays but hdECoG may provide a more robust long-term interface with optimal spacing for sampling relevant cortical representations

Exploiting code-modulating, Visually-Evoked Potentials for fast and flexible control via Brain-Computer Interfaces

Riechmann H. Exploiting code-modulating, Visually-Evoked Potentials for fast and flexible control via Brain-Computer Interfaces. Bielefeld: Universität Bielefeld; 2014