Language Mapping in Multilingual Patients: Electrocorticography and Cortical Stimulation During Naming

Multilingual patients pose a unique challenge when planning epilepsy surgery near language cortex because the cortical representations of each language may be distinct. These distinctions may not be evident with routine electrocortical stimulation mapping (ESM). Electrocorticography (ECoG) has recently been used to detect task-related spectral perturbations associated with functional brain activation. We hypothesized that using broadband high gamma augmentation (HGA, 60–150 Hz) as an index of cortical activation, ECoG would complement ESM in discriminating the cortical representations of first (L1) and second (L2) languages. We studied four adult patients for whom English was a second language, in whom subdural electrodes (a total of 358) were implanted to guide epilepsy surgery. Patients underwent ECoG recordings and ESM while performing the same visual object naming task in L1 and L2. In three of four patients, ECoG found sites activated during naming in one language but not the other. These language-specific sites were not identified using ESM. In addition, ECoG HGA was observed at more sites during L2 versus L1 naming in two patients, suggesting that L2 processing required additional cortical resources compared to L1 processing in these individuals. Post-operative language deficits were identified in three patients (one in L2 only). These deficits were predicted by ECoG spectral mapping but not by ESM. These results suggest that pre-surgical mapping should include evaluation of all utilized languages to avoid post-operative functional deficits. Finally, this study suggests that ECoG spectral mapping may potentially complement the results of ESM of language

BCI2000Web and WebFM: Browser-Based Tools for Brain Computer Interfaces and Functional Brain Mapping

BCI2000 has been a popular platform for development of real-time brain computer interfaces (BCIs). Since BCI2000's initial release, web browsers have evolved considerably, enabling rapid development of internet-enabled applications and interactive visualizations. Linking the amplifier abstraction and signal processing native to BCI2000 with the host of technologies and ease of development afforded by modern web browsers could enable a new generation of browser-based BCIs and visualizations. We developed a server and filter module called BCI2000Web providing an HTTP connection capable of escalation into an RFC6455 WebSocket, which enables direct communication between a browser and a BCI2000 distribution in real-time, facilitating a number of novel applications. We also present a JavaScript module, bci2k.js, that allows web developers to create paradigms and visualizations using this interface in an easy-to-use and intuitive manner. To illustrate the utility of BCI2000Web, we demonstrate a browser-based implementation of a real-time electrocorticographic (ECoG) functional mapping suite called WebFM. We also explore how the unique characteristics of our browser-based framework make BCI2000Web an attractive tool for future BCI applications. BCI2000Web leverages the advances of BCI2000 to provide real-time browser-based interactions with human neurophysiological recordings, allowing for web-based BCIs and other applications, including real-time functional brain mapping. Both BCI2000 and WebFM are provided under open source licenses. Enabling a powerful BCI suite to communicate with today's most technologically progressive software empowers a new cohort of developers to engage with BCI technology, and could serve as a platform for internet-enabled BCIs

Keyword Spotting Using Human Electrocorticographic Recordings

Neural keyword spotting could form the basis of a speech brain-computer-interface for menu-navigation if it can be done with low latency and high specificity comparable to the “wake-word” functionality of modern voice-activated AI assistant technologies. This study investigated neural keyword spotting using motor representations of speech via invasively-recorded electrocorticographic signals as a proof-of-concept. Neural matched filters were created from monosyllabic consonant-vowel utterances: one keyword utterance, and 11 similar non-keyword utterances. These filters were used in an analog to the acoustic keyword spotting problem, applied for the first time to neural data. The filter templates were cross-correlated with the neural signal, capturing temporal dynamics of neural activation across cortical sites. Neural vocal activity detection (VAD) was used to identify utterance times and a discriminative classifier was used to determine if these utterances were the keyword or non-keyword speech. Model performance appeared to be highly related to electrode placement and spatial density. Vowel height (/a/ vs /i/) was poorly discriminated in recordings from sensorimotor cortex, but was highly discriminable using neural features from superior temporal gyrus during self-monitoring. The best performing neural keyword detection (5 keyword detections with two false-positives across 60 utterances) and neural VAD (100% sensitivity, ~1 false detection per 10 utterances) came from high-density (2 mm electrode diameter and 5 mm pitch) recordings from ventral sensorimotor cortex, suggesting the spatial fidelity and extent of high-density ECoG arrays may be sufficient for the purpose of speech brain-computer-interfaces

Multi-Regional Adaptation in Human Auditory Association Cortex

In auditory cortex, neural responses decrease with stimulus repetition, known as adaptation. Adaptation is thought to facilitate detection of novel sounds and improve perception in noisy environments. Although it is well established that adaptation occurs in primary auditory cortex, it is not known whether adaptation also occurs in higher auditory areas involved in processing complex sounds, such as speech. Resolving this issue is important for understanding the neural bases of adaptation and to avoid potential post-operative deficits after temporal lobe surgery for treatment of focal epilepsy. Intracranial electrocorticographic recordings were acquired simultaneously from electrodes implanted in primary and association auditory areas of the right (non-dominant) temporal lobe in a patient with complex partial seizures originating from the inferior parietal lobe. Simple and complex sounds were presented in a passive oddball paradigm. We measured changes in single-trial high-gamma power (70–150 Hz) and in regional and inter-regional network-level activity indexed by cross-frequency coupling. Repetitive tones elicited the greatest adaptation and corresponding increases in cross-frequency coupling in primary auditory cortex. Conversely, auditory association cortex showed stronger adaptation for complex sounds, including speech. This first report of multi-regional adaptation in human auditory cortex highlights the role of the non-dominant temporal lobe in suppressing neural responses to repetitive background sounds (noise). These results underscore the clinical utility of functional mapping to avoid potential post-operative deficits including increased listening difficulties in noisy, real-world environments

The neural tides of sleep and consciousness revealed by single-pulse electrical brain stimulation

Wakefulness and sleep arise from global changes in brain physiology that may also govern the flow of neural activity between cortical regions responsible for perceptual processing vs planning and action. To test whether and how the sleep/wake cycle affects the overall propagation of neural activity in large-scale brain networks, we applied single-pulse electrical stimulation (SPES) in patients implanted with intracranial EEG electrodes for epilepsy surgery. SPES elicited cortico-cortical spectral responses at high-gamma frequencies (CCSRHG, 80-150 Hz), which indexes changes in neuronal population firing rates. Using event-related causality analysis (ERC), we found that the overall patterns of neural propagation among sites with CCSRHG were different during wakefulness and different sleep stages. For example, stimulation of frontal lobe elicited greater propagation toward parietal lobe during slow wave sleep than during wakefulness. During REM sleep, we observed a decrease in propagation within frontal lobe, and an increase in propagation within parietal lobe, elicited by frontal and parietal stimulation, respectively. These biases in the directionality of large-scale cortical network dynamics during REM sleep could potentially account for some of the unique experiential aspects of this sleep stage. Together these findings suggest that the regulation of conscious awareness and sleep is associated with differences in the balance of neural propagation across large-scale frontal-parietal networks

Coherence Potentials Encode Simple Human Sensorimotor Behavior

Recent work has shown that large amplitude negative periods in the local field potential (nLFPs) are able to spread in saltatory manner across large distances in the cortex without distortion in their temporal structure forming ‘coherence potentials’. Here we analysed subdural electrocorticographic (ECoG) signals recorded at 59 sites in the sensorimotor cortex in the left hemisphere of a human subject performing a simple visuomotor task (fist clenching and foot dorsiflexion) to understand how coherence potentials arising in the recordings relate to sensorimotor behavior. In all behaviors we found a particular coherence potential (i.e. a cascade of a particular nLFP wave pattern) arose consistently across all trials with temporal specificity. During contrateral fist clenching, but not the foot dorsiflexion or ipsilateral fist clenching, the coherence potential most frequently originated in the hand representation area in the somatosensory cortex during the anticipation and planning periods of the trial, moving to other regions during the actual motor behavior. While these ‘expert’ sites participated more consistently, other sites participated only a small fraction of the time. Furthermore, the timing of the coherence potential at the hand representation area after onset of the cue predicted the timing of motor behavior. We present the hypothesis that coherence potentials encode information relevant for behavior and are generated by the ‘expert’ sites that subsequently broadcast to other sites as a means of ‘sharing knowledge’

Reconstructing Speech from Human Auditory Cortex

Direct brain recordings from neurosurgical patients listening to speech reveal that the acoustic speech signals can be reconstructed from neural activity in auditory cortex

Short-term variations in response distribution to cortical stimulation

Patterns of responses in the cerebral cortex can vary, and are influenced by pre-existing cortical function, but it is not known how rapidly these variations can occur in humans. We investigated how rapidly response patterns to electrical stimulation can vary in intact human brain. We also investigated whether the type of functional change occurring at a given location with stimulation would help predict the distribution of responses elsewhere over the cortex to stimulation at that given location. We did this by studying cortical afterdischarges following electrical stimulation of the cortex in awake humans undergoing evaluations for brain surgery. Response occurrence and location could change within seconds, both nearby to and distant from stimulation sites. Responses might occur at a given location during one trial but not the next. They could occur at electrodes adjacent or not adjacent to those directly stimulated or to other electrodes showing afterdischarges. The likelihood of an afterdischarge at an individual site after stimulation was predicted by spontaneous electroencephalographic activity at that specific site just prior to stimulation, but not by overall cortical activity. When stimulation at a site interrupted motor, sensory or language function, afterdischarges were more likely to occur at other sites where stimulation interrupted similar functions. These results show that widespread dynamic changes in cortical responses can occur in intact cortex within short periods of time, and that the distribution of these responses depends on local brain states and functional brain architecture at the time of stimulation. Similar rapid variations may occur during normal intracortical communication and may underlie changes in the cortical organization of function. Possibly these variations, and the occurrence and distribution of responses to cortical stimulation, could be predicted. If so, interventions such as stimulation might be used to alter spread of epileptogenic activity, accelerate learning or enhance cortical reorganization after brain injury

Spatiotemporal dynamics of word retrieval in speech production revealed by cortical high-frequency band activity.

Word retrieval is core to language production and relies on complementary processes: the rapid activation of lexical and conceptual representations and word selection, which chooses the correct word among semantically related competitors. Lexical and conceptual activation is measured by semantic priming. In contrast, word selection is indexed by semantic interference and is hampered in semantically homogeneous (HOM) contexts. We examined the spatiotemporal dynamics of these complementary processes in a picture naming task with blocks of semantically heterogeneous (HET) or HOM stimuli. We used electrocorticography data obtained from frontal and temporal cortices, permitting detailed spatiotemporal analysis of word retrieval processes. A semantic interference effect was observed with naming latencies longer in HOM versus HET blocks. Cortical response strength as indexed by high-frequency band (HFB) activity (70-150 Hz) amplitude revealed effects linked to lexical-semantic activation and word selection observed in widespread regions of the cortical mantle. Depending on the subsecond timing and cortical region, HFB indexed semantic interference (i.e., more activity in HOM than HET blocks) or semantic priming effects (i.e., more activity in HET than HOM blocks). These effects overlapped in time and space in the left posterior inferior temporal gyrus and the left prefrontal cortex. The data do not support a modular view of word retrieval in speech production but rather support substantial overlap of lexical-semantic activation and word selection mechanisms in the brain