Cortical Dynamics of Language

The human capability for fluent speech profoundly directs inter-personal communication and, by extension, self-expression. Language is lost in millions of people each year due to trauma, stroke, neurodegeneration, and neoplasms with devastating impact to social interaction and quality of life. The following investigations were designed to elucidate the neurobiological foundation of speech production, building towards a universal cognitive model of language in the brain. Understanding the dynamical mechanisms supporting cortical network behavior will significantly advance the understanding of how both focal and disconnection injuries yield neurological deficits, informing the development of therapeutic approaches

MODIFICATION AND EVALUATION OF A BRAIN COMPUTER INTERFACE SYSTEM TO DETECT MOTOR INTENTION

It is widely understood that neurons within the brain produce electrical activity, and electroencephalography—a technique used to measure biopotentials with electrodes placed upon the scalp—has been used to observe it. Today, scientists and engineers work to interface these electrical neural signals with computers and machines through the field of Brain-Computer Interfacing (BCI). BCI systems have the potential to greatly improve the quality of life of physically handicapped individuals by replacing or assisting missing or debilitated motor functions. This research thus aims to further improve the efficacy of the BCI based assistive technologies used to aid physically disabled individuals. This study deals with the testing and modification of a BCI system that uses the alpha and beta bands to detect motor intention by weighing online EEG output against a calibrated threshold

Brain-Switches for Asynchronous Brain−Computer Interfaces: A Systematic Review

A brain–computer interface (BCI) has been extensively studied to develop a novel communication system for disabled people using their brain activities. An asynchronous BCI system is more realistic and practical than a synchronous BCI system, in that, BCI commands can be generated whenever the user wants. However, the relatively low performance of an asynchronous BCI system is problematic because redundant BCI commands are required to correct false-positive operations. To significantly reduce the number of false-positive operations of an asynchronous BCI system, a two-step approach has been proposed using a brain-switch that first determines whether the user wants to use an asynchronous BCI system before the operation of the asynchronous BCI system. This study presents a systematic review of the state-of-the-art brain-switch techniques and future research directions. To this end, we reviewed brain-switch research articles published from 2000 to 2019 in terms of their (a) neuroimaging modality, (b) paradigm, (c) operation algorithm, and (d) performance

Mapping Sensorimotor Function and Controlling Upper Limb Neuroprosthetics with Electrocorticography

Electrocorticography (ECoG) occupies a unique intermediate niche between microelectrode recordings of single neurons and recordings of whole brain activity via functional magnetic resonance imaging (fMRI). ECoG’s combination of high temporal resolution and wide area coverage make it an ideal modality for both functional brain mapping and brain-machine interface (BMI) for control of prosthetic devices. This thesis demonstrates the utility of ECoG, particularly in high gamma frequencies (70-120 Hz), for passive online mapping of language and motor behaviors, online control of reaching and grasping of an advanced robotic upper limb, and mapping somatosensory digit representations in the postcentral gyrus. The dissertation begins with a brief discussion of the framework for neuroprosthetic control developed by the collaboration between Johns Hopkins and JHU Applied Physics Laboratory (JHU/APL). Second, the methodology behind an online spatial-temporal functional mapping (STFM) system is described. Trial-averaged spatiotemporal maps of high gamma activity were computed during a visual naming and a word reading task. The system output is subsequently shown and compared to stimulation mapping. Third, simultaneous and independent ECoG-based control of reaching and grasping is demonstrated with the Modular Prosthetic Limb (MPL). The STFM system was used to identify channels whose high gamma power significantly and selectively increases during either reaching or grasping. Using this technique, two patients were able to rapidly achieve naturalistic control over simple movements by the MPL. Next, high-density ECoG (hdECoG) was used to map the cortical responses to mechanical vibration of the fingertips. High gamma responses exhibited a strong yet overlapping somatotopy that was not well replicated in other frequency bands. These responses are strong enough to be detected in single trials and used to classify the finger being stimulated with over 98% accuracy. Finally, the role of ECoG is discussed for functional mapping and BMI applications. ECoG occupies a unique role among neural recording modalities as a tool for functional mapping, but must prove its value relative to stimulation mapping. For BMI, ECoG lags microelectrode arrays but hdECoG may provide a more robust long-term interface with optimal spacing for sampling relevant cortical representations

State-dependent modulation of cortico-spinal networks

Beta-band rhythm (13-30 Hz) is a dominant oscillatory activity in the sensorimotor system. Numerous studies reported on links between motor performance and the cortical and cortico-spinal beta rhythm. However, these studies report divergent beta-band frequencies and are, additionally, based on differently performed motor-tasks (e.g., motor imagination, muscle contraction, reach, grasp, and attention). This diversity blurs the role of beta in the sensorimotor system. It consequently challenges the development of beta-band activity-dependent stimulation protocols in the sensorimotor system. In this vein, we studied the functional role of beta-band cortico-cortical and cortico-spinal networks during a motor learning task. We studied how the contribution of cortical and spinal beta changes in the course of learning, and how this modulation is affected by afferent feedback to the sensorimotor system. We furthermore researched the relationship to motor performance. Consider that we made our study in the absence of any residual movement to allow our findings to be translated into rehabilitation programs for severely affected stroke patients. This thesis, at first, investigates evoked responses after transcranial magnetic stimulation (TMS). This revealed two different beta-band networks, i.e., in the low and high beta-band reflecting cortical and cortico-spinal activity. We, then, used a broader frequency range in the beta-band to trigger passive opening of the hand (peripheral feedback) or cortical stimulation (cortical feedback). While a unilateral hemispheric increase in cortico-spinal synchronization was observed in the group with peripheral feedback, a bilateral hemispheric increase in cortico-cortical and cortico-spinal synchronization was observed for the group with cortical feedback. An improvement in motor performance was found in the peripheral group only. Additionally, an enhancement in the directed cortico-spinal synchronization from cortex to periphery was observed for the peripheral group. Similar neurophysiological and behavioral changes were observed for stroke patients receiving peripheral feedback. The results 6 suggest two different mechanisms for beta-band activity-dependent protocols depending on the feedback modality. While the peripheral feedback appears to increase the synchronization among neural groups, cortical stimulation appears to recruit dormant neurons and to extend the involved motor network. These findings may provide insights regarding the mechanism behind novel activity-dependent protocols. It also highlights the importance of afferent feedback for motor restoration in beta-band activity-dependent rehabilitation programs

Brain-controlled cycling system for rehabilitation following paraplegia with delay-time prediction

Objective: Robotic rehabilitation systems have been investigated to assist with motor dysfunction recovery in patients with lower-extremity paralysis caused by central nervous system lesions. These systems are intended to provide appropriate sensory feedback associated with locomotion. Appropriate feedback is thought to cause synchronous neuron firing, resulting in the recovery of function. Approach: In this study, we designed and evaluated an ergometric cycling wheelchair, with a brain-machine interface (BMI), that can force the legs to move by including normal stepping speeds and quick responses. Experiments were conducted in five healthy subjects and one patient with spinal cord injury (SCI), who experienced the complete paralysis of the lower limbs. Event-related desynchronization (ERD) in the β band (18‐28 Hz) was used to detect lower-limb motor images. Main results: An ergometer-based BMI system was able to safely and easily force patients to perform leg movements, at a rate of approximately 1.6 seconds/step (19 rpm), with an online accuracy rate of 73.1% for the SCI participant. Mean detection time from the cue to pedaling onset was 0.83±0.31 s Significance: This system can easily and safely maintain a normal walking speed during the experiment and be designed to accommodate the expected delay between the intentional onset and physical movement, to achieve rehabilitation effects for each participant. Similar BMI systems, implemented with rehabilitation systems, may be applicable to a wide range of patients

Development of an Electroencephalography-Based Brain-Computer Interface Supporting Two-Dimensional Cursor Control

This study aims to explore whether human intentions to move or cease to move right and left hands can be decoded from spatiotemporal features in non-invasive electroencephalography (EEG) in order to control a discrete two-dimensional cursor movement for a potential multi-dimensional Brain-Computer interface (BCI). Five naïve subjects performed either sustaining or stopping a motor task with time locking to a predefined time window by using motor execution with physical movement or motor imagery. Spatial filtering, temporal filtering, feature selection and classification methods were explored. The performance of the proposed BCI was evaluated by both offline classification and online two-dimensional cursor control. Event-related desynchronization (ERD) and post-movement event-related synchronization (ERS) were observed on the contralateral hemisphere to the hand moved for both motor execution and motor imagery. Feature analysis showed that EEG beta band activity in the contralateral hemisphere over the motor cortex provided the best detection of either sustained or ceased movement of the right or left hand. The offline classification of four motor tasks (sustain or cease to move right or left hand) provided 10-fold cross-validation accuracy as high as 88% for motor execution and 73% for motor imagery. The subjects participating in experiments with physical movement were able to complete the online game with motor execution at the average accuracy of 85.5±4.65%; Subjects participating in motor imagery study also completed the game successfully. The proposed BCI provides a new practical multi-dimensional method by noninvasive EEG signal associated with human natural behavior, which does not need long-term training

Improving EEG-based driver fatigue classification using sparse-deep belief networks

© 2017 Chai, Ling, San, Naik, Nguyen, Tran, Craig and Nguyen. This paper presents an improvement of classification performance for electroencephalography (EEG)-based driver fatigue classification between fatigue and alert states with the data collected from 43 participants. The system employs autoregressive (AR) modeling as the features extraction algorithm, and sparse-deep belief networks (sparse-DBN) as the classification algorithm. Compared to other classifiers, sparse-DBN is a semi supervised learning method which combines unsupervised learning for modeling features in the pre-training layer and supervised learning for classification in the following layer. The sparsity in sparse-DBN is achieved with a regularization term that penalizes a deviation of the expected activation of hidden units from a fixed low-level prevents the network from overfitting and is able to learn low-level structures as well as high-level structures. For comparison, the artificial neural networks (ANN), Bayesian neural networks (BNN), and original deep belief networks (DBN) classifiers are used. The classification results show that using AR feature extractor and DBN classifiers, the classification performance achieves an improved classification performance with a of sensitivity of 90.8%, a specificity of 90.4%, an accuracy of 90.6%, and an area under the receiver operating curve (AUROC) of 0.94 compared to ANN (sensitivity at 80.8%, specificity at 77.8%, accuracy at 79.3% with AUC-ROC of 0.83) and BNN classifiers (sensitivity at 84.3%, specificity at 83%, accuracy at 83.6% with AUROC of 0.87). Using the sparse-DBN classifier, the classification performance improved further with sensitivity of 93.9%, a specificity of 92.3%, and an accuracy of 93.1% with AUROC of 0.96. Overall, the sparse-DBN classifier improved accuracy by 13.8, 9.5, and 2.5% over ANN, BNN, and DBN classifiers, respectively

Human Ipsilateral Motor Physiology and Neuroprosthetic Applications in Chronic Stroke

Improving the recovery of lost motor function in hemiplegic chronic stroke survivors is a critical need to improve the lives of these patients. Over the last several decades, neuroprosthetic systems have emerged as novel tools with the potential to restore function in a variety of patient populations. While traditional neuroprosthetics have focused on using neural activity contralateral to a moving limb for device control, an alternative control signal may be necessary to develop brain-computer interface (BCI) systems in stroke survivors that suffer damage to the cortical hemisphere contralateral to the affected limb. While movement-related neural activity also occurs in the hemisphere ipsilateral to a moving limb, it is uncertain if these signals can be used within BCI systems. This dissertation examines the motor activity ipsilateral to a moving limb and the potential use of these signals for neuroprosthetic applications in chronic stroke survivors. Patients performed three-dimensional (3D) reaching movements with the arm ipsilateral to an electrocorticography (ECoG) array in order to assess the extent of kinematic information that can be decoded from the cortex ipsilateral to a moving limb. Additionally, patients performed the same task with the arm contralateral to the same ECoG arrays, allowing us to compare the neural representations of contralateral and ipsilateral limb movements. While spectral power changes related to ipsilateral arm movements begin later and are lower in amplitude than power changes related to contralateral arm movements, 3D kinematics from both contralateral and ipsilateral arm trajectories can be decoded with similar accuracies. The ability to decode movement kinematics from the ipsilateral cortical hemisphere demonstrates the potential to use these signals within BCI applications for controlling multiple degrees of freedom. Next we examined the relationship between electrode invasiveness and signal quality. The ability to decode movement kinematics from neural activity was significantly decreased in simulated electroencephalography (EEG) signals relative to ECoG signals, indicating that invasive signals would be necessary to implement BCI systems with multiple degrees of freedom. For ECoG signals, the human dura also causes a significant decrease in signal quality when electrodes with small spatial sizes are used. This tradeoff between signal quality and electrode invasiveness should therefore be taken into account when designing ECoG BCI systems. Finally, chronic stroke survivors used activity associated with affected hand motor intentions, recorded from their unaffected hemisphere using EEG, to control simple BCI systems. This demonstrates that motor signals from the ipsilateral hemisphere are viable for BCI applications, not only in motor-intact patients, but also in chronic stroke survivors. Taken together, these experiments provide initial demonstrations that it is possible to develop BCI systems using the unaffected hemisphere in stroke survivors with multiple degrees of freedom. Further development of these BCI systems may eventually lead to improving function for a significant population of patients