Decoding covert somatosensory attention by a BCI system calibrated with tactile sensation

© 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.Objective: We propose a novel calibration strategy to facilitate the decoding of covert somatosensory attention by exploring the oscillatory dynamics induced by tactile sensation. Methods: It was hypothesized that the similarity of the oscillatory pattern between stimulation sensation (SS, real sensation) and somatosensory attentional orientation (SAO) provides a way to decode covert somatic attention. Subjects were instructed to sense the tactile stimulation, which was applied to the left (SS-L) or the right (SS-R) wrist. The BCI system was calibrated with the sensation data and then applied for online SAO decoding. Results: Both SS and SAO showed oscillatory activation concentrated on the contralateral somatosensory hemisphere. Offline analysis showed that the proposed calibration method led to greater accuracy than the traditional calibration method based on SAO only. This is confirmed by online experiments, where the online accuracy on 15 subjects was 78.8±13.1%, with 12 subjects >70% and 4 subject >90%. Conclusion: By integrating the stimulus-induced oscillatory dynamics from sensory cortex, covert somatosensory attention can be reliably decoded by a BCI system calibrated with tactile sensation. Significance: Indeed, real tactile sensation is more consistent during calibration than SAO. This brain-computer interfacing approach may find application for stroke and completely locked-in patients with preserved somatic sensation.University Starter Grant of the University of Waterloo (No. 203859) National Natural Science Foundation of China (Grant No. 51620105002

Fast Recognition of BCI-Inefficient Users Using Physiological Features from EEG Signals: A Screening Study of Stroke Patients

Motor imagery (MI) based brain-computer interface (BCI) has been developed as an alternative therapy for stroke rehabilitation. However, experimental evidence demonstrates that a significant portion (10% to 50%) of subjects are BCI-illiterate users (accuracy less than 70%). Thus, predicting BCI performance prior to clinical BCI usage would facilitate the selection of suitable end-users and improve the efficiency of stroke rehabilitation. In the current study, we proposed two physiological variables, i.e., laterality index (LI) and cortical activation strength (CAS), to predict MI-BCI performance. Twenty-four stroke patients and ten healthy subjects were recruited for this study. Each subject was required to perform two blocks of left- and right-hand MI tasks. Linear regression analyses were performed between the BCI accuracies and two physiological predictors. Here, the predictors were calculated from the electroencephalography (EEG) signals during paretic hand MI tasks (5 trials; approximately one minute). LI values exhibited a statistically significant correlation with two-class BCI (left vs. right) performance (r=-0.732, p<0.001), and CAS values exhibited a statistically significant correlation with brain-switch BCI (task vs. idle) performance (r=0.641, p<0.001). Furthermore, the BCI-illiterate users were successfully recognized with a sensitivity of 88.2% and a specificity of 85.7% in the two-class BCI. The brain-switch BCI achieved a sensitivity of 100.0% and a specificity of 87.5% in the discrimination of BCI-illiterate users. These results demonstrated that the proposed BCI predictors were promising to promote the BCI usage in stroke rehabilitation and contribute to a better understanding of the BCI-illiteracy phenomenon in stroke patients.National Natural Science Foundation of China (Grant No. 51620105002) National High Technology Research and Development Program (863 Program) of China (Grant No.2015AA020501

Spatial Information Enhances Myoelectric Control Performance with Only Two Channels

© 2018 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Automatic gesture recognition (AGR) is investigated as an effortless human-machine interaction method, potentially applied in many industrial sectors. When using surface electromyogram (sEMG) for AGR, i.e. myoelectric control, a minimum of four EMG channels are required. However, in practical applications, fewer number of electrodes is always preferred, particularly for mobile and wearable applications. No published research focused on how to improve the performance of a myoelectric system with only two sEMG channels. In this study, we presented a systematic investigation to fill this gap. Specifically, we demonstrated that through spatial filtering and electrode position optimization, the myoelectric control performance was significantly improved (p < 0.05) and similar to that with four electrodes. Further, we found a significant correlation between offline and online performance metrics in the two-channel system, indicating that offline performance was transferable to online performance, highly relevant for algorithm development for sEMG-based AGR applications.Natural Sciences and Engineering Research Council of Canada || (Discovery Grant 072169) National Natural Science Foundation of China || (Grant 51620105002 and 91748119) State Key Lab of Railway Control and Safety Open Topics Fund of China || (Grant RCS2017K008)

Improving robustness against electrode shift of high density EMG for myoelectric control through common spatial patterns

Background: Most prosthetic myoelectric control studies have concentrated on low density (less than 16 electrodes, LD) electromyography (EMG) signals, due to its better clinical applicability and low computation complexity compared with high density (more than 16 electrodes, HD) EMG signals. Since HD EMG electrodes have been developed more conveniently to wear with respect to the previous versions recently, HD EMG signals become an alternative for myoelectric prostheses. The electrode shift, which may occur during repositioning or donning/doffing of the prosthetic socket, is one of the main reasons for degradation in classification accuracy (CA). Methods: HD EMG signals acquired from the forearm of the subjects were used for pattern recognition-based myoelectric control in this study. Multiclass common spatial patterns (CSP) with two types of schemes, namely one versus one (CSP-OvO) and one versus rest (CSP-OvR), were used for feature extraction to improve the robustness against electrode shift for myoelectric control. Shift transversal (ST1 and ST2) and longitudinal (SL1 and SL2) to the direction of the muscle fibers were taken into consideration. We tested nine intact-limb subjects for eleven hand and wrist motions. The CSP features (CSP-OvO and CSP-OvR) were compared with three commonly used features, namely time-domain (TD) features, time-domain autoregressive (TDAR) features and variogram (Variog) features. Results: Compared with the TD features, the CSP features significantly improved the CA over 10 % in all shift configurations (ST1, ST2, SL1 and SL2). Compared with the TDAR features, a. the CSP-OvO feature significantly improved the average CA over 5 % in all shift configurations; b. the CSP-OvR feature significantly improved the average CA in shift configurations ST1, SL1 and SL2. Compared with the Variog features, the CSP features significantly improved the average CA in longitudinal shift configurations (SL1 and SL2). Conclusion: The results demonstrated that the CSP features significantly improved the robustness against electrode shift for myoelectric control with respect to the commonly used features.National Basic Research Program (973 Program) of China [2011CB013305]; National Natural Science Foundation of China [51375296, 51475292

Performance of Brain-Computer Interfacing Based on Tactile Selective Sensation and Motor Imagery

© 2017 IEEE.Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.A large proportion of users do not achieve adequate control using current non-invasive Brain-computer Interfaces (BCI). This issue has being coined “BCI-Illiteracy”, and is observed among BCI modalities. Here, we compare the performance and BCI-illiteracy rate of tactile selective sensation (SS) and motor imagery (MI) BCI, for large subject samples. We analyzed 80 experimental sessions from 57 subjects with two-class SS protocols. For SS, the group average performance was 79.8±10.6%, with 43 out of the 57 subjects (75.4%) exceeding the 70% BCI-illiteracy threshold for left and right hand SS discrimination. When compared to previous results, this tactile BCI outperformed all other tactile BCIs currently available. We also analyzed 63 experiment sessions from 43 subjects with two-class MI BCI protocols, where the group average performance was 77.2±13.3%, with 69.7% of the subjects exceeded the 70% performance threshold for left and right hand MI. For within-subject comparison, the 24 subjects who participated to both the SS and MI experiments, the BCI performance was superior with SS than MI especially in beta frequency band (p<0.05), with enhanced R2 discriminative information in the somatosensory cortex for the SS modality. Both SS and MI showed a functional dissociation between lower alpha ([8 10] Hz) and upper alpha ([10 13] Hz) bands, with BCI performance significantly better in the upper alpha than the lower alpha (p<0.05) band. In summary, we demonstrated that SS is a promising BCI modality with low BCI illiteracy issue, and has great potential in practical applications reaching large population.University Starter Grant of the University of Waterloo [No. 203859]National Natural Science Foundation of China [Grant No. 51620105002

Sensory Stimulation Training for BCI System based on Somatosensory Attentional Orientation

© 2018 IEEE.Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.In this study, we propose a sensory stimulation training (SST) approach to improve the performance of a brain-computer interface (BCI) based on somatosensory attentional orientation (SAO). In this BCI, subjects imagine the tactile sensation and maintain the attention on the corresponding hand as if there was a tactile stimulus on the wrist skin. Twenty BCI naive subjects were recruited and randomly divided into a Control-Group and an SST-Group. In the Control-Group, subjects performed left hand and right hand SAO tasks in six consecutive runs (with 40 trials in each run), divided into three blocks with each having two runs. For the SST-Group, two runs included real tactile stimulation to the left or right hand (SST training block), between the first two (Pre-SST block) and the last two SAO runs (Post-SST block). Results showed that the SST-Group had a significantly improved performance of 9.4% between the last block and the first block after SST training (F(2,18) =11.11, p=0.0007); in contrast, no significant difference was found in the Control-Group between the first, second and the last block (F(2,18) = 2.07, p=0.1546), indicating no learning effect. The tactile sensation-induced oscillatory dynamics were similar to those induced by SAO. In the SST-Group, R2 discriminative information was enhanced around the somatosensory cortex due to the real sensory stimulation as compared with that in the Control-Group. Since the SAO mental task is inherently an internal process, the proposed SST method is meant as an adjuvant to SAO to facilitate subjects in achieving an initial SAO-based BCI control.University Starter Grant of the University of Waterloo (No. 203859)National Natural Science Foundation of China (Grant No. 51620105002)

A Multi-class BCI based on Somatosensory Imagery

© 2018 IEEE.Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.In this study, we investigated the performance of a multi-class brain-computer interface (BCI). The BCI system is based on the concept of somatosensory attentional orientation (SAO), in which the user shifts and maintains somatosensory attention by imagining the sensation of tactile stimulation of a body part. At the beginning of every trial, a vibration stimulus (200 ms) informed the subjects to prepare for the task. Four SAO tasks were performed following randomly presented cues: SAO of the left hand (SAO-LF), SAO of the right hand (SAO-RT), bilateral SAO (SAO-BI), and SAO suppressed or idle state (SAO-ID). Analysis of the event-related desynchronization and synchronization (ERD/ERS) in the EEG indicated that the four SAO tasks had different somatosensory cortical activation patterns. SAO-LF and SAO-RT exhibited stronger contralateral ERD, whereas bilateral ERD activation was indicative of SAO-BI, and bilateral ERS activation was associated with SAO-ID. By selecting the frequency bands and/or optimal classes, classification accuracy of the system reached 85.2±11.2% for two classes, 69.5±16.2% for three classes, and 55.9±15.8% for four classes. The results validated a multi-class BCI system based on SAO, on a single trial basis. Somatosensory attention to different body parts induces diverse oscillatory dynamics within the somatosensory area of the brain, and the proposed SAO paradigm provided a new approach for a multiple-class BCI that is potentially stimulus-independent.University Starter Grant, University of Waterloo (No. 203859)National Natural Science Foundation of China (Grant No. 51620105002