Decoding covert somatosensory attention by a BCI system calibrated with tactile sensation

© 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.Objective: We propose a novel calibration strategy to facilitate the decoding of covert somatosensory attention by exploring the oscillatory dynamics induced by tactile sensation. Methods: It was hypothesized that the similarity of the oscillatory pattern between stimulation sensation (SS, real sensation) and somatosensory attentional orientation (SAO) provides a way to decode covert somatic attention. Subjects were instructed to sense the tactile stimulation, which was applied to the left (SS-L) or the right (SS-R) wrist. The BCI system was calibrated with the sensation data and then applied for online SAO decoding. Results: Both SS and SAO showed oscillatory activation concentrated on the contralateral somatosensory hemisphere. Offline analysis showed that the proposed calibration method led to greater accuracy than the traditional calibration method based on SAO only. This is confirmed by online experiments, where the online accuracy on 15 subjects was 78.8±13.1%, with 12 subjects >70% and 4 subject >90%. Conclusion: By integrating the stimulus-induced oscillatory dynamics from sensory cortex, covert somatosensory attention can be reliably decoded by a BCI system calibrated with tactile sensation. Significance: Indeed, real tactile sensation is more consistent during calibration than SAO. This brain-computer interfacing approach may find application for stroke and completely locked-in patients with preserved somatic sensation.University Starter Grant of the University of Waterloo (No. 203859) National Natural Science Foundation of China (Grant No. 51620105002

Sensory Stimulation Training for BCI System based on Somatosensory Attentional Orientation

© 2018 IEEE.Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.In this study, we propose a sensory stimulation training (SST) approach to improve the performance of a brain-computer interface (BCI) based on somatosensory attentional orientation (SAO). In this BCI, subjects imagine the tactile sensation and maintain the attention on the corresponding hand as if there was a tactile stimulus on the wrist skin. Twenty BCI naive subjects were recruited and randomly divided into a Control-Group and an SST-Group. In the Control-Group, subjects performed left hand and right hand SAO tasks in six consecutive runs (with 40 trials in each run), divided into three blocks with each having two runs. For the SST-Group, two runs included real tactile stimulation to the left or right hand (SST training block), between the first two (Pre-SST block) and the last two SAO runs (Post-SST block). Results showed that the SST-Group had a significantly improved performance of 9.4% between the last block and the first block after SST training (F(2,18) =11.11, p=0.0007); in contrast, no significant difference was found in the Control-Group between the first, second and the last block (F(2,18) = 2.07, p=0.1546), indicating no learning effect. The tactile sensation-induced oscillatory dynamics were similar to those induced by SAO. In the SST-Group, R2 discriminative information was enhanced around the somatosensory cortex due to the real sensory stimulation as compared with that in the Control-Group. Since the SAO mental task is inherently an internal process, the proposed SST method is meant as an adjuvant to SAO to facilitate subjects in achieving an initial SAO-based BCI control.University Starter Grant of the University of Waterloo (No. 203859)National Natural Science Foundation of China (Grant No. 51620105002)

A Multi-class BCI based on Somatosensory Imagery

© 2018 IEEE.Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.In this study, we investigated the performance of a multi-class brain-computer interface (BCI). The BCI system is based on the concept of somatosensory attentional orientation (SAO), in which the user shifts and maintains somatosensory attention by imagining the sensation of tactile stimulation of a body part. At the beginning of every trial, a vibration stimulus (200 ms) informed the subjects to prepare for the task. Four SAO tasks were performed following randomly presented cues: SAO of the left hand (SAO-LF), SAO of the right hand (SAO-RT), bilateral SAO (SAO-BI), and SAO suppressed or idle state (SAO-ID). Analysis of the event-related desynchronization and synchronization (ERD/ERS) in the EEG indicated that the four SAO tasks had different somatosensory cortical activation patterns. SAO-LF and SAO-RT exhibited stronger contralateral ERD, whereas bilateral ERD activation was indicative of SAO-BI, and bilateral ERS activation was associated with SAO-ID. By selecting the frequency bands and/or optimal classes, classification accuracy of the system reached 85.2±11.2% for two classes, 69.5±16.2% for three classes, and 55.9±15.8% for four classes. The results validated a multi-class BCI system based on SAO, on a single trial basis. Somatosensory attention to different body parts induces diverse oscillatory dynamics within the somatosensory area of the brain, and the proposed SAO paradigm provided a new approach for a multiple-class BCI that is potentially stimulus-independent.University Starter Grant, University of Waterloo (No. 203859)National Natural Science Foundation of China (Grant No. 51620105002

Decoding covert somatosensory attention by a BCI system calibrated with tactile sensation

Objective: We propose a novel calibration strategy to facilitate the decoding of covert somatosensory attention by exploring the oscillatory dynamics induced by tactile sensation. Methods: It was hypothesized that the similarity of the oscillatory pattern between stimulation sensation (SS, real sensation) and somatosensory attentional orientation (SAO) provides a way to decode covert somatic attention. Subjects were instructed to sense the tactile stimulation, which was applied to the left (SS-L) or the right (SS-R) wrist. The brain-computer interface (BCI) system was calibrated with the sensation data and then applied for online SAO decoding. Results: Both SS and SAO showed oscillatory activation concentrated on the contralateral somatosensory hemisphere. Offline analysis showed that the proposed calibration method led to a greater accuracy than the traditional calibration method based on SAO only. This is confirmed by online experiments, where the online accuracy on 15 subjects was 78.8 ± 13.1%, with 12 subjects >70% and 4 subject >90%. Conclusion: By integrating the stimulus-induced oscillatory dynamics from sensory cortex, covert somatosensory attention can be reliably decoded by a BCI system calibrated with tactile sensation. Significance: Indeed, real tactile sensation is more consistent during calibration than SAO. This brain-computer interfacing approach may find application for stroke and completely locked-in patients with preserved somatic sensation

Exploring Training Effect in 42 Human Subjects Using a Non-invasive Sensorimotor Rhythm Based Online BCI

Electroencephalography based brain-computer interfaces (BCIs) show promise of providing an alternative communication channel between the brain and an external device. It is well acknowledged that BCI control is a skill and could be improved through practice and training. In this study, we explore the change of BCI behavioral performance as well as the electrophysiological properties across three training sessions in a pool of 42 human subjects. Our results show that the group average of BCI accuracy and the information transfer rate improved significantly in the third session compared to the first session; especially the significance reached in a smaller subset of a low BCI performance group (average accuracy <70%) as well. There was a significant difference of event-related desynchronization (ERD) lateralization for BCI control between the left- and right-hand imagination task in the last two sessions, but this significant difference was not revealed in the first training sessions. No significant change of R2 value or event-related desynchronization and synchronization (ERD/ERS) for either channel C3 or channel C4, which were used for online control, was found across the training sessions. The change of ERD lateralization was also not significant across the training sessions. The present results indicate that BCI training could induce a change of behavioral performance and electrophysiological properties quickly, within just a few hours of training, distributed into three sessions. Multiple training sessions might especially be beneficial for the low BCI performers