Narrow Window Feature Extraction for EEG-Motor Imagery Classification using k-NN and Voting Scheme

Achieving consistent accuracy still big challenge in EEG based Motor Imagery classification since the nature of EEG signal is non-stationary, intra-subject and inter-subject dependent. To address this problems, we propose the feature extraction scheme employing statistical measurements in narrow window with channel instantiation approach. In this study, k-Nearest Neighbor is used and a voting scheme as final decision where the most detection in certain class will be a winner. In this channel instantiation scheme, where EEG channel become instance or record, seventeen EEG channels with motor related activity is used to reduce from 118 channels. We investigate five narrow windows combination in the proposed methods, i.e.: one, two, three, four and five windows. BCI competition III Dataset IVa is used to evaluate our proposed methods. Experimental results show that one window with all channel and a combination of five windows with reduced channel outperform all prior research with highest accuracy and lowest standard deviation. This results indicate that our proposed methods achieve consistent accuracy and promising for reliable BCI systems

Decoding covert somatosensory attention by a BCI system calibrated with tactile sensation

© 2017 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.Objective: We propose a novel calibration strategy to facilitate the decoding of covert somatosensory attention by exploring the oscillatory dynamics induced by tactile sensation. Methods: It was hypothesized that the similarity of the oscillatory pattern between stimulation sensation (SS, real sensation) and somatosensory attentional orientation (SAO) provides a way to decode covert somatic attention. Subjects were instructed to sense the tactile stimulation, which was applied to the left (SS-L) or the right (SS-R) wrist. The BCI system was calibrated with the sensation data and then applied for online SAO decoding. Results: Both SS and SAO showed oscillatory activation concentrated on the contralateral somatosensory hemisphere. Offline analysis showed that the proposed calibration method led to greater accuracy than the traditional calibration method based on SAO only. This is confirmed by online experiments, where the online accuracy on 15 subjects was 78.8±13.1%, with 12 subjects >70% and 4 subject >90%. Conclusion: By integrating the stimulus-induced oscillatory dynamics from sensory cortex, covert somatosensory attention can be reliably decoded by a BCI system calibrated with tactile sensation. Significance: Indeed, real tactile sensation is more consistent during calibration than SAO. This brain-computer interfacing approach may find application for stroke and completely locked-in patients with preserved somatic sensation.University Starter Grant of the University of Waterloo (No. 203859) National Natural Science Foundation of China (Grant No. 51620105002

Sensory Stimulation Training for BCI System based on Somatosensory Attentional Orientation

© 2018 IEEE.Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.In this study, we propose a sensory stimulation training (SST) approach to improve the performance of a brain-computer interface (BCI) based on somatosensory attentional orientation (SAO). In this BCI, subjects imagine the tactile sensation and maintain the attention on the corresponding hand as if there was a tactile stimulus on the wrist skin. Twenty BCI naive subjects were recruited and randomly divided into a Control-Group and an SST-Group. In the Control-Group, subjects performed left hand and right hand SAO tasks in six consecutive runs (with 40 trials in each run), divided into three blocks with each having two runs. For the SST-Group, two runs included real tactile stimulation to the left or right hand (SST training block), between the first two (Pre-SST block) and the last two SAO runs (Post-SST block). Results showed that the SST-Group had a significantly improved performance of 9.4% between the last block and the first block after SST training (F(2,18) =11.11, p=0.0007); in contrast, no significant difference was found in the Control-Group between the first, second and the last block (F(2,18) = 2.07, p=0.1546), indicating no learning effect. The tactile sensation-induced oscillatory dynamics were similar to those induced by SAO. In the SST-Group, R2 discriminative information was enhanced around the somatosensory cortex due to the real sensory stimulation as compared with that in the Control-Group. Since the SAO mental task is inherently an internal process, the proposed SST method is meant as an adjuvant to SAO to facilitate subjects in achieving an initial SAO-based BCI control.University Starter Grant of the University of Waterloo (No. 203859)National Natural Science Foundation of China (Grant No. 51620105002)

A Multi-class BCI based on Somatosensory Imagery

© 2018 IEEE.Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.In this study, we investigated the performance of a multi-class brain-computer interface (BCI). The BCI system is based on the concept of somatosensory attentional orientation (SAO), in which the user shifts and maintains somatosensory attention by imagining the sensation of tactile stimulation of a body part. At the beginning of every trial, a vibration stimulus (200 ms) informed the subjects to prepare for the task. Four SAO tasks were performed following randomly presented cues: SAO of the left hand (SAO-LF), SAO of the right hand (SAO-RT), bilateral SAO (SAO-BI), and SAO suppressed or idle state (SAO-ID). Analysis of the event-related desynchronization and synchronization (ERD/ERS) in the EEG indicated that the four SAO tasks had different somatosensory cortical activation patterns. SAO-LF and SAO-RT exhibited stronger contralateral ERD, whereas bilateral ERD activation was indicative of SAO-BI, and bilateral ERS activation was associated with SAO-ID. By selecting the frequency bands and/or optimal classes, classification accuracy of the system reached 85.2±11.2% for two classes, 69.5±16.2% for three classes, and 55.9±15.8% for four classes. The results validated a multi-class BCI system based on SAO, on a single trial basis. Somatosensory attention to different body parts induces diverse oscillatory dynamics within the somatosensory area of the brain, and the proposed SAO paradigm provided a new approach for a multiple-class BCI that is potentially stimulus-independent.University Starter Grant, University of Waterloo (No. 203859)National Natural Science Foundation of China (Grant No. 51620105002

Performance of Brain-Computer Interfacing Based on Tactile Selective Sensation and Motor Imagery

© 2017 IEEE.Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes,creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.A large proportion of users do not achieve adequate control using current non-invasive Brain-computer Interfaces (BCI). This issue has being coined “BCI-Illiteracy”, and is observed among BCI modalities. Here, we compare the performance and BCI-illiteracy rate of tactile selective sensation (SS) and motor imagery (MI) BCI, for large subject samples. We analyzed 80 experimental sessions from 57 subjects with two-class SS protocols. For SS, the group average performance was 79.8±10.6%, with 43 out of the 57 subjects (75.4%) exceeding the 70% BCI-illiteracy threshold for left and right hand SS discrimination. When compared to previous results, this tactile BCI outperformed all other tactile BCIs currently available. We also analyzed 63 experiment sessions from 43 subjects with two-class MI BCI protocols, where the group average performance was 77.2±13.3%, with 69.7% of the subjects exceeded the 70% performance threshold for left and right hand MI. For within-subject comparison, the 24 subjects who participated to both the SS and MI experiments, the BCI performance was superior with SS than MI especially in beta frequency band (p<0.05), with enhanced R2 discriminative information in the somatosensory cortex for the SS modality. Both SS and MI showed a functional dissociation between lower alpha ([8 10] Hz) and upper alpha ([10 13] Hz) bands, with BCI performance significantly better in the upper alpha than the lower alpha (p<0.05) band. In summary, we demonstrated that SS is a promising BCI modality with low BCI illiteracy issue, and has great potential in practical applications reaching large population.University Starter Grant of the University of Waterloo [No. 203859]National Natural Science Foundation of China [Grant No. 51620105002

Exploring Training Effect in 42 Human Subjects Using a Non-invasive Sensorimotor Rhythm Based Online BCI

Electroencephalography based brain-computer interfaces (BCIs) show promise of providing an alternative communication channel between the brain and an external device. It is well acknowledged that BCI control is a skill and could be improved through practice and training. In this study, we explore the change of BCI behavioral performance as well as the electrophysiological properties across three training sessions in a pool of 42 human subjects. Our results show that the group average of BCI accuracy and the information transfer rate improved significantly in the third session compared to the first session; especially the significance reached in a smaller subset of a low BCI performance group (average accuracy &lt;70%) as well. There was a significant difference of event-related desynchronization (ERD) lateralization for BCI control between the left- and right-hand imagination task in the last two sessions, but this significant difference was not revealed in the first training sessions. No significant change of R2 value or event-related desynchronization and synchronization (ERD/ERS) for either channel C3 or channel C4, which were used for online control, was found across the training sessions. The change of ERD lateralization was also not significant across the training sessions. The present results indicate that BCI training could induce a change of behavioral performance and electrophysiological properties quickly, within just a few hours of training, distributed into three sessions. Multiple training sessions might especially be beneficial for the low BCI performers

Effective EEG analysis for advanced AI-driven motor imagery BCI systems

Developing effective signal processing for brain-computer interfaces (BCIs) and brain-machine interfaces (BMIs) involves factoring in three aspects of functionality: classification performance, execution time, and the number of data channels used. The contributions in this thesis are centered on these three issues. Contributions are focused on the classification of motor imagery (MI) data, which is generated during imagined movements. Typically, EEG time-series data is segmented for data augmentation or to mimic buffering that happens in an online BCI. A multi-segment decision fusion approach is presented, which takes consecutive temporal segments of EEG data, and uses decision fusion to boost classification performance. It was computationally lightweight and improved the performance of four conventional classifiers. Also, an analysis of the contributions of electrodes from different scalp regions is presented, and a subset of channels is recommended. Sparse learning (SL) classifiers have exhibited strong classification performance in the literature. However, they are computationally expensive. To reduce the test-set execution times, a novel EEG classification pipeline consisting of a genetic-algorithm (GA) for channel selection and a dictionary-based SL module for classification, called GABSLEEG, is presented. Subject-specific channel selection was carried out, in which the channels are selected based on training data from the subject. Using the GA-recommended subset of EEG channels reduced the execution time by 60% whilst preserving classification performance. Although subject-specific channel selection is widely used in the literature, effective subject-independent channel selection, in which channels are detected using data from other subjects, is an ideal aim because it leads to lower training latency and reduces the number of electrodes needed. A novel convolutional neural network (CNN)-based subject-independent channels selection method is presented, called the integrated channel selection (ICS) layer. It performed on-a-par with or better than subject-specific channel selection. It was computationally efficient, operating 12-17 times faster than the GA channel selection module. The ICS layer method was versatile, performing well with two different CNN architectures and datasets.Developing effective signal processing for brain-computer interfaces (BCIs) and brain-machine interfaces (BMIs) involves factoring in three aspects of functionality: classification performance, execution time, and the number of data channels used. The contributions in this thesis are centered on these three issues. Contributions are focused on the classification of motor imagery (MI) data, which is generated during imagined movements. Typically, EEG time-series data is segmented for data augmentation or to mimic buffering that happens in an online BCI. A multi-segment decision fusion approach is presented, which takes consecutive temporal segments of EEG data, and uses decision fusion to boost classification performance. It was computationally lightweight and improved the performance of four conventional classifiers. Also, an analysis of the contributions of electrodes from different scalp regions is presented, and a subset of channels is recommended. Sparse learning (SL) classifiers have exhibited strong classification performance in the literature. However, they are computationally expensive. To reduce the test-set execution times, a novel EEG classification pipeline consisting of a genetic-algorithm (GA) for channel selection and a dictionary-based SL module for classification, called GABSLEEG, is presented. Subject-specific channel selection was carried out, in which the channels are selected based on training data from the subject. Using the GA-recommended subset of EEG channels reduced the execution time by 60% whilst preserving classification performance. Although subject-specific channel selection is widely used in the literature, effective subject-independent channel selection, in which channels are detected using data from other subjects, is an ideal aim because it leads to lower training latency and reduces the number of electrodes needed. A novel convolutional neural network (CNN)-based subject-independent channels selection method is presented, called the integrated channel selection (ICS) layer. It performed on-a-par with or better than subject-specific channel selection. It was computationally efficient, operating 12-17 times faster than the GA channel selection module. The ICS layer method was versatile, performing well with two different CNN architectures and datasets

Shortest Route at Dynamic Location with Node Combination-Dijkstra Algorithm

Abstract— Online transportation has become a basic requirement of the general public in support of all activities to go to work, school or vacation to the sights. Public transportation services compete to provide the best service so that consumers feel comfortable using the services offered, so that all activities are noticed, one of them is the search for the shortest route in picking the buyer or delivering to the destination. Node Combination method can minimize memory usage and this methode is more optimal when compared to A* and Ant Colony in the shortest route search like Dijkstra algorithm, but can’t store the history node that has been passed. Therefore, using node combination algorithm is very good in searching the shortest distance is not the shortest route. This paper is structured to modify the node combination algorithm to solve the problem of finding the shortest route at the dynamic location obtained from the transport fleet by displaying the nodes that have the shortest distance and will be implemented in the geographic information system in the form of map to facilitate the use of the system. Keywords— Shortest Path, Algorithm Dijkstra, Node Combination, Dynamic Location (key words