A Novel 9-Class Auditory ERP Paradigm Driving a Predictive Text Entry System

Brain–computer interfaces (BCIs) based on event related potentials (ERPs) strive for offering communication pathways which are independent of muscle activity. While most visual ERP-based BCI paradigms require good control of the user's gaze direction, auditory BCI paradigms overcome this restriction. The present work proposes a novel approach using auditory evoked potentials for the example of a multiclass text spelling application. To control the ERP speller, BCI users focus their attention to two-dimensional auditory stimuli that vary in both, pitch (high/medium/low) and direction (left/middle/right) and that are presented via headphones. The resulting nine different control signals are exploited to drive a predictive text entry system. It enables the user to spell a letter by a single nine-class decision plus two additional decisions to confirm a spelled word. This paradigm – called PASS2D – was investigated in an online study with 12 healthy participants. Users spelled with more than 0.8 characters per minute on average (3.4 bits/min) which makes PASS2D a competitive method. It could enrich the toolbox of existing ERP paradigms for BCI end users like people with amyotrophic lateral sclerosis disease in a late stage

Evidence for the late MMN as a neurophysiological endophenotype for dyslexia.

Dyslexia affects 5-10% of school-aged children and is therefore one of the most common learning disorders. Research on auditory event related potentials (AERP), particularly the mismatch negativity (MMN) component, has revealed anomalies in individuals with dyslexia to speech stimuli. Furthermore, candidate genes for this disorder were found through molecular genetic studies. A current challenge for dyslexia research is to understand the interaction between molecular genetics and brain function, and to promote the identification of relevant endophenotypes for dyslexia. The present study examines MMN, a neurophysiological correlate of speech perception, and its potential as an endophenotype for dyslexia in three groups of children. The first group of children was clinically diagnosed with dyslexia, whereas the second group of children was comprised of their siblings who had average reading and spelling skills and were therefore "unaffected" despite having a genetic risk for dyslexia. The third group consisted of control children who were not related to the other groups and were also unaffected. In total, 225 children were included in the study. All children showed clear MMN activity to/da/-/ba/contrasts that could be separated into three distinct MMN components. Whilst the first two MMN components did not differentiate the groups, the late MMN component (300-700 ms) revealed significant group differences. The mean area of the late MMN was attenuated in both the dyslexic children and their unaffected siblings in comparison to the control children. This finding is indicative of analogous alterations of neurophysiological processes in children with dyslexia and those with a genetic risk for dyslexia, without a manifestation of the disorder. The present results therefore further suggest that the late MMN might be a potential endophenotype for dyslexia

Language Model Applications to Spelling with Brain-Computer Interfaces

Within the Ambient Assisted Living (AAL) community, Brain-Computer Interfaces (BCIs) have raised great hopes as they provide alternative communication means for persons with disabilities bypassing the need for speech and other motor activities. Although significant advancements have been realized in the last decade, applications of language models (e.g., word prediction, completion) have only recently started to appear in BCI systems. The main goal of this article is to review the language model applications that supplement non-invasive BCI-based communication systems by discussing their potential and limitations, and to discern future trends. First, a brief overview of the most prominent BCI spelling systems is given, followed by an in-depth discussion of the language models appli

Effects of orthographic consistency and homophone density on Chinese spoken word recognition

Studies of alphabetic language have shown that orthographic knowledge influences phonological processing during spoken word recognition. This study utilized the Event-Related Potentials (ERPs) to differentiate two types of phonology-to-orthography (P-to-O) mapping consistencies in Chinese, namely homophone density and orthographic consistency. The ERP data revealed an orthographic consistency effect in the frontal-centrally distributed N400, and a homophone density effect in central-posteriorly distributed late positive component (LPC). Further source analyses using the standardized low-resolution electromagnetic tomography (sLORETA) demonstrated that the orthographic effect was not only localized in the frontal and temporal-parietal regions for phonological processing, but also in the posterior visual cortex for orthographic processing, while the homophone density effect was found in middle temporal gyrus for lexical-semantic selection, and in the temporal-occipital junction for orthographic processing. These results suggest that orthographic information not only shapes the nature of phonological representations, but may also be activated during on-line spoken word recognition

Electrophysiological dynamics of Chinese phonology during visual word recognition in Chinese-English bilinguals

Silent word reading leads to the activation of orthographic (spelling), meaning, as well as phonological (sound) information. For bilinguals, native language information can also be activated automatically when they read words in their second language. For example, when Chinese-English bilinguals read words in their second language (English), the phonology of the Chinese translations is automatically activated. Chinese phonology, however, consists of consonants and vowels (segmental) and tonal information. To what extent these two aspects of Chinese phonology are activated is yet unclear. Here, we used behavioural measures, event-related potentials and oscillatory EEG to investigate Chinese segmental and tonal activation during word recognition. Evidence of Chinese segmental activation was found when bilinguals read English words (faster responses, reduced N400, gamma-band power reduction) and when they read Chinese words (increased LPC, gamma-band power reduction). In contrast, evidence for Chinese tonal activation was only found when bilinguals read Chinese words (gamma-band power increase). Together, our converging behavioural and electrophysiological evidence indicates that Chinese segmental information is activated during English word reading, whereas both segmental and tonal information are activated during Chinese word reading. Importantly, gamma-band oscillations are modulated differently by tonal and segmental activation, suggesting independent processing of Chinese tones and segments

Use of a Green Familiar Faces Paradigm Improves P300-Speller Brain-Computer Interface Performance

Background A recent study showed improved performance of the P300-speller when the flashing row or column was overlaid with translucent pictures of familiar faces (FF spelling paradigm). However, the performance of the P300-speller is not yet satisfactory due to its low classification accuracy and information transfer rate. Objective To investigate whether P300-speller performance is further improved when the chromatic property and the FF spelling paradigm are combined. Methods We proposed a new spelling paradigm in which the flashing row or column is overlaid with translucent green pictures of familiar faces (GFF spelling paradigm). We analyzed the ERP waveforms elicited by the FF and proposed GFF spelling paradigms and compared P300-speller performance between the two paradigms. Results Significant differences in the amplitudes of four ERP components (N170, VPP, P300, and P600f) were observed between both spelling paradigms. Compared to the FF spelling paradigm, the GFF spelling paradigm elicited ERP waveforms of higher amplitudes and resulted in improved P300-speller performance. Conclusions Combining the chromatic property (green color) and the FF spelling paradigm led to better classification accuracy and an increased information transfer rate. These findings demonstrate a promising new approach for improving the performance of the P300-speller

Neural Correlates of Early-Stage Visual Processing Differences in Developmental Dyslexia

Reading requires the successful recruitment and coordination of brain networks to translate visual symbols into phonemes, which are then sequenced to match speech sounds and matched onto semantic representations. Although phonemic awareness is understood to be a core deficit associated with reading disability, neuroimaging has demonstrated an association between poor reading and disruption to various interrelated areas in the brain. This includes one of the major visual pathways, the magnocellular pathway, which contributes to the dorsal pathway in the brain and the processing of motion. For at least two decades, researchers have observed differences in motion processing, supported by the magnocellular pathway, between individuals with and without dyslexia (Eden et al., 1996; Gori et al., 2016; Livingstone et al., 1991; Wilmer, 2004). Further, psychometric studies report an association between reading ability and dorsal stream sensitivity in adults and in children before and after learning to read (Boets et al., 2011; Kevan & Pammer, 2009). Studies of the development of the major visual pathways have suggested that the magnocellular pathway follows a protracted course of development, which raises the possibility that it is vulnerable to pathological change during development and also has the potential for greater plasticity (Armstrong et al., 2002; Stevens & Neville, 2006). To explore the potential differences in early-stage visual processing, this dissertation study investigated whether neurophysiological measures, as indexed by event-related potentials (ERP), may differ between adults with and without dyslexia to stimuli tailored to evoke a response from each of two major visual pathways: magnocellular and parvocellular. The P1 component was elicited in response to motion stimuli designed to probe magnocellular pathways, and the N1 component was elicited in response to color stimuli designed for parvocellular processing. Group comparisons revealed statistically significant group differences in P1 amplitude for the motion/magnocellular condition, but no differences were found for N1 ERP measures for the parvocellular/color condition. Moderate to strong correlations between P1 measures in response to the magnocellular/motion condition were observed in relation to specific behavioral assessments: nonverbal reasoning and memory, orthographic choice, the word identification subtest from the Woodcock Reading Mastery Test (3rd edition: WRMT-III, Woodcock, 2011), and the sight word efficiency subtest from the Test of Word Reading Efficiency (2nd edition: TOWRE-2, Wagner, Torgesen, & Rashotte, 2011). These results are indicative of an early-stage visual processing disruption in individuals with dyslexia observable at the level of the brain. Due to the compounding impact of even small disruptions of sensory and cognitive processing on learning, refining our knowledge of the underlying neural mechanisms of reading may permit earlier identification and potentially more focused interventions that could yield better outcomes for struggling readers. Additionally, the association of those differences with measures of word decoding will inform further research into the underlying neural mechanisms that may contribute to dyslexia and skilled reading

Comparison of the ERP-Based BCI Performance Among Chromatic (RGB) Semitransparent Face Patterns

Objective: Previous studies have shown that combing with color properties may be used as part of the display presented to BCI users in order to improve performance. Build on this, we explored the effects of combinations of face stimuli with three primary colors (RGB) on BCI performance which is assessed by classification accuracy and information transfer rate (ITR). Furthermore, we analyzed the waveforms of three patterns. Methods: We compared three patterns in which semitransparent face is overlaid three primary colors as stimuli: red semitransparent face (RSF), green semitransparent face (GSF), and blue semitransparent face (BSF). Bayesian linear discriminant analysis (BLDA) was used to construct the individual classifier model. In addition, a Repeated-measures ANOVA (RM-ANOVA) and Bonferroni correction were chosen for statistical analysis. Results: The results indicated that the RSF pattern achieved the highest online averaged accuracy with 93.89%, followed by the GSF pattern with 87.78%, while the lowest performance was caused by the BSF pattern with an accuracy of 81.39%. Furthermore, significant differences in classification accuracy and ITR were found between RSF and GSF (p < 0.05) and between RSF and BSF patterns (p < 0.05). Conclusion: The semitransparent faces colored red (RSF) pattern yielded the best performance of the three patterns. The proposed patterns based on ERP-BCI system have a clinically significant impact by increasing communication speed and accuracy of the P300-speller for patients with severe motor impairment