Brain-Computer Interfaces for Non-clinical (Home, Sports, Art, Entertainment, Education, Well-being) Applications

HCI researchers interest in BCI is increasing because the technology industry is expanding into application areas where efficiency is not the main goal of concern. Domestic or public space use of information and communication technology raise awareness of the importance of affect, comfort, family, community, or playfulness, rather than efficiency. Therefore, in addition to non-clinical BCI applications that require efficiency and precision, this Research Topic also addresses the use of BCI for various types of domestic, entertainment, educational, sports, and well-being applications. These applications can relate to an individual user as well as to multiple cooperating or competing users. We also see a renewed interest of artists to make use of such devices to design interactive art installations that know about the brain activity of an individual user or the collective brain activity of a group of users, for example, an audience. Hence, this Research Topic also addresses how BCI technology influences artistic creation and practice, and the use of BCI technology to manipulate and control sound, video, and virtual and augmented reality (VR/AR)

A New Auditory Multi-Class Brain-Computer Interface Paradigm: Spatial Hearing as an Informative Cue

Most P300-based brain-computer interface (BCI) approaches use the visual modality for stimulation. For use with patients suffering from amyotrophic lateral sclerosis (ALS) this might not be the preferable choice because of sight deterioration. Moreover, using a modality different from the visual one minimizes interference with possible visual feedback. Therefore, a multi-class BCI paradigm is proposed that uses spatially distributed, auditory cues. Ten healthy subjects participated in an offline oddball task with the spatial location of the stimuli being a discriminating cue. Experiments were done in free field, with an individual speaker for each location. Different inter-stimulus intervals of 1000 ms, 300 ms and 175 ms were tested. With averaging over multiple repetitions, selection scores went over 90% for most conditions, i.e., in over 90% of the trials the correct location was selected. One subject reached a 100% correct score. Corresponding information transfer rates were high, up to an average score of 17.39 bits/minute for the 175 ms condition (best subject 25.20 bits/minute). When presenting the stimuli through a single speaker, thus effectively canceling the spatial properties of the cue, selection scores went down below 70% for most subjects. We conclude that the proposed spatial auditory paradigm is successful for healthy subjects and shows promising results that may lead to a fast BCI that solely relies on the auditory sense

Within-Subject Joint Independent Component Analysis of Simultaneous fMRI/ERP in an Auditory Oddball Paradigm

The integration of event-related potential (ERP) and functional magnetic resonance imaging (fMRI) can contribute to characterizing neural networks with high temporal and spatial resolution. This research aimed to determine the sensitivity and limitations of applying joint independent component analysis (jICA) within-subjects, for ERP and fMRI data collected simultaneously in a parametric auditory frequency oddball paradigm. In a group of 20 subjects, an increase in ERP peak amplitude ranging 1–8 μV in the time window of the P300 (350–700 ms), and a correlated increase in fMRI signal in a network of regions including the right superior temporal and supramarginal gyri, was observed with the increase in deviant frequency difference. JICA of the same ERP and fMRI group data revealed activity in a similar network, albeit with stronger amplitude and larger extent. In addition, activity in the left pre- and post-central gyri, likely associated with right hand somato-motor response, was observed only with the jICA approach. Within-subject, the jICA approach revealed significantly stronger and more extensive activity in the brain regions associated with the auditory P300 than the P300 linear regression analysis. The results suggest that with the incorporation of spatial and temporal information from both imaging modalities, jICA may be a more sensitive method for extracting common sources of activity between ERP and fMRI

An overview of current approaches and future challenges in physiological monitoring

Sufficient evidence exists from laboratory studies to suggest that physiological measures can be useful as an adjunct to behavioral and subjective measures of human performance and capabilities. Thus it is reasonable to address the conceptual and engineering challenges that arise in applying this technology in operational settings. Issues reviewed include the advantages and disadvantages of constructs such as mental states, the need for physiological measures of performance, areas of application for physiological measures in operational settings, which measures appear to be most useful, problem areas that arise in the use of these measures in operational settings, and directions for future development

Bacteria Hunt: A multimodal, multiparadigm BCI game

Brain-Computer Interfaces (BCIs) allow users to control applications by brain activity. Among their possible applications for non-disabled people, games are promising candidates. BCIs can enrich game play by the mental and affective state information they contain. During the eNTERFACE’09 workshop we developed the Bacteria Hunt game which can be played by keyboard and BCI, using SSVEP and relative alpha power. We conducted experiments in order to investigate what difference positive vs. negative neurofeedback would have on subjects’ relaxation states and how well the different BCI paradigms can be used together. We observed no significant difference in mean alpha band power, thus relaxation, and in user experience between the games applying positive and negative feedback. We also found that alpha power before SSVEP stimulation was significantly higher than alpha power during SSVEP stimulation indicating that there is some interference between the two BCI paradigms

Sensorial feedback contribution to the sense of embodiment in brain-machine interfaces: a systematic review

The sense of embodiment (SoE) is an essential element of human perception that allows individuals to control and perceive the movements of their body parts. Brain–machine interface (BMI) technology can induce SoE in real time, and adding sensory feedback through various modalities has been shown to improve BMI control and elicit SoEe. In this study, we conducted a systematic review to study BMI performance in studies that integrated SoE variables and analyzed the contribution of single or multimodal sensory stimulation. Out of 493 results, only 20 studies analyzed the SoE of humans using BMIs. Analysis of these articles revealed that 40% of the studies relating BMIs with sensory stimulation and SoE primarily focused on manipulating visual stimuli, particularly in terms of coherence (i.e., synchronous vs. asynchronous stimuli) and realism (i.e., humanoid or robotic appearance). However, no study has analyzed the independent contributions of different sensory modalities to SoE and BMI performance. These results suggest that providing a detailed description of the outcomes resulting from independent and combined effects of different sensory modalities on the experience of SoE during BMI control may be relevant for the design of neurorehabilitation programs.info:eu-repo/semantics/publishedVersio

Restoration of auditory network after Cochlear Implant: A P300 and EEG study using LORETA (Low resolution brain electromagnetic tomography)

The proper functioning of the auditory processing needs an integration of many types of information, and a synchronised action between auditory cortex and other cortical and subcortical centres. The normal development of connectivity between the auditory system and the higher neurocognitive functions depends on sensory experience, and congenital hearing loss makes it essentially impossible. The aim of this work was to perform an electrophysiological analysis of auditory cortical areas in patients with cochlear implant (CI). Thirty implanted patients were included in the study. Twenty-four of them were prelingual patients and they were divided into three groups, according to the age at time of CI surgery and to the duration of CI use: group A - early implant and lengthy CI use, group B - late implant and lengthy CI use, group C - late implant and short CI use. The remaining six patients were affected by postlingual deafness, and they were included in the group D. Each patient group was compared with a normal hearing age matched control group. Each subject underwent an Event-related potentials (ERPs) evaluation and electroencephalographic registration. All data analysis were performed by using Loreta software (Low Resolution Electromagnetic Tomography). ERPs latencies were for the most part significantly longer in patients than in controls. Concerning the Event-related cortical activity, all the control groups showed a high and well-defined activation in frontals areas and the cingulate cortex, in the N200 and P300 time windows. A comparable activation in strength and timing, between patients and controls, was only found in the first prelingual patient group (A), and to a lesser extent in the second group (B), while patients belonging to the third prelingual group (C) showed a very low cortical activation, with no cyclic pattern. Postlingual patients (D) showed no difference in activation compared to controls. ln a second step of the study, functional connectivity was analysed from EEG data, in two different conditions: resting state and activation state. Default mode network, left and right Precuneus and associative visual cortex were examined. No difference between prelingual patients and controls was found in the first group (A). Functional connectivity showed a significant increase in the second (B) and third (C) prelingual patient group, especially in the activation state, and specifically between visual areas and Precuneus and posterior cingulate cortex, while postlingual patients (D) showed no difference compared to controls. Cochlear implant adds a new auditory modality in prelingual patients, allowing the creation of a functional network. This involves the areas implicated in sensory and cognitive modalities, and needs some time to form. The duration of CI use is crucial: prolonged CI use, in addiction to an early time of implant, can restore auditory network, allowing a normalization process, from both an audiological and a neurophysiological point of view. However, in the case of patients with postlingual hearing loss, cochlear implant seems to restore and reinforce a cortical network that has already been formed, before the onset of the hearing impairment

Pre- and post-prandial human scalp-EEG response to olfactory stimulation, using the brain electrical activity mapping technique

Recent psychophysiological evidence indicates that Central Nervous System activity may be directly affected by olfactory stimulation. The present thesis sought to examine the relationship between the CNS and olfactory perception in a series of three EEG experiments employing food odours as stimuli. Further aims were to explore the effect of food ingestion on psychophysiological behaviour and on the hedonic rating of odours, and to investigate the relationship between odour's affective valence and EEG asymmetry. The areas relating to olfactory psychology are reviewed in detail. Experiment 1 investigated the effects of the ingestion of a lunchtime meal and ambient food odour on the auditory oddball evoked potential. Marked P2(K) amplitude changes were associated with exposure to odour. In most cases, decreases in amplitude were obtained depending on the nature of the stimulus. Effects of meal ingestion were also found for P2(X) with the lunch group showing greater amplitude during the second (post-prandial) session than the unfed control group. A three-way interaction was obtained with the controls showing a significant decrease in P2(X) amplitude during the presentation of the odour of vegetable in the second session in comparison to the lunch group. No effect of odour on P300 amplitude was found. Experiments 2 and 3 examined EEG response to a variety of different actual and synthetic food odorants. Both experiments showed alterations in the theta frequency (in experiment 2, exclusively so). The effect of meal ingestion was variable with controls showing greater alpha activity than the lunch group during the second session in one experiment, but the opposite effect in the other. No alpha-related EEG asymmetry for pleasant or unpleasant odours was found in experiment 2 although asymmetries were obtained for the theta frequency. In experiment 3, however, intra-hemispheric alpha asymmetry was obtained for the most pleasant odour. No effect of lunch was found for the postprandial psychometric rating of food odour suggesting that negative olfactory alliesthesia may not be as robust a phenomenon as gustatory alliesthesia. The hypothesis is put forward that the dominant EEG frequency for the processing of olfactory information is the theta frequency. It is suggested, however, that the effects found in this waveband may be related to the psychometric properties of the odour such as distractability and not due to the odour per se

A Brief Exposition on Brain-Computer Interface

Brain-Computer Interface is a technology that records brain signals and translates them into useful commands to operate a drone or a wheelchair. Drones are used in various applications such as aerial operations, where pilot’s presence is impossible. The BCI can also be used for patients suffering from brain diseases who lose their body control and are unable to move to satisfy their basic needs. By taking advantage of BCI and drone technology, algorithms for Mind-Controlled Unmanned Aerial System can be developed. This paper deals with the classification of BCI & UAV, methodologies of BCI, the framework of BCI, neuro-imaging methods, BCI headset options, BCI platforms, electrode types & their placement, and the result of feature extraction technique (FFT) with 72.5% accuracy

Biophysical Source Modeling of Some Exogenous and Endogenous Components of the Human Event-Related Potential

Methods of dipole localization were applied to human scalp-recorded electrical activity associated with a simple auditory cognitive discrimination task. Human neuroanatomy and neurophysiology were reviewed from a biophysical standpoint in order to describe the probable neurogenesis of electrical activity in the brain and on the surface of the head. Topographic electroencephalography (EEG) analysis and source localization methods were historically reviewed in detail, followed by a brief review of the history of non-invasive evoked potential (EP) and magnetic field measurements of human central nervous system activity. Four well known simple cognitive tasks were considered that were known to elicit non-obligatory brain responses, and the odd-ball task chosen. Three subjects listened to a series of two tones, one frequent and one rare, and counted the rare tones. During task performance, 40 to 46 channels of EEG activity were recorded from their scalps. From the EEG data, average evoked potentials (aEP) were calculated for the frequent and rare conditions. From these a difference response was calculated. All three of these EPs were plotted as equipotential maps over a schematic of a head for topographic display and the major distribution features discussed. These aEPs and maps matched those previously reported in the literature. From estimates of the spatial electrical power over the head, four peak components were selected for analysis by equivalent source modeling (ESM). These were designated the FP40, FP100, FP200, and FP350, where FP stands for field power. ESM demonstrated that one centrally located point dipole or two bilaterally symmetric dipoles could model the empirical data quite well. These results were discussed in relation to other topographic studies, as well as studies of intracranial recordings, lesions, and animal models. The source locations found were consistent with auditory cortical locations for the obligatory sensory peaks (FP40, FP100, FP200) and with brainstem locations as the source of the FP350 cognitive event-related peak.</p