Emotional Brain-Computer Interfaces

Research in Brain-computer interface (BCI) has significantly increased during the last few years. In addition to their initial role as assisting devices for the physically challenged, BCIs are now proposed for a wider range of applications. As in any HCI application, BCIs can also benefit from adapting their operation to the emotional state of the user. BCIs have the advantage of having access to brain activity which can provide signicant insight into the user's emotional state. This information can be utilized in two manners. 1) Knowledge of the inuence of the emotional state on brain activity patterns can allow the BCI to adapt its recognition algorithms, so that the intention of the user is still correctly interpreted in spite of signal deviations induced by the subject's emotional state. 2) The ability to recognize emotions can be used in BCIs to provide the user with more natural ways of controlling the BCI through affective modulation. Thus, controlling a BCI by recollecting a pleasant memory can be possible and can potentially lead to higher information transfer rates.\ud These two approaches of emotion utilization in BCI are elaborated in detail in this paper in the framework of noninvasive EEG based BCIs

Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges

In recent years, new research has brought the field of EEG-based Brain-Computer Interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely,“Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user-machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human-computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices

Multimodal imaging of human brain activity: rational, biophysical aspects and modes of integration

Until relatively recently the vast majority of imaging and electrophysiological studies of human brain activity have relied on single-modality measurements usually correlated with readily observable or experimentally modified behavioural or brain state patterns. Multi-modal imaging is the concept of bringing together observations or measurements from different instruments. We discuss the aims of multi-modal imaging and the ways in which it can be accomplished using representative applications. Given the importance of haemodynamic and electrophysiological signals in current multi-modal imaging applications, we also review some of the basic physiology relevant to understanding their relationship

Influencing brain waves by evoked potentials as biometric approach: taking stock of the last six years of research

The scientific advances of recent years have made available to anyone affordable hardware devices capable of doing something unthinkable until a few years ago, the reading of brain waves. It means that through small wearable devices it is possible to perform an electroencephalography (EEG), albeit with less potential than those offered by high-cost professional devices. Such devices make it possible for researchers a huge number of experiments that were once impossible in many areas due to the high costs of the necessary hardware. Many studies in the literature explore the use of EEG data as a biometric approach for people identification, but, unfortunately, it presents problems mainly related to the difficulty of extracting unique and stable patterns from users, despite the adoption of sophisticated techniques. An approach to face this problem is based on the evoked potentials (EPs), external stimuli applied during the EEG reading, a noninvasive technique used for many years in clinical routine, in combination with other diagnostic tests, to evaluate the electrical activity related to some areas of the brain and spinal cord to diagnose neurological disorders. In consideration of the growing number of works in the literature that combine the EEG and EP approaches for biometric purposes, this work aims to evaluate the practical feasibility of such approaches as reliable biometric instruments for user identification by surveying the state of the art of the last 6 years, also providing an overview of the elements and concepts related to this research area

Monitoring the Depth of Anaesthesia

One of the current challenges in medicine is monitoring the patients’ depth of general anaesthesia (DGA). Accurate assessment of the depth of anaesthesia contributes to tailoring drug administration to the individual patient, thus preventing awareness or excessive anaesthetic depth and improving patients’ outcomes. In the past decade, there has been a significant increase in the number of studies on the development, comparison and validation of commercial devices that estimate the DGA by analyzing electrical activity of the brain (i.e., evoked potentials or brain waves). In this paper we review the most frequently used sensors and mathematical methods for monitoring the DGA, their validation in clinical practice and discuss the central question of whether these approaches can, compared to other conventional methods, reduce the risk of patient awareness during surgical procedures

Recovery of cortical effective connectivity and recovery of consciousness in vegetative patients

Patients surviving severe brain injury may regain consciousness without recovering their ability to understand, move and communicate. Recently, electrophysiological and neuroimaging approaches, employing simple sensory stimulations or verbal commands, have proven useful in detecting higher order processing and, in some cases, in establishing some degree of communication in brain-injured subjects with severe impairment of motor function. To complement these approaches, it would be useful to develop methods to detect recovery of consciousness in ways that do not depend on the integrity of sensory pathways or on the subject's ability to comprehend or carry out instructions. As suggested by theoretical and experimental work, a key requirement for consciousness is that multiple, specialized cortical areas can engage in rapid causal interactions (effective connectivity). Here, we employ transcranial magnetic stimulation together with high-density electroencephalography to evaluate effective connectivity at the bedside of severely brain injured, non-communicating subjects. In patients in a vegetative state, who were open-eyed, behaviourally awake but unresponsive, transcranial magnetic stimulation triggered a simple, local response indicating a breakdown of effective connectivity, similar to the one previously observed in unconscious sleeping or anaesthetized subjects. In contrast, in minimally conscious patients, who showed fluctuating signs of non-reflexive behaviour, transcranial magnetic stimulation invariably triggered complex activations that sequentially involved distant cortical areas ipsi- and contralateral to the site of stimulation, similar to activations we recorded in locked-in, conscious patients. Longitudinal measurements performed in patients who gradually recovered consciousness revealed that this clear-cut change in effective connectivity could occur at an early stage, before reliable communication was established with the subject and before the spontaneous electroencephalogram showed significant modifications. Measurements of effective connectivity by means of transcranial magnetic stimulation combined with electroencephalography can be performed at the bedside while by-passing subcortical afferent and efferent pathways, and without requiring active participation of subjects or language comprehension; hence, they offer an effective way to detect and track recovery of consciousness in brain-injured patients who are unable to exchange information with the external environment