Combining brain-computer interfaces and assistive technologies: state-of-the-art and challenges

In recent years, new research has brought the field of EEG-based Brain-Computer Interfacing (BCI) out of its infancy and into a phase of relative maturity through many demonstrated prototypes such as brain-controlled wheelchairs, keyboards, and computer games. With this proof-of-concept phase in the past, the time is now ripe to focus on the development of practical BCI technologies that can be brought out of the lab and into real-world applications. In particular, we focus on the prospect of improving the lives of countless disabled individuals through a combination of BCI technology with existing assistive technologies (AT). In pursuit of more practical BCIs for use outside of the lab, in this paper, we identify four application areas where disabled individuals could greatly benefit from advancements in BCI technology, namely,“Communication and Control”, “Motor Substitution”, “Entertainment”, and “Motor Recovery”. We review the current state of the art and possible future developments, while discussing the main research issues in these four areas. In particular, we expect the most progress in the development of technologies such as hybrid BCI architectures, user-machine adaptation algorithms, the exploitation of users’ mental states for BCI reliability and confidence measures, the incorporation of principles in human-computer interaction (HCI) to improve BCI usability, and the development of novel BCI technology including better EEG devices

Bestial boredom: a biological perspective on animal boredom and suggestions for its scientific investigation

Boredom is likely to have adaptive value in motivating exploration and learning, and many animals may possess the basic neurological mechanisms to support it. Chronic inescapable boredom can be extremely aversive, and understimulation can harm neural, cognitive and behavioural flexibility. Wild and domesticated animals are at particular risk in captivity, which is often spatially and temporally monotonous. Yet biological research into boredom has barely begun, despite having important implications for animal welfare, the evolution of motivation and cognition, and for human dysfunction at individual and societal levels. Here I aim to facilitate hypotheses about how monotony affects behaviour and physiology, so that boredom can be objectively studied by ethologists and other scientists. I cover valence (pleasantness) and arousal (wakefulness) qualities of boredom, because both can be measured, and I suggest boredom includes suboptimal arousal and aversion to monotony. Because the suboptimal arousal during boredom is aversive, individuals will resist low arousal. Thus, behavioural indicators of boredom will, seemingly paradoxically, include signs of increasing drowsiness, alongside bouts of restlessness, avoidance and sensation-seeking behaviour. Valence and arousal are not, however, sufficient to fully describe boredom. For example, human boredom is further characterized by a perception that time ‘drags’, and this effect of monotony on time perception can too be behaviourally assayed in animals. Sleep disruption and some abnormal behaviour may also be caused by boredom. Ethological research into this emotional phenomenon will deepen understanding of its causes, development, function and evolution, and will enable evidence-based interventions to mitigate human and animal boredom

Fall Prediction and Prevention Systems: Recent Trends, Challenges, and Future Research Directions.

Fall prediction is a multifaceted problem that involves complex interactions between physiological, behavioral, and environmental factors. Existing fall detection and prediction systems mainly focus on physiological factors such as gait, vision, and cognition, and do not address the multifactorial nature of falls. In addition, these systems lack efficient user interfaces and feedback for preventing future falls. Recent advances in internet of things (IoT) and mobile technologies offer ample opportunities for integrating contextual information about patient behavior and environment along with physiological health data for predicting falls. This article reviews the state-of-the-art in fall detection and prediction systems. It also describes the challenges, limitations, and future directions in the design and implementation of effective fall prediction and prevention systems

An Overview of Self-Adaptive Technologies Within Virtual Reality Training

This overview presents the current state-of-the-art of self-adaptive technologies within virtual reality (VR) training. Virtual reality training and assessment is increasingly used for five key areas: medical, industrial & commercial training, serious games, rehabilitation and remote training such as Massive Open Online Courses (MOOCs). Adaptation can be applied to five core technologies of VR including haptic devices, stereo graphics, adaptive content, assessment and autonomous agents. Automation of VR training can contribute to automation of actual procedures including remote and robotic assisted surgery which reduces injury and improves accuracy of the procedure. Automated haptic interaction can enable tele-presence and virtual artefact tactile interaction from either remote or simulated environments. Automation, machine learning and data driven features play an important role in providing trainee-specific individual adaptive training content. Data from trainee assessment can form an input to autonomous systems for customised training and automated difficulty levels to match individual requirements. Self-adaptive technology has been developed previously within individual technologies of VR training. One of the conclusions of this research is that while it does not exist, an enhanced portable framework is needed and it would be beneficial to combine automation of core technologies, producing a reusable automation framework for VR training

Optimizing Random Forest Algorithm to Classify Player's Memorisation via In-game Data

Assessment of a player's knowledge in game education has been around for some time. Traditional evaluation in and around a gaming session may disrupt the players' immersion. This research uses an optimized Random Forest to construct a non-invasive prediction of a game education player's Memorization via in-game data. Firstly, we obtained the dataset from a 3-month survey to record in-game data of 50 players who play 4-15 game stages of the Chem Fight (a test case game). Next, we generated three variants of datasets via the preprocessing stages: resampling method (SMOTE), normalization (min-max), and a combination of resampling and normalization. Then, we trained and optimized three Random Forest (RF) classifiers to predict the player's Memorization. We chose RF because it can generalize well given the high-dimensional dataset. We used RF as the classifier, subject to optimization using its hyperparameter: n_estimators. We implemented a Grid Search Cross Validation (GSCV) method to identify the best value of  n_estimators. We utilized the statistics of GSCV results to reduce the weight of  n_estimators by observing the region of interest shown by the graphs of performances of the classifiers. Overall, the classifiers fitted using the BEST n_estimators (i.e., 89, 31, 89, and 196 trees) from GSCV performed well with around 80% accuracy. Moreover, we successfully identified the smaller number of n_estimators (OPTIMAL), at least halved the BEST  n_estimators. All classifiers were retrained using the OPTIMAL  n_estimators (37, 12, 37, and 41 trees). We found out that the performances of the classifiers were relatively steady at ~80%. This means that we successfully optimized the Random Forest in predicting a player's Memorization when playing the Chem Fight game. An automated technique presented in this paper can monitor student interactions and evaluate their abilities based on in-game data. As such, it can offer objective data about the skills used

Decision Support System for Soybean Rust (Phakopsora pachyrhizi) Management using QnD

The objective of this project is to design a decision support system for soybean rust management using gaming software that incorporates farmer's decision making in the face of risks from soybean rust. Learning from past actions and neighbor's actions are also incorporated. Farmers observe rust outbreak in the current and past periods and decide over how much of land to allocate between soybean, corn and other crops. This decision is influenced by maximization of expected profits criterion which entails crop rotation choices that are based upon perceived risks, yield drags and input costs from altering optimum rotation patterns. Adoption of new technology in terms of selecting better rust management practices is also analyzed in an adaptive management framework. The software meets the need of guiding policy formulation besides training stakeholders in making economically sound choices in the absence of empirical data over pest infestation.Research Methods/ Statistical Methods,

Hybridizing 3-dimensional multiple object tracking with neurofeedback to enhance preparation, performance, and learning

Le vaste domaine de l’amélioration cognitive traverse les applications comportementales, biochimiques et physiques. Aussi nombreuses sont les techniques que les limites de ces premières : des études de pauvre méthodologie, des pratiques éthiquement ambiguës, de faibles effets positifs, des effets secondaires significatifs, des couts financiers importants, un investissement de temps significatif, une accessibilité inégale, et encore un manque de transfert. L’objectif de cette thèse est de proposer une méthode novatrice d’intégration de l’une de ces techniques, le neurofeedback, directement dans un paradigme d’apprentissage afin d’améliorer la performance cognitive et l’apprentissage. Cette thèse propose les modalités, les fondements empiriques et des données à l’appui de ce paradigme efficace d’apprentissage ‘bouclé’. En manipulant la difficulté dans une tâche en fonction de l’activité cérébrale en temps réel, il est démontré que dans un paradigme d’apprentissage traditionnel (3-dimentional multiple object tracking), la vitesse et le degré d’apprentissage peuvent être améliorés de manière significative lorsque comparés au paradigme traditionnel ou encore à un groupe de contrôle actif. La performance améliorée demeure observée même avec un retrait du signal de rétroaction, ce qui suggère que les effets de l’entrainement amélioré sont consolidés et ne dépendent pas d’une rétroaction continue. Ensuite, cette thèse révèle comment de tels effets se produisent, en examinant les corrélés neuronaux des états de préparation et de performance à travers les conditions d’état de base et pendant la tâche, de plus qu’en fonction du résultat (réussite/échec) et de la difficulté (basse/moyenne/haute vitesse). La préparation, la performance et la charge cognitive sont mesurées via des liens robustement établis dans un contexte d’activité cérébrale fonctionnelle mesurée par l’électroencéphalographie quantitative. Il est démontré que l’ajout d’une assistance- à-la-tâche apportée par la fréquence alpha dominante est non seulement appropriée aux conditions de ce paradigme, mais influence la charge cognitive afin de favoriser un maintien du sujet dans sa zone de développement proximale, ce qui facilite l’apprentissage et améliore la performance. Ce type de paradigme d’apprentissage peut contribuer à surmonter, au minimum, un des limites fondamentales du neurofeedback et des autres techniques d’amélioration cognitive : le manque de transfert, en utilisant une méthode pouvant être intégrée directement dans le contexte dans lequel l’amélioration de la performance est souhaitée.The domain of cognitive enhancement is vast, spanning behavioral, biochemical and physical applications. The techniques are as numerous as are the limitations: poorly conducted studies, ethically ambiguous practices, limited positive effects, significant side-effects, high financial costs, significant time investment, unequal accessibility, and lack of transfer. The purpose of this thesis is to propose a novel way of integrating one of these techniques, neurofeedback, directly into a learning context in order to enhance cognitive performance and learning. This thesis provides the framework, empirical foundations, and supporting evidence for a highly efficient ‘closed-loop’ learning paradigm. By manipulating task difficulty based on a measure of cognitive load within a classic learning scenario (3-dimentional multiple object tracking) using real-time brain activity, results demonstrate that over 10 sessions, speed and degree of learning can be substantially improved compared with a classic learning system or an active sham-control group. Superior performance persists even once the feedback signal is removed, which suggests that the effects of enhanced training are consolidated and do not rely on continued feedback. Next, this thesis examines how these effects occur, exploring the neural correlates of the states of preparedness and performance across baseline and task conditions, further examining correlates related to trial results (correct/incorrect) and task difficulty (slow/medium/fast speeds). Cognitive preparedness, performance and load are measured using well-established relationships between real-time quantified brain activity as measured by quantitative electroencephalography. It is shown that the addition of neurofeedback-based task assistance based on peak alpha frequency is appropriate to task conditions and manages to influence cognitive load, keeping the subject in the zone of proximal development more often, facilitating learning and improving performance. This type of learning paradigm could contribute to overcoming at least one of the fundamental limitations of neurofeedback and other cognitive enhancement techniques : a lack of observable transfer effects, by utilizing a method that can be directly integrated into the context in which improved performance is sought

Examining the synergistic effects of a cognitive control video game and a home-based, self-administered non-invasive brain stimulation on alleviating depression : the DiSCoVeR trial protocol

Funding Information: Open Access funding enabled and organized by Projekt DEAL. The DisCoVeR project is funded by ERA NET NEURON. The NEURON ‘Network of European Funding for Neuroscience Research is established under the organization of the ERA-NET ‘European Research Area Networks’ of the European Commission. National funding agencies are the Federal Ministry of Education and Research (Bundesministerium für Bildung und Forschung [BMBF]) for LMU Munich, the Ministry of Health (MOH) for HUJI and Hadassah, the Swiss National Science Foundation (SNSF) for UNIGE and EPFL and the State Education and Development Agency (VIAA) of Latvia for RSU. Funding Information: This project was funded by the European Research Area Network (ERA-NET) NEURON 2018 Mental Disorders program. Publisher Copyright: © 2022, The Author(s).Enhanced behavioral interventions are gaining increasing interest as innovative treatment strategies for major depressive disorder (MDD). In this study protocol, we propose to examine the synergistic effects of a self-administered home-treatment, encompassing transcranial direct current stimulation (tDCS) along with a video game based training of attentional control. The study is designed as a two-arm, double-blind, randomized and placebo-controlled multi-center trial (ClinicalTrials.gov: NCT04953208). At three study sites (Israel, Latvia, and Germany), 114 patients with a primary diagnosis of MDD undergo 6 weeks of intervention (30 × 30 min sessions). Patients assigned to the intervention group receive active tDCS (anode F3 and cathode F4; 2 mA intensity) and an action-like video game, while those assigned to the control group receive sham tDCS along with a control video game. An electrode-positioning algorithm is used to standardize tDCS electrode positioning. Participants perform their designated treatment at the clinical center (sessions 1-5) and continue treatment at home under remote supervision (sessions 6-30). The endpoints are feasibility (primary) and safety, treatment efficacy (secondary, i.e., change of Montgomery-Åsberg Depression Rating Scale (MADRS) scores at week six from baseline, clinical response and remission, measures of social, occupational, and psychological functioning, quality of life, and cognitive control (tertiary). Demonstrating the feasibility, safety, and efficacy of this novel combined intervention could expand the range of available treatments for MDD to neuromodulation enhanced interventions providing cost-effective, easily accessible, and low-risk treatment options.ClinicalTrials.gov: NCT04953208.publishersversionPeer reviewe