A note on brain actuated spelling with the Berlin brain-computer interface

Brain-Computer Interfaces (BCIs) are systems capable of decoding neural activity in real time, thereby allowing a computer application to be directly controlled by the brain. Since the characteristics of such direct brain-tocomputer interaction are limited in several aspects, one major challenge in BCI research is intelligent front-end design. Here we present the mental text entry application ‘Hex-o-Spell’ which incorporates principles of Human-Computer Interaction research into BCI feedback design. The system utilises the high visual display bandwidth to help compensate for the extremely limited control bandwidth which operates with only two mental states, where the timing of the state changes encodes most of the information. The display is visually appealing, and control is robust. The effectiveness and robustness of the interface was demonstrated at the CeBIT 2006 (world’s largest IT fair) where two subjects operated the mental text entry system at a speed of up to 7.6 char/min

Assessing the Impact of Two Residential Programs for Dually-Diagnosed Homeless Individuals

Two residential programs for dually diagnosed (severely mentally ill and substance abusing) homeless individuals in Philadelphia were compared in a quasi-experimental field study. Findings indicate that the experimental model, a hybrid psychosocial and drug rehabilitation program, did significantly better in maintaining clients in care and in successful rehabilitation than the comparison model, a modified therapeutic community program. However, the overall rate of success in both programs was quite modest. We found Emile Durkheim\u27s concepts of organic and mechanical solidarity to be useful in comparing the structure of the two programs. Because of the small number of clients treated by these programs and the unique characteristics (predominantly young, black and male) of this urban population, findings are not conclusive but clarify direction for further practice and study

Real-time inference of word relevance from electroencephalogram and eye gaze

Objective. Brain-computer interfaces can potentially map the subjective relevance of the visual surroundings, based on neural activity and eye movements, in order to infer the interest of a person in real-time. Approach. Readers looked for words belonging to one out of five semantic categories, while a stream of words passed at different locations on the screen. It was estimated in real-time which words and thus which semantic category interested each reader based on the electroencephalogram (EEG) and the eye gaze. Main results. Words that were subjectively relevant could be decoded online from the signals. The estimation resulted in an average rank of 1.62 for the category of interest among the five categories after a hundred words had been read. Significance. It was demonstrated that the interest of a reader can be inferred online from EEG and eye tracking signals, which can potentially be used in novel types of adaptive software, which enrich the interaction by adding implicit information about the interest of the user to the explicit interaction. The study is characterised by the following novelties. Interpretation with respect to the word meaning was necessary in contrast to the usual practice in brain-computer interfacing where stimulus recognition is sufficient. The typical counting task was avoided because it would not be sensible for implicit relevance detection. Several words were displayed at the same time, in contrast to the typical sequences of single stimuli. Neural activity was related with eye tracking to the words, which were scanned without restrictions on the eye movements.EC/FP7/611570/EU/Symbiotic Mind Computer Interaction for Information Seeking/MindSe

Childhood Risk Factors in Dually Diagnosed Homeless Adults

Although the negative long term effects of specific childhood risk factors - sexual and physical abuse, parental mental illness and substance abuse, and out of home placement - have been recognized, most studies have focused on just one of these risks. This article examines the prevalence of these five childhood risk factors among dually diagnosed (mental illness and substance abusing) homeless adults in rehabilitation programs. It further assesses the impact of each risk factor individually and in combinations of two on the social functioning skills and rehabilitation progress of these multiply disadvantaged clients

Assessing the Impact of Serving the Long-term Mentally Disabled Homeless

Homelessness has emerged as a major social problem. In an attempt to understand this problem, attention has been focused on postulating its causes, describing the individuals who hold this status, and estimating its magnitude. This study assesses the outcome of one social service program for long-term mentally disabled homeless individuals. It includes a synopsis of the state of the art in serving homeless individuals with severe mental health problems; a description of a program created to meet their needs; and an analysis of the outcome of this program

Towards a Cure for BCI Illiteracy

Brain–Computer Interfaces (BCIs) allow a user to control a computer application by brain activity as acquired, e.g., by EEG. One of the biggest challenges in BCI research is to understand and solve the problem of “BCI Illiteracy”, which is that BCI control does not work for a non-negligible portion of users (estimated 15 to 30%). Here, we investigate the illiteracy problem in BCI systems which are based on the modulation of sensorimotor rhythms. In this paper, a sophisticated adaptation scheme is presented which guides the user from an initial subject-independent classifier that operates on simple features to a subject-optimized state-of-the-art classifier within one session while the user interacts the whole time with the same feedback application. While initial runs use supervised adaptation methods for robust co-adaptive learning of user and machine, final runs use unsupervised adaptation and therefore provide an unbiased measure of BCI performance. Using this approach, which does not involve any offline calibration measurement, good performance was obtained by good BCI participants (also one novice) after 3–6 min of adaptation. More importantly, the use of machine learning techniques allowed users who were unable to achieve successful feedback before to gain significant control over the BCI system. In particular, one participant had no peak of the sensory motor idle rhythm in the beginning of the experiment, but could develop such peak during the course of the session (and use voluntary modulation of its amplitude to control the feedback application)

Implicit relevance feedback from electroencephalography and eye tracking in image search

Objective. Methods from brain–computer interfacing (BCI) open a direct access to the mental processes of computer users, which offers particular benefits in comparison to standard methods for inferring user-related information. The signals can be recorded unobtrusively in the background, which circumvents the time-consuming and distracting need for the users to give explicit feedback to questions concerning the individual interest. The obtained implicit information makes it possible to create dynamic user interest profiles in real-time, that can be taken into account by novel types of adaptive, personalised software. In the present study, the potential of implicit relevance feedback from electroencephalography (EEG) and eye tracking was explored with a demonstrator application that simulated an image search engine. Approach. The participants of the study queried for ambiguous search terms, having in mind one of the two possible interpretations of the respective term. Subsequently, they viewed different images arranged in a grid that were related to the query. The ambiguity of the underspecified search term was resolved with implicit information present in the recorded signals. For this purpose, feature vectors were extracted from the signals and used by multivariate classifiers that estimated the intended interpretation of the ambiguous query. Main result. The intended interpretation was inferred correctly from a combination of EEG and eye tracking signals in 86% of the cases on average. Information provided by the two measurement modalities turned out to be complementary. Significance. It was demonstrated that BCI methods can extract implicit user-related information in a setting of human-computer interaction. Novelties of the study are the implicit online feedback from EEG and eye tracking, the approximation to a realistic use case in a simulation, and the presentation of a large set of photographies that had to be interpreted with respect to the content.EC/FP7/611570/EU/Symbiotic Mind Computer Interaction for Information Seeking/MindSeeBMBF, 01GQ0850, Bernstein Fokus Neurotechnologie - Nichtinvasive Neurotechnologie für Mensch-Maschine Interaktio