The Berlin Brain-Computer Interface: Progress Beyond Communication and Control

The combined effect of fundamental results about neurocognitive processes and advancements in decoding mental states from ongoing brain signals has brought forth a whole range of potential neurotechnological applications. In this article, we review our developments in this area and put them into perspective. These examples cover a wide range of maturity levels with respect to their applicability. While we assume we are still a long way away from integrating Brain-Computer Interface (BCI) technology in general interaction with computers, or from implementing neurotechnological measures in safety-critical workplaces, results have already now been obtained involving a BCI as research tool. In this article, we discuss the reasons why, in some of the prospective application domains, considerable effort is still required to make the systems ready to deal with the full complexity of the real world.EC/FP7/611570/EU/Symbiotic Mind Computer Interaction for Information Seeking/MindSeeEC/FP7/625991/EU/Hyperscanning 2.0 Analyses of Multimodal Neuroimaging Data: Concept, Methods and Applications/HYPERSCANNING 2.0DFG, 103586207, GRK 1589: Verarbeitung sensorischer Informationen in neuronalen Systeme

Brain-machine interface using electrocorticography in humans

Paralysis has a severe impact on a patient’s quality of life and entails a high emotional burden and life-long social and financial costs. More than 5 million people in the USA suffer from some form of paralysis and about 50% of the people older than 65 experience difficulties or inabilities with movement. Restoring movement and communication for patients with neurological and motor disorders, stroke and spinal cord injuries remains a challenging clinical problem without an adequate solution. A brain-machine interface (BMI) allows subjects to control a device, such as a computer cursor or an artificial hand, exclusively by their brain activity. BMIs can be used to control communication and prosthetic devices, thereby restoring the communication and movement capabilities of the paralyzed patients. So far, most powerful BMIs have been realized by extracting movement parameters from the activity of single neurons. To record such activity, electrodes have to penetrate the brain tissue, thereby generating risk of brain injury. In addition, recording instability, due to small movements of the electrodes within the brain and the neuronal tissue response to the electrode implant, is also an issue. In this thesis, I investigate whether electrocorticography (ECoG), an alternative recording technique, can be used to achieve BMIs with similar accuracy. First, I demonstrate a BMI based on the approach of extracting movement parameters from ECoG signals. Such ECoG based BMI can further be improved using supervised adaptive algorithms. To implement such algorithms, it is necessary to continuously receive feedback from the subject whether the BMI-decoded trajectory was correct or incorrect. I show that, by using the same ECoG recordings, neuronal responses to trajectory errors can be recorded, detected and differentiated from other types of errors. Finally, I devise a method that could be used to improve the detection of error related neuronal responses

A robot swarm assisting a human fire-fighter

Emergencies in industrial warehouses are a major concern for fire-fighters. The large dimensions, together with the development of dense smoke that drastically reduces visibility, represent major challenges. The GUARDIANS robot swarm is designed to assist fire-fighters in searching a large warehouse. In this paper we discuss the technology developed for a swarm of robots assisting fire-fighters. We explain the swarming algorithms that provide the functionality by which the robots react to and follow humans while no communication is required. Next we discuss the wireless communication system, which is a so-called mobile ad-hoc network. The communication network provides also the means to locate the robots and humans. Thus, the robot swarm is able to provide guidance information to the humans. Together with the fire-fighters we explored how the robot swarm should feed information back to the human fire-fighter. We have designed and experimented with interfaces for presenting swarm-based information to human beings

Bridges Structural Health Monitoring and Deterioration Detection Synthesis of Knowledge and Technology

INE/AUTC 10.0

Computer modeling and signal analysis of cardiovascular physiology

This dissertation aims to study cardiovascular physiology from the cellular level to the whole heart level to the body level using numerical approaches. A mathematical model was developed to describe electromechanical interaction in the heart. The model integrates cardio-electrophysiology and cardiac mechanics through excitation-induced contraction and deformation-induced currents. A finite element based parallel simulation scheme was developed to investigate coupled electrical and mechanical functions. The developed model and numerical scheme were utilized to study cardiovascular dynamics at cellular, tissue and organ levels. The influence of ion channel blockade on cardiac alternans was investigated. It was found that the channel blocker may significantly change the critical pacing period corresponding to the onset of alternans as well as the alternans’ amplitude. The influence of electro-mechanical coupling on cardiac alternans was also investigated. The study supported the earlier assumptions that discordant alternans is induced by the interaction of conduction velocity and action potential duration restitution at high pacing rates. However, mechanical contraction may influence the spatial pattern and onset of discordant alternans. Computer algorithms were developed for analysis of human physiology. The 12-lead electrocardiography (ECG) is the gold standard for diagnosis of various cardiac abnormalities. However, disturbances and mistakes may modify physiological waves in ECG and lead to wrong diagnoses. This dissertation developed advanced signal analysis techniques and computer software to detect and suppress artifacts and errors in ECG. These algorithms can help to improve the quality of health care when integrated into medical devices or services. Moreover, computer algorithms were developed to predict patient mortality in intensive care units using various physiological measures. Models and analysis techniques developed here may help to improve the quality of health care

GUARDIANS final report part 1 (draft): a robot swarm assisting a human fire fighter

Emergencies in industrial warehouses are a major concern for fire fighters. The large dimensions together with the development of dense smoke that drastically reduces visibility, represent major challenges. The Guardians robot swarm is designed to assist re ghters in searching a large warehouse. In this paper we discuss the technology developed for a swarm of robots assisting re ghters. We explain the swarming algorithms which provide the functionality by which the robots react to and follow humans while no communication is required. Next we discuss the wireless communication system, which is a so-called mobile ad-hoc network. The communication network provides also the means to locate the robots and humans. Thus the robot swarm is able to provide guidance information to the humans. Together with the fire fighters we explored how the robot swarm should feed information back to the human fire fighter. We have designed and experimented with interfaces for presenting swarm based information to human beings

Southwest Research Institute assistance to NASA in biomedical areas of the technology

Significant applications of aerospace technology were achieved. These applications include: a miniaturized, noninvasive system to telemeter electrocardiographic signals of heart transplant patients during their recuperative period as graded situations are introduced; and economical vital signs monitor for use in nursing homes and rehabilitation hospitals to indicate the onset of respiratory arrest; an implantable telemetry system to indicate the onset of the rejection phenomenon in animals undergoing cardiac transplants; an exceptionally accurate current proportional temperature controller for pollution studies; an automatic, atraumatic blood pressure measurement device; materials for protecting burned areas in contact with joint bender splints; a detector to signal the passage of animals by a given point during ecology studies; and special cushioning for use with below-knee amputees to protect the integrity of the skin at the stump/prosthesis interface

Automatic signal and image-based assessments of spinal cord injury and treatments.

Spinal cord injury (SCI) is one of the most common sources of motor disabilities in humans that often deeply impact the quality of life in individuals with severe and chronic SCI. In this dissertation, we have developed advanced engineering tools to address three distinct problems that researchers, clinicians and patients are facing in SCI research. Particularly, we have proposed a fully automated stochastic framework to quantify the effects of SCI on muscle size and adipose tissue distribution in skeletal muscles by volumetric segmentation of 3-D MRI scans in individuals with chronic SCI as well as non-disabled individuals. We also developed a novel framework for robust and automatic activation detection, feature extraction and visualization of the spinal cord epidural stimulation (scES) effects across a high number of scES parameters to build individualized-maps of muscle recruitment patterns of scES. Finally, in the last part of this dissertation, we introduced an EMG time-frequency analysis framework that implements EMG spectral analysis and machine learning tools to characterize EMG patterns resulting in independent or assisted standing enabled by scES, and identify the stimulation parameters that promote muscle activation patterns more effective for standing. The neurotechnological advancements proposed in this dissertation have greatly benefited SCI research by accelerating the efforts to quantify the effects of SCI on muscle size and functionality, expanding the knowledge regarding the neurophysiological mechanisms involved in re-enabling motor function with epidural stimulation and the selection of stimulation parameters and helping the patients with complete paralysis to achieve faster motor recovery