Smart helmet: wearable multichannel ECG & EEG

Modern wearable technologies have enabled continuous recording of vital signs, however, for activities such as cycling, motor-racing, or military engagement, a helmet with embedded sensors would provide maximum convenience and the opportunity to monitor simultaneously both the vital signs and the electroencephalogram (EEG). To this end, we investigate the feasibility of recording the electrocardiogram (ECG), respiration, and EEG from face-lead locations, by embedding multiple electrodes within a standard helmet. The electrode positions are at the lower jaw, mastoids, and forehead, while for validation purposes a respiration belt around the thorax and a reference ECG from the chest serve as ground truth to assess the performance. The within-helmet EEG is verified by exposing the subjects to periodic visual and auditory stimuli and screening the recordings for the steady-state evoked potentials in response to these stimuli. Cycling and walking are chosen as real-world activities to illustrate how to deal with the so-induced irregular motion artifacts, which contaminate the recordings. We also propose a multivariate R-peak detection algorithm suitable for such noisy environments. Recordings in real-world scenarios support a proof of concept of the feasibility of recording vital signs and EEG from the proposed smart helmet

Study and analysis of motion artifacts for ambulatory electroencephalography

Motion artifacts contribute complexity in acquiring clean electroencephalography (EEG) data. It is one of the major challenges for ambulatory EEG. The performance of mobile health monitoring, neurological disorders diagnosis and surgeries can be significantly improved by reducing the motion artifacts. Although different papers have proposed various novel approaches for removing motion artifacts, the datasets used to validate those algorithms are questionable. In this paper, a unique EEG dataset was presented where ten different activities were performed. No such previous EEG recordings using EMOTIV EEG headset are available in research history that explicitly mentioned and considered a number of daily activities that induced motion artifacts in EEG recordings. Quantitative study shows that in comparison to correlation coefficient, the coherence analysis depicted a better similarity measure between motion artifacts and motion sensor data. Motion artifacts were characterized with very low frequency which overlapped with the Delta rhythm of the EEG. Also, a general wavelet transform based approach was presented to remove motion artifacts. Further experiment and analysis with more similarity metrics and longer recording duration for each activity is required to finalize the characteristics of motion artifacts and henceforth reliably identify and subsequently remove the motion artifacts in the contaminated EEG recordings

Review on Smart Electro-Clothing Systems (SeCSs)

This review paper presents an overview of the smart electro-clothing systems (SeCSs) targeted at health monitoring, sports benefits, fitness tracking, and social activities. Technical features of the available SeCSs, covering both textile and electronic components, are thoroughly discussed and their applications in the industry and research purposes are highlighted. In addition, it also presents the developments in the associated areas of wearable sensor systems and textile-based dry sensors. As became evident during the literature research, such a review on SeCSs covering all relevant issues has not been presented before. This paper will be particularly helpful for new generation researchers who are and will be investigating the design, development, function, and comforts of the sensor integrated clothing materials

Removal of movement-induced EEG artifacts: current state of the art and guidelines

Objective: Electroencephalography (EEG) is a non-invasive technique used to record cortical neurons’ electrical activity using electrodes placed on the scalp. It has become a promising avenue for research beyond state-of-the-art EEG research that is conducted under static conditions. EEG signals are always contaminated by artifacts and other physiological signals. Artifact contamination increases with the intensity of movement. Approach: In the last decade (since 2010), researchers have started to implement EEG measurements in dynamic setups to increase the overall ecological validity of the studies. Many different methods are used to remove non-brain activity from the EEG signal, and there are no clear guidelines on which method should be used in dynamic setups and for specific movement intensities. Main results: Currently, the most common methods for removing artifacts in movement studies are methods based on independent component analysis. However, the choice of method for artifact removal depends on the type and intensity of movement, which affects the characteristics of the artifacts and the EEG parameters of interest. When dealing with EEG under non-static conditions, special care must be taken already in the designing period of an experiment. Software and hardware solutions must be combined to achieve sufficient removal of unwanted signals from EEG measurements. Significance: We have provided recommendations for the use of each method depending on the intensity of the movement and highlighted the advantages and disadvantages of the methods. However, due to the current gap in the literature, further development and evaluation of methods for artifact removal in EEG data during locomotion is needed.EC/H2020/952401/EU/TWINning the BRAIN with machine learning for neuro-muscular efficiency/TwinBrai

Validation of Electroencephalographic Recordings Obtained with a Consumer-Grade, Single Dry Electrode, Low-Cost Device: A Comparative Study

The functional validity of the signal obtained with low-cost electroencephalography (EEG) devices is still under debate. Here, we have conducted an in-depth comparison of the EEG-recordings obtained with a medical-grade golden-cup electrodes ambulatory device, the SOMNOwatch + EEG-6, vs those obtained with a consumer-grade, single dry electrode low-cost device, the NeuroSky MindWave, one of the most a ordable devices currently available. We recorded EEG signals at Fp1 using the two di erent devices simultaneously on 21 participants who underwent two experimental phases: a 12-minute resting state task (alternating two cycles of closed/open eyes periods), followed by 60-minute virtual-driving task. We evaluated the EEG recording quality by comparing the similarity between the temporal data series, their spectra, their signal-to-noise ratio, the reliability of EEG measurements (comparing the closed eyes periods), as well as their blink detection rate. We found substantial agreement between signals: whereas, qualitatively, the NeuroSky MindWave presented higher levels of noise and a biphasic shape of blinks, the similarity metric indicated that signals from both recording devices were significantly correlated. While the NeuroSky MindWave was less reliable, both devices had a similar blink detection rate. Overall, the NeuroSky MindWave is noise-limited, but provides stable recordings even through long periods of time. Furthermore, its data would be of adequate quality compared to that of conventional wet electrode EEG devices, except for a potential calibration error and spectral differences at low frequencies.Spanish Department of Transportation, Madrid, Spain (Grant No. SPIP2014-1426 to L.L.D.S.)A.C. is funded by a Spanish Ministry of Economy and Competitiveness grant (PSI2016-80558-R to A.C.)S.R. is funded by an Andalusian Government Excellence Research grant (P11-TIC-7983)L.J.F. is funded by a Spanish Ministry of Economy and Competitiveness grant (PSI2014-53427-P) and a Fundación Séneca grant (19267/PI/14)L.L.D.S. is currently supported by the Ramón y Cajal fellowship program (RYC-2015-17483)C.D.-P. is currently supported by the CEIMAR program (CEIMAR2018-2)C.D.-P. and L.L.D.S. are supported by a Santander Bank—CEMIX UGR-MADOC grant (Project PINS 2018-15

Brain oscillations track the formation of episodic memories in the real world

Despite the well-known influence of environmental context on episodic memory, little has been done to increase contextual richness within the lab. This leaves a blind spot lingering over the neuronal correlates of episodic memory formation in day-to-day life. To address this, we presented participants with a series of words to memorise along a pre-designated route across campus while a mobile EEG system acquired ongoing neural activity. Replicating lab-based subsequent memory effects (SMEs), we identified significant low to mid frequency power decreases (<30 Hz), including beta power decreases over the left inferior frontal gyrus. When investigating the oscillatory correlates of temporal and spatial context binding, we found that items strongly bound to spatial context exhibited significantly greater theta power decreases than items strongly bound to temporal context. These findings expand upon lab-based studies by demonstrating the influence of real world contextual factors that underpin memory formation

Mining the brain to predict gait characteristics: a BCI study

Tese de mestrado integrado em Engenharia Biomédica e Biofísica, apresentada à Universidade de Lisboa, através da Faculdade de Ciências, em 2018A locomoção é uma das atividades mais comuns e relevantes da vida quotidiana, sendo que envolve a ativação dos sistemas nervoso e músculo-esquelético. Os distúrbios da locomoção são comuns principalmente na população idosa, sendo que frequentemente estão associados a uma diminuição da qualidade de vida. A ocorrência destes distúrbios aumenta com a idade, estimando-se que aproximadamente 10% das pessoas com idades entre 60 e 69 anos sofram de algum tipo de distúrbio da locomoção, enquanto esse número aumenta para mais de 60% em pessoas com idade superior a 80 anos. Os padrões da locomoção são influenciados por doenças, condições físicas, personalidade e humor, sendo que um padrão anormal ocorre quando uma pessoa não é capaz de andar da maneira usual, maioritariamente devido a lesões, doenças ou outras condições subjacentes. As causas dos distúrbios da marcha incluem condições neurológicas e músculo-esqueléticas. Um grande número de condições neurológicas pode causar um padrão de marcha anormal, como por exemplo um acidente vascular cerebral, paralisia cerebral ou a doença de Parkinson. Por outro lado, as causas músculo-esqueléticas devem-se principalmente a doenças ósseas ou musculares. A avaliação ou análise da marcha, inclui a medição, descrição e avaliação das variáveis que caracterizam a locomoção humana. Como resultado, este estudo permite o diagnóstico de várias condições, bem como avaliar a progressão da reabilitação e desenvolver estratégias de intervenção. Convencionalmente, a marcha é estudada subjetivamente com protocolos observacionais. No entanto, recentemente foram desenvolvidos métodos mais objetivos e viáveis. Os métodos de análise da marcha podem ser classificados em laboratoriais ou portáteis. Embora a análise baseada em laboratório utilize equipamentos especializados, os sistemas portáteis permitem o estudo da marcha em ambientes naturais e durante atividades da vida diária. A análise laboratorial da marcha é baseada principalmente em informações de imagem e vídeo, embora sensores de piso e placas de força também sejam comuns. Por outro lado, os sistemas portáteis consistem em um ou vários sensores, ligados ao corpo. A adaptação da locomoção é um dos mais relevantes conceitos na análise da mesma, sendo que a sua origem e dinâmica neuronal têm sido amplamente estudadas nos últimos anos. A adaptação da marcha reflete a capacidade de um sujeito em mudar de velocidade e direção, manter o equilíbrio ou evitar obstáculos. Em termos da reabilitação neurológica, a adaptação da locomoção interfere na dinâmica neuronal, permitindo que os pacientes restaurem certas funções motoras. Atualmente, os dispositivos robóticos para membros inferiores e os exoesqueletos são cada vez mais usados não só para facilitar a reabilitação motora, mas também para apoiar as funções da vida diária. No entanto, a sua eficiência e segurança depende da sua eficácia em detetar a intenção humana de mover e adaptar a locomoção. Recentemente, foi demonstrado que o ritmo auditivo tem um forte efeito no sistema motor. Consequentemente, a adaptação tem sido estudada com base em ritmos auditivos, onde os pacientes seguem tons de estimulação para melhorar a coordenação da marcha. A imagem motora (MI), uma prática emergente em BCI, ou interface cérebro-máquina, é definida como a atividade de simular mentalmente uma determinada ação, sem a execução real do movimento. O desempenho da classificação da MI é importante para desenvolver ambientes robustos de interface cérebro-máquina, para neuro-reabilitação de pacientes e controle de próteses robóticas. O desempenho da classificação da MI é importante para desenvolver ambientes robustos de interface cérebro-máquina, para neuro-reabilitação de pacientes e controle de próteses robóticas, uma vez que, estudos anteriores, concluíram que realizar uma sessão de MI ativa parcialmente as mesmas regiões cerebrais que o desempenho da tarefa real. Inicialmente, a tarefas de MI centravam-se apenas nos movimentos dos membros superiores, no entanto, recentemente, estas começaram também a focar-se nos movimentos dos membros inferiores, de modo a estudar a locomoção humana. A deteção da intenção motora em tarefas de MI enfrenta vários desafios, mesmo para duas classes (esquerda / direita, por exemplo), sendo que um dos principais desafios se deve ao número, localização e tipo de elétrodos de EEG usados. Recentemente, um número crescente de estudos investigou a atividade cerebral durante a locomoção humana. Esses estudos, baseados maioritariamente no EEG, encontraram várias relações entre regiões cerebrais e ações ou movimentos específicos. Por exemplo, concluiu-se que a atividade cerebral aumenta durante a caminhada ou a preparação para caminhar e que a potência nas bandas μ e β diminui durante a execução voluntária do movimento. Em termos de adaptação da marcha, foi demonstrado que a atividade eletrocortical varia de acordo com a tarefa motora executada. Recentemente, as Interfaces Cérebro-Máquina permitiram o desenvolvimento de novas terapias de reabilitação para restaurar as funções motoras em pessoas com deficiências na locomoção, envolvendo o SNC para ativar dispositivos externos. Na primeira parte desta tese, foram realizadas várias tarefas de MI, juntamente com os movimentos reais dos membros inferiores, de modo a comparar o desempenho da classificação de um sistema wireless de 16 elétrodos secos com um sistema wireless de 32 elétrodos com gel condutor. A extração e classificação das características do sinal foram também avaliadas com mais de um método (LDA e CSP). No final, a combinação de um filtro beta passa-banda com um filtro RCSP mostrou a melhor taxa de classificação. Embora durante a aquisição do EEG todos os canais tenham sido utilizados, durante os métodos de processamento, foram escolhidas duas configurações específicas, onde os elétrodos foram selecionados de acordo com sua posição relativamente ao córtex motor. Desde modo, infere-se que uma seleção cuidada da localização dos elétrodos é mais importante do que ter um denso mapa de elétrodos, o que torna os sistemas EEG mais confortáveis e de fácil utilização. Os resultados mostram também a viabilidade do uso doméstico de sistemas de elétrodos secos com um reduzido número de sensores, e a possibilidade de diferenciar entre as tarefas de MI (esquerda e direita), para ambos os membros, com uma precisão relativamente alta. Por outro lado, a segunda parte desta tese apresenta um esquema de adaptação da marcha em ambientes naturais. De modo a avaliar a adaptação da marcha, os sujeitos seguem um tom rítmico que alterna entre três modos distintos (lento, normal e acelerado). As características da locomoção foram extraídas com base numa câmara RGB, sendo que os sinais de EEG foram monitorados simultaneamente. De seguida, estas características bem como as informações do tempo de reação foram utilizadas para extrair as etapas de adaptação da marcha versus etapas de não adaptação. De modo a remover os artefactos presentes no EEG, devidos maioritariamente ao movimento do sujeito, o sinal for filtrado com uma filtro passa-banda e sujeito a uma análise de componentes independentes (ICA). Posteriormente, as características de adaptação da marcha do EEG foram investigadas com base em dois problemas de classificação: i) classificação dos passos em direito ou esquerdo e ii) etapas de adaptação versus não adaptação da marcha. As características foram extraídas com base em padrões espaciais comuns (CSP) e padrões espaciais comuns regularizados (RCSP). Os resultados mostram que é possível discriminar com sucesso a adaptação versus não adaptação com mais de 90% de precisão. Este procedimento permite a monitoração dos participantes em ambientes mais realistas, sem a necessidade de equipamentos especializados, como sensores de pressão. Este método demonstrou que é possível detetar a adaptação com mais de 90% de precisão, quando os participantes tentam adaptar sua velocidade de marcha para uma velocidade maior ou menor.Gait adaptation is one of the most relevant concepts in gait analysis and its neuronal origin and dynamics has been extensively studied in the past few years. In terms of neurorehabilitation, gait adaptation perturbs neuronal dynamics and allows patients to restore some of their motor functions. In fact, lower-limbs robotic devices and exoskeletons are increasingly used to facilitate rehabilitation as well as supporting daily life functions. However, their efficiency and safety depend on how well they can detect the human intention to move and adapt the gait. Motor imagery (MI), an emerging practise in Brain Computer Interface (BCI), is defined as the activity of mentally simulating a given action, without the actual execution of the movement. MI classification performance is important in order to develop robust brain computer interface environments for neuro-rehabilitation of patients and robotic prosthesis control. In the first section of this thesis, it was performed a number of motor imagery tasks along with actual movements of the limbs to compare the classification performance of a dry 16-channel and a wet, 32-channel, wireless (Electroencephalography) EEG system. Results showed the feasibility of home use of dry electrode systems with a small number of sensors, and the possibility to discriminate between left and right MI tasks for both arms and legs, with a relatively high accuracy. The second part of this thesis presents a gait adaptation scheme in natural settings. This procedure allows the monitorization of subjects in more realistic environments without the requirement of specialized equipment such as treadmill and foot pressure sensors. Gait characteristics were extracted based on a single RGB camera, and EEG signals are monitored simultaneously. This method demonstrated that it is possible to detect adaptation steps with more than 90% accuracy, when subjects tries to adapt their walking speed to a higher or lower speed

Exploring Covert States of Brain Dynamics via Fuzzy Inference Encoding.

Human brain inherently exhibits latent mental processes which are likely to change rapidly over time. A framework that adopts a fuzzy inference system is proposed to model the dynamics of the human brain. The fuzzy inference system is used to encode real-world data to represent the salient features of the EEG signals. Then, an unsupervised clustering is conducted on the extracted feature space to identify the brain (external and covert) states that respond to different cognitive demands. To understand the human state change, a state transition diagram is introduced, allowing visualization of connectivity patterns between every pair of states. We compute the transition probability between every pair of states to represent the relationships between the states. This state transition diagram is named as the Fuzzy Covert State Transition Diagram (FCOSTD), which helps the understanding of human states and human performance. We then apply FCOSTD on distracted driving experiments. FCOSTD successfully discovers the external and covert states, faithfully reveals the transition of the brain between states, and the route of the state change when humans are distracted during a driving task. The experimental results demonstrate that different subjects have similar states and inter-state transition behaviour (establishing the consistency of the system) but different ways to allocate brain resources as different actions are being taken

Electrode Evaluation and Electrocortical Dynamics of Adapting to Small Perturbations during Treadmill Walking

Mobile brain-body imaging (MoBI) seeks to understand human brain and body dynamics during movement and locomotor tasks such as walking with perturbations that challenge balance and lead to adaptation of walking behavior. In this dissertation, I evaluated the long-term electromyography (EMG) recording performance of dry epidermal electrodes for measuring electrical muscle activity. I also evaluated the relationships between the signals recorded from the two sides of dual-sided electroencephalography (EEG) electrodes, a recent advancement in EEG electrode design for measuring electrical brain activity. Last, I investigated adaptation of brain and body responses to small and frequent perturbations during treadmill walking while I recorded brain activity using a custom-built dual-layer EEG system and body kinematics using motion capture. Dry epidermal electrodes provided better Signal Quality Indices, a metric I developed that accounts for signal-to-noise and signal-to-motion contributions, during limited dynamic movements, indicating that high-quality EMG for long-term recording was possible but also limited. For the dual-sided EEG electrode evaluation, I quantified correlations between dual-sided EEG signals in a benchtop experiment. Signals recorded from two sides of a dual-sided EEG electrode were highly correlated during constrained movements but degraded in more realistic random movements. This information is critical for developing EEG cleaning algorithms based on dual-layer EEG systems. For the locomotor adaptation studies, I quantified gait stability using margin of stability and its components and performed source localization and time-frequency analyses to determine electrocortical processes during perturbed walking. Small and frequent treadmill perturbations disrupted gait stability and quickly induced direction-dependent gait stability adaptation. Anterior cingulate theta-band adaptation occurred and was more evident during belt deceleration perturbations compared to belt acceleration perturbations. These results add new knowledge about the characteristics of novel EMG and EEG electrodes and revealed the potential of modulating perturbation direction to tune gait stability strategy and activation of electrocortical dynamics