Spatio–Spectral Representation Learning for Electroencephalographic Gait-Pattern Classification

The brain plays a pivotal role in locomotion by coordinating muscles through interconnections that get established by the peripheral nervous system. To date, many attempts have been made to reveal the underlying mechanisms of humans' gait. However, decoding cortical processes associated with different walking conditions using EEG signals for gait-pattern classification is a less-explored research area. In this paper, we design an EEG-based experiment with four walking conditions (i.e., free walking, and exoskeleton-assisted walking at zero, low, and high assistive forces by the use of a unilateral exoskeleton to right lower limb). We proposed spatio-spectral representation learning (SSRL), a deep neural network topology with shared weights to learn the spatial and spectral representations of multi-channel EEG signals during walking. Adoption of weight sharing reduces the number of free parameters, while learning spatial and spectral equivariant features. SSRL outperformed state-of-the-art methods in decoding gait patterns, achieving a classification accuracy of 77.8%. Moreover, the features extracted in the intermediate layer of SSRL were observed to be more discriminative than the hand-crafted features. When analyzing the weights of the proposed model, we found an intriguing spatial distribution that is consistent with the distribution found in well-known motor-activated cortical regions. Our results show that SSRL advances the ability to decode human locomotion and it could have important implications for exoskeleton design, rehabilitation processes, and clinical diagnosis

Deep Learning in EEG: Advance of the Last Ten-Year Critical Period

Deep learning has achieved excellent performance in a wide range of domains, especially in speech recognition and computer vision. Relatively less work has been done for EEG, but there is still significant progress attained in the last decade. Due to the lack of a comprehensive and topic widely covered survey for deep learning in EEG, we attempt to summarize recent progress to provide an overview, as well as perspectives for future developments. We first briefly mention the artifacts removal for EEG signal and then introduce deep learning models that have been utilized in EEG processing and classification. Subsequently, the applications of deep learning in EEG are reviewed by categorizing them into groups such as brain-computer interface, disease detection, and emotion recognition. They are followed by the discussion, in which the pros and cons of deep learning are presented and future directions and challenges for deep learning in EEG are proposed. We hope that this paper could serve as a summary of past work for deep learning in EEG and the beginning of further developments and achievements of EEG studies based on deep learning

Intelligent Biosignal Analysis Methods

This book describes recent efforts in improving intelligent systems for automatic biosignal analysis. It focuses on machine learning and deep learning methods used for classification of different organism states and disorders based on biomedical signals such as EEG, ECG, HRV, and others

A novel EEG based linguistic BCI

While a human being can think coherently, physical limitations no matter how severe, should never become disabling. Thinking and cognition are performed and expressed through language, which is the most natural form of human communication. The use of covert speech tasks for BCIs has been successfully achieved for invasive and non-invasive systems. In this work, by incorporating the most recent discoveries on the spatial, temporal, and spectral signatures of word production, a novel system is designed, which is custom-build for linguistic tasks. Other than paying attention and waiting for the onset cue, this BCI requires absolutely no cognitive effort from the user and operates using automatic linguistic functions of the brain in the first 312ms post onset, which is also completely out of the control of the user and immune from inconsistencies. With four classes, this online BCI achieves classification accuracy of 82.5%. Each word produces a signature as unique as its phonetic structure, and the number of covert speech tasks used in this work is limited by computational power. We demonstrated that this BCI can successfully use wireless dry electrode EEG systems, which are becoming as capable as traditional laboratory grade systems. This frees the potential user from the confounds of the lab, facilitating real-world application. Considering that the number of words used in daily life does not exceed 2000, the number of words used by this type of novel BCI may indeed reach this number in the future, with no need to change the current system design or experimental protocol. As a promising step towards noninvasive synthetic telepathy, this system has the potential to not only help those in desperate need, but to completely change the way we communicate with our computers in the future as covert speech is much easier than any form of manual communication and control

Interaction dynamics and autonomy in cognitive systems

The concept of autonomy is of crucial importance for understanding life and cognition. Whereas cellular and organismic autonomy is based in the self-production of the material infrastructure sustaining the existence of living beings as such, we are interested in how biological autonomy can be expanded into forms of autonomous agency, where autonomy as a form of organization is extended into the behaviour of an agent in interaction with its environment (and not its material self-production). In this thesis, we focus on the development of operational models of sensorimotor agency, exploring the construction of a domain of interactions creating a dynamical interface between agent and environment. We present two main contributions to the study of autonomous agency: First, we contribute to the development of a modelling route for testing, comparing and validating hypotheses about neurocognitive autonomy. Through the design and analysis of specific neurodynamical models embedded in robotic agents, we explore how an agent is constituted in a sensorimotor space as an autonomous entity able to adaptively sustain its own organization. Using two simulation models and different dynamical analysis and measurement of complex patterns in their behaviour, we are able to tackle some theoretical obstacles preventing the understanding of sensorimotor autonomy, and to generate new predictions about the nature of autonomous agency in the neurocognitive domain. Second, we explore the extension of sensorimotor forms of autonomy into the social realm. We analyse two cases from an experimental perspective: the constitution of a collective subject in a sensorimotor social interactive task, and the emergence of an autonomous social identity in a large-scale technologically-mediated social system. Through the analysis of coordination mechanisms and emergent complex patterns, we are able to gather experimental evidence indicating that in some cases social autonomy might emerge based on mechanisms of coordinated sensorimotor activity and interaction, constituting forms of collective autonomous agency

Diagnosis of low-speed bearings via vibration-based entropy indicators and acoustic emissions

Tesi del Pla de doctorat industrial de la Generalitat de Catalunya. Tesi en modalitat compendi de publicacions, amb diferents seccions retallades per drets dels editorsWind energy is one ofthe main renewable energies to replace fossil fuels in the generation of electricityworldwide. To enhance and accelerate its implementation at a large scale, it is vital to reduce the costs associated with maintenance. As com ponent breakages force the turbine to stop for long repair times, the wind industry m ust switch from the old-fashioned preventive or corrective maintenance to condition-based maintenance (also called predictive maintenance). The condition­based maintenance of pitch bearings is especiallychallenging, as the operating conditions include high mechanical stress and low rotational speed. Since these operating conditions im pact negatively on the results of the standard methods and techniques applied in current condition-based monitoring systems, the condition-based maintenance of pitch bearings is still a challenge. Therefore, this thes is is focused on the research of novel methods and techniques that obtain reliable information on the state of pitch bearings for condition-based maintenance. lnitially, the acknowledgment ofthe state ofthe art is performed to recognize the methods and signals. This step endorses the decision to analyze the vibration signals and acoustic emissions throughout this thesis. Due to the particular operating conditions of pitch bearings, this research states the need to create data sets to replicate the particular operating conditions in a controlled laboratory experiment. As a res ult, a datas et based on vibrations, and a second datas et based on acoustic emissions are generated. The vibration datas et allows the validation of a novel algorithm for the low-speed bearing diagnosis, which is based on the concept of entropy by the definition of Shannon and Rényi. In com parison to the classical methods found in the literature, the diagnosis of low-speed bearings based on entropy-based indicators can extract more reliable information. Moreover, the research of the com bination of several indicators to improve the diagnosis revea Is that the entropy-based indicators can extract more information than regular indicators used in academia. The datas et of acoustic emissions from low-speed bearings helps to contribute to the development of methods for diagnosis. In this research, the analysis of the energyfrom the signals reveals a dependencyon the intensityand the presence of damage. In addition, a relation between the waveform ofthe analyzed energy and the existence of damage is em phas ized.La energía eólica es una de las principales energías renovables consideradas para reemplazar los combustibles fósiles en la generación de electricidad a nivel mundial. Para mejorar y acelerar su implementación a gran escala, es vital reducir los costes asociados con el mantenimiento. Como las roturas de los componentes obligan a la turbina a detenerse durante largos períodos de reparación, la industria eólica necesita cambiar del anticuado mantenimiento preventiv o correctivo al mantenimiento basado en la condición (también llamado mantenimiento predictivo). El mantenimiento basado en la condición de los rodamientos pitch es especialmente desafiante, porque las condiciones de operación incluyen un alto estrés mecánico y bajas velocidades de rotación. Debido a que estas condiciones de operación impactan negativamente en los resultados de los métodos y técnicas estándar aplicados en los sistemas actuales de monitoreo basados en el estado, el mantenimiento basado en el estado de los rodamientos pitch sigue siendo un desafío. Por tanto, esta tesis se centra en la investigación de métodos y técnicas novedosas que obtengan información fiable sobre el estado de los rodamientos pitch para el mantenimiento basado en la condición. Inicialmente, se realiza el reconocimiento del estado del arte para reconocer los métodos y señales utilizados. Este paso avala la decisión de analizar las señales de vibración y las emisiones acústicas a lo largo de esta tesis. Debido a las condiciones de funcionamiento particulares de los rodamientos pitch, esta investigación reconoce la necesidad de crear un conjunto de datos para replicar las condiciones de funcionamiento particulares del rodamiento pitch en una experiencia de laboratorio controlado. Como resultado, se genera un conjunto de datos basado en vibraciones y un segundo conjunto de datos basado en emisiones acústicas. El conjunto de datos de vibraciones permite la validación de un algoritmo novedoso para el diagnóstico de rodamientos de baja velocidad, el cual se basa en el concepto de la entropía según la definición de Shannon y Rényi. En comparación con los métodos clásicos que se encuentran en la literatura, el diagnóstico de rodamientos de baja velocidad basado en indicadores basados en la entropía puede extraer información más confiable. Además, la investigación de la combinación de varios indicadores para mejorar el diagnóstico revela que los indicadores basados en la entropía pueden extraer más información que los indicadores habituales utilizados en la academia. El conjunto de datos de las emisiones acústicas de los rodamientos de baja velocidad ayuda a contribuir al desarrollo de métodos de diagnóstico. En esta investigación, el análisis de la energía de las señales revela una dependencia de la intensidad y la presencia de daño. Además, se enfatiza una relación entre la forma de onda de la energía analizada y la existencia de daño.L'energia eòlica és una de les principals energies renovables considerades per reemplaçar els combustibles fòssils en la generació d'electricitat a nivell mundial. Per millorar i accelerar la seva implementació a gran escala, és vital reduir els costos associats amb el manteniment. Com els trencaments dels components obliguen a la turbina a aturar-se durant llargs períodes de reparació, la industria eòlica necessita canviar de l'antiquat manteniment preventiu o correctiu al manteniment basat en la condició (també anomenat manteniment predictiu). El manteniment basat en la condició dels rodaments de pas és especialment desafiant, perquè les condicions d’operació inclouen un alt estrès mecànic i baixes velocitats de rotació. A causa de que aquestes condicions d’operació impacten negativament en els resultats dels mètodes i tècniques estàndard aplicats en els sistemes actuals de monitorització basats en l'estat, el manteniment basat en l'estat dels rodaments de pas segueix sent un desafiament. Per tant, aquesta tesi se centra en la investigació de mètodes i tècniques noves que obtinguin informació fiable sobre l'estat dels rodaments de pas per al manteniment basat en la condició. Inicialment, es realitza el reconeixement de l'estat de l'art per reconèixer els mètodes i senyals utilitzats. Aquest pas avala la decisió d'analitzar els senyals de vibració i les emissions acústiques al llarg d'aquesta tesi. A causa de les condicions de funcionament particulars dels rodaments de pas, aquesta investigació reconeix la necessitat de crear un conjunt de dades per replicar les condicions de funcionament particulars del rodament de pas en un experiment de laboratori controlat. Com a resultat, es genera un conjunt de dades basat en vibracions i un segon conjunt de dades basat en emissions acústiques. El conjunt de dades de vibracions permet la validació d'un algoritme nou per al diagnòstic de rodaments de baixa velocitat, el qual es basa en el concepte de l'entropia segons la definició de Shannon i Renyi. En comparació amb els mètodes clàssics que es troben a la literatura, el diagnòstic de rodaments de baixa velocitat basat en indicadors basats en l'entropia pot extreure informació més fiable. A més, la investigació de la combinació de diversos indicadors per millorar el diagnòstic revela que els indicadors basats en l'entropia poden extreure més informació que els indicadors habituals utilitzats en la literatura. El conjunt de dades de les emissions acústiques dels rodaments de baixa velocitat ajuda a contribuir al desenvolupament de mètodes de diagnòstic. En aquesta investigació, l’anàlisi de l'energia de les senyals revela una dependència de la intensitat i la presència de dany. A més, s'emfatitza una relació entre la forma d'ona de l'energia analitzada i l’existència de dany.Energia eolikoa mundu mailan elektrizitatea sortu eta erregai fosilak ordezkatzeko energia berriztagarri nagusietako bat da. Eskala handiko ezarpena hobetu eta bizkortzeko, ezinbestekoa da mantentze-lanekin lotutako kostuak murriztea. Osagaien hausturek turbina konponketa-aldi luzeetan gelditzera behartzen dutenez, industria eolikoak mantentze-lan prebentibo edo zuzentzaile zaharkitutik egoeran oinarritutako mantentzelanetara aldatu behar du (mantentze-lan prediktiboa ere esaten zaio). Pitch errodamenduen egoeran oinarritutako mantentzea bereziki desa atzailea da, tentsio mekaniko handiak jasaten baitituzte eta errotazio-abiadura txikietan egoten baitira abian. Operaziobaldintza horiek eragin negatiboa dutenez egoeran oinarritutako egungo monitorizazio sistemetan erabiltzen diren metodo eta teknika estandarren emaitzetan, pitch errodamenduen egoeran oinarritutako mantentze-lanak erronka bat izaten jarraitzen du. Tesi hau egoeran oinarritutako mantenurako pitch errodamenduen egoerari buruzko informazio dagarria lortzen duten metodo eta teknika berritzaileen ikerketan oinarritzen da. Hasieran, teknologiaren egungo egoera aztertzen da, erabilitako metodoak eta seinaleak ezagutzeko. Urrats honek tesi honetan zehar bibrazio-seinaleak eta emisio akustikoak aztertzeko erabakia bermatzen du. Pitch errodamenduen funtzionamendu baldintza bereziak direla eta, ikerketa honek adierazten du beharrezkoa dela datu multzo bat sortzea pitch errodamenduaren funtzionamendu baldintza partikularrak erreplikatzeko laborategi kontrolatuko testuinguru batean. Ondorioz, bibrazioetan oinarritutako datu-multzo bat eta emisio akustikoetan oinarritutako bigarren datu-multzo bat sortzen dira. Bibrazioen datu-multzoak abiadura txikiko errodamenduen diagnostikorako algoritmo berritzaile bat baliozkotzea ahalbidetzen du, zeina entropiaren kontzeptuan oinarritzen baita Shannon eta R enyiren de nizioaren arabera. Literaturan dauden metodo klasikoekin alderatuta, entropian oinarritutako adierazleek abiadura txikiko errodamenduen diagnostikorako informazio dagarriagoa atera dezakete. Gainera, diagnostikoa hobetzeko hainbat adierazleren konbinazioaren ikerketak agerian uzten du entropian oinarritutako adierazleek akademian erabiltzen diren ohiko adierazleek baino informazio gehiago atera dezaketela. Abiadura txikiko errodamenduen emisio akustikoen datu multzoak diagnostiko metodoak garatzen laguntzen du. Ikerketa lan honetan, seinaleen energiaren azterketak intentsitatearekiko eta kaltearen presentziarekiko dependentzia adierazten du. Gainera, aztertutako energiaren uhin-formaren eta kaltearen arteko erlazioa nabarmentzen da.Postprint (published version