Sistemas de interfaz cerebro-ordenador basados en dispositivos EEG de bajo coste y modelos neurodifusos aplicados a la imaginación de movimiento

[SPA] La presente tesis doctoral detalla la evaluación de un dispositivo de electroencefalografía de bajo coste a partir de su inclusión en un sistema de interfaz cerebro-máquina completo (BCI del inglés Brain-Computer Interfaces) basado en técnicas neurodifusas. El paradigma elegido se centra en la imaginación de movimiento multiclase sin realimentación, donde la operación es completamente asíncrona. También se ha aportado un avance en el área de la selección de características, desarrollando e implementando una metodología capaz de minimizar las componentes del vector de características necesarias para operar sistemas BCI, facilitando así la integración de éstos en plataformas móviles. En primer lugar, se ha seleccionado el dispositivo Emotiv EPOC en torno a criterios de coste, número de sensores, acceso a la señal capturada, ergonomía y relevancia para la comunidad científica. Del mismo modo, se ha abordado el problema definido en el BCI Competition III dataset V dada la disponibilidad de las señales capturadas sobre el cuero cabelludo por un equipo profesional, la exhaustiva definición del experimento y la facilidad para reproducirlo. Adicionalmente, la existencia de estudios utilizando estos mismos datos ha ofrecido una guía sobre las mejores técnicas a aplicar. Entre éstas destaca el modelo neurodifuso S-dFasArt, que hasta ahora ha presentado los mejores resultados cumpliendo las restricciones del problema. Por tanto, se ha construido un sistema BCI propio utilizando Emotiv EPOC como dispositivo de obtención de la señal EEG y S-dFasArt como sistema de inteligencia artificial. La valoración se ha realizado desde el punto de vista de un sistema BCI completo por lo que, en lugar de examinar la forma de la señal detectada, se ha calculado el rendimiento del mismo para datos capturados con diferentes equipos. Para ello se han comparado los resultados alcanzados tanto a partir de la base de datos BCI Competition como de cuatro conjuntos propios en los que han colaborado 19 voluntarios, quienes han participado en uno o varios experimentos. Se han incluido tanto sesiones utilizando Emotiv EPOC para la obtención de datos, como pruebas donde se ha utilizado una versión híbrida del mismo, en la cual se mantiene la unidad de procesamiento pero varía la tecnología y la ubicación de los sensores. Así, se ha demostrado que el sistema BCI construido integrando Emotiv EPOC junto al clasificador S-dFasArt alcanza una precisión asimilable a la lograda sobre datos capturados por equipos de investigación manteniendo el problema y la posición de los sensores. Además, la ubicación de los mismos sobre la corteza motora ha hecho posible un incremento en torno al 7% en el nivel de acierto medio (desde el 62% al 66.53 %). Igualmente, se ha corroborado la influencia positiva de la realimentación, que ha permitido lograr precisiones de por encima del 70% con Emotiv EPOC. Finamente, se ha presentado una metodología de selección de características en la que el S-dFasArt se ha integrado con modelos basados en combinaciones entre el método estadístico y el criterio difuso con la selección por orden y GMDH. La metodología desarrollada ha seleccionado automáticamente las componentes más relevantes del vector de características, alcanzando el modelo reducido obtenido por las diferentes variantes mejores resultados que el completo para dos de cada tres sujetos. Igualmente, la disminución del tamaño del conjunto de datos es muy significativa, presentando un decremento medio desde 168 a 5 características para la mejor combinación. [ENG] This PhD thesis details the evaluation process of a low-cost electroencephalography device when included into a brain-computer interface system (BCI) based on neuro-fuzzy techniques. The chosen paradigm focuses on the multi-class motor imagery problem, with no feedback and asynchronous operation. Also, a contribution to the feature selection area is presented, developing and implementing a new methodology able to minimise the number of feature vector components required to operate BCI systems, thus facilitating their integration into mobile platforms. First, the Emotiv EPOC EEG device has been selected after performing an economic evaluation considering cost and aspects such as the number of sensors, the available capabilities to access the raw brain data, the ergonomics and the relevance for the scientist community. Likewise, the BCI Competition III Dataset V defined problem has been undertaken. This has been chosen based on the availability of the raw brain signals, the detailed description of the experiment and the ability to reproduce it. Also, the existence of a number of research papers has provided guidance about the best performing approaches tackling this problem. Among then, the S-dFasArt neuro-fuzzy model has shown the best performance following the experiment rules so far. Therefore, a new BCI system has been built using Emotiv EPOC as a data capture device and S-dFasArt as an artificial intelligence unit. This assessment has been performed from the perspective of a complete BCI system so, instead of examining the shape of the detected brainwave, the performance of the setup using different data gathering devices has been analysed. Given that, a comparison of the results obtained has been performed processing data from several databases, including the BCI Competition and other four purposely-built datasets containing brain signals recorded from 19 volunteers participating in one or more experiments. Datasets include scalp potentials recorded using Emotiv EPOC as well as sessions recorded by a hybrid version of it, which maintains the processing unit while integrating a different sensor technology and allowing the setup at different electrode locations. Thus, the BCI system built integrating Emotiv EPOC and the S-dFasArt classiffier has shown an accuracy level comparable to that achieved using research EEG devices for the same problem and sensor locations. Besides, placing the electrodes over the motor cortex has allowed a 7% increase of the average success rate (from 62% to 66.53 %). Additionally, the importance of providing users with live feedback of their performance has been corroborated, obtaining accuracy levels above 70% using Emotiv EPOC. Finally, a new methodology where S- S-dFasArt is integrated with a combination of eit-her the statistic method or the fuzzy criteria and the order selection or GMDH has been introduced. The developed methodology has automatically selected the most relevant components from the feature vector, allowing the reduced model calculated from the different variations to achieve better than original accuracy levels for two out of three subjects. Moreover, a very significant average reduction from 168 to 5 features has been achieved for the highest performing combination.Escuela Internacional de Doctorado de la Universidad Politécnica de CartagenaUniversidad Politécnica de CartagenaPrograma de Doctorado en Tecnologías Industriales por la Universidad Politécnica de Cartagen

Designing an Interval Type-2 Fuzzy Logic System for Handling Uncertainty Effects in Brain–Computer Interface Classification of Motor Imagery Induced EEG Patterns

One of the urgent challenges in the automated analysis and interpretation of electrical brain activity is the effective handling of uncertainties associated with the complexity and variability of brain dynamics, reflected in the nonstationary nature of brain signals such as electroencephalogram (EEG). This poses a severe problem for existing approaches to the classification task within brain–computer interface (BCI) systems. Recently emerged type-2 fuzzy logic (T2FL) methodology has shown a remarkable potential in dealing with uncertain information given limited insight into the nature of the data generating mechanism. The objective of this work is thus to examine the applicability of T2FL approach to the problem of EEG pattern recognition. In particular, the focus is two-fold: i) the design methodology for the interval T2FL system (IT2FLS) that can robustly deal with inter-session as well as within-session manifestations of nonstationary spectral EEG correlates of motor imagery (MI), and ii) the comprehensive examination of the proposed fuzzy classifier in both off-line and on-line EEG classification case studies. The on-line evaluation of the IT2FLS-controlled real-time neurofeedback over multiple recording sessions holds special importance for EEG-based BCI technology. In addition, a retrospective comparative analysis accounting for other popular BCI classifiers such as linear discriminant analysis (LDA), kernel Fisher discriminant (KFD) and support vector machines (SVMs) as well as a conventional type-1 FLS (T1FLS), simulated off-line on the recorded EEGs, has demonstrated the enhanced potential of the proposed IT2FLS approach to robustly handle uncertainty effects in BCI classification

A motor imagery based brain-computer interface system via swarm-optimized fuzzy integral and its application

© 2016 IEEE. A brain-computer interface (BCI) system provides a convenient means of communication between the human brain and a computer, which is applied not only to healthy people but also for people that suffer from motor neuron diseases (MNDs). Motor imagery (MI) is one well-known basis for designing Electroencephalography (EEG)-based real-life BCI systems. However, EEG signals are often contaminated with severe noise and various uncertainties, imprecise and incomplete information streams. Therefore, this study proposes spectrum ensemble based on swam-optimized fuzzy integral for integrating decisions from sub-band classifiers that are established by a sub-band common spatial pattern (SBCSP) method. Firstly, the SBCSP effectively extracts features from EEG signals, and thereby the multiple linear discriminant analysis (MLDA) is employed during a MI classification task. Subsequently, particle swarm optimization (PSO) is used to regulate the subject-specific parameters for assigning optimal confidence levels for classifiers used in the fuzzy integral during the fuzzy fusion stage of the proposed system. Moreover, BCI systems usually tend to have complex architectures, be bulky in size, and require time-consuming processing. To overcome this drawback, a wireless and wearable EEG measurement system is investigated in this study. Finally, in our experimental result, the proposed system is found to produce significant improvement in terms of the receiver operating characteristic (ROC) curve. Furthermore, we demonstrate that a robotic arm can be reliably controlled using the proposed BCI system. This paper presents novel insights regarding the possibility of using the proposed MI-based BCI system in real-life applications

Genetically Engineered Adaptive Resonance Theory (art) Neural Network Architectures

Fuzzy ARTMAP (FAM) is currently considered to be one of the premier neural network architectures in solving classification problems. One of the limitations of Fuzzy ARTMAP that has been extensively reported in the literature is the category proliferation problem. That is Fuzzy ARTMAP has the tendency of increasing its network size, as it is confronted with more and more data, especially if the data is of noisy and/or overlapping nature. To remedy this problem a number of researchers have designed modifications to the training phase of Fuzzy ARTMAP that had the beneficial effect of reducing this phenomenon. In this thesis we propose a new approach to handle the category proliferation problem in Fuzzy ARTMAP by evolving trained FAM architectures. We refer to the resulting FAM architectures as GFAM. We demonstrate through extensive experimentation that an evolved FAM (GFAM) exhibits good (sometimes optimal) generalization, small size (sometimes optimal size), and requires reasonable computational effort to produce an optimal or sub-optimal network. Furthermore, comparisons of the GFAM with other approaches, proposed in the literature, which address the FAM category proliferation problem, illustrate that the GFAM has a number of advantages (i.e. produces smaller or equal size architectures, of better or as good generalization, with reduced computational complexity). Furthermore, in this dissertation we have extended the approach used with Fuzzy ARTMAP to other ART architectures, such as Ellipsoidal ARTMAP (EAM) and Gaussian ARTMAP (GAM) that also suffer from the ART category proliferation problem. Thus, we have designed and experimented with genetically engineered EAM and GAM architectures, named GEAM and GGAM. Comparisons of GEAM and GGAM with other ART architectures that were introduced in the ART literature, addressing the category proliferation problem, illustrate similar advantages observed by GFAM (i.e, GEAM and GGAM produce smaller size ART architectures, of better or improved generalization, with reduced computational complexity). Moverover, to optimally cover the input space of a problem, we proposed a genetically engineered ART architecture that combines the category structures of two different ART networks, FAM and EAM. We named this architecture UART (Universal ART). We analyzed the order of search in UART, that is the order according to which a FAM category or an EAM category is accessed in UART. This analysis allowed us to better understand UART\u27s functionality. Experiments were also conducted to compare UART with other ART architectures, in a similar fashion as GFAM and GEAM were compared. Similar conclusions were drawn from this comparison, as in the comparison of GFAM and GEAM with other ART architectures. Finally, we analyzed the computational complexity of the genetically engineered ART architectures and we compared it with the computational complexity of other ART architectures, introduced into the literature. This analytical comparison verified our claim that the genetically engineered ART architectures produce better generalization and smaller sizes ART structures, at reduced computational complexity, compared to other ART approaches. In review, a methodology was introduced of how to combine the answers (categories) of ART architectures, using genetic algorithms. This methodology was successfully applied to FAM, EAM and FAM and EAM ART architectures, with success, resulting in ART neural networks which outperformed other ART architectures, previously introduced into the literature, and quite often produced ART architectures that attained optimal classification results, at reduced computational complexity

A Survey of Adaptive Resonance Theory Neural Network Models for Engineering Applications

This survey samples from the ever-growing family of adaptive resonance theory (ART) neural network models used to perform the three primary machine learning modalities, namely, unsupervised, supervised and reinforcement learning. It comprises a representative list from classic to modern ART models, thereby painting a general picture of the architectures developed by researchers over the past 30 years. The learning dynamics of these ART models are briefly described, and their distinctive characteristics such as code representation, long-term memory and corresponding geometric interpretation are discussed. Useful engineering properties of ART (speed, configurability, explainability, parallelization and hardware implementation) are examined along with current challenges. Finally, a compilation of online software libraries is provided. It is expected that this overview will be helpful to new and seasoned ART researchers

Probabilistic graphical models for brain computer interfaces

Brain computer interfaces (BCI) are systems that aim to establish a new communication path for subjects who su er from motor disabilities, allowing interaction with the environment through computer systems. BCIs make use of a diverse group of physiological phenomena recorded using electrodes placed on the scalp (Electroencephalography, EEG) or electrodes placed directly over the brain cortex (Electrocorticography, ECoG). One commonly used phenomenon is the activity observed in specific areas of the brain in response to external events, called Event Related Potentials (ERP). Among those, a type of response called P300 is the most used phenomenon. The P300 has found application in spellers that make use of the brain's response to the presentation of a sequence of visual stimuli. Another commonly used phenomenon is the synchronization or desynchronization of brain rhythms during the execution or imagination of a motor task, which can be used to differentiate between two or more subject intentions. In the most basic scenario, a BCI system calculates the differences in the power of the EEG rhythms during execution of different tasks. Based on those differences, the BCI decides which task has been executed (e.g., motor imagination of left or right hand). Current approaches are mainly based on machine learning techniques that learn the distribution of the power values of the brain signals for each of the possible classes. In this thesis, making use of EEG and ECoG recording methods, we propose the use of probabilistic graphical models for brain computer interfaces. In the case of ERPs, in particular P300-based spellers, we propose the incorporation of language models at the level of words to increase significantly the performance of the spelling system. The proposed framework allows also the incorporation of different methods that take into account language models based on n-grams, all of this in an integrated structure whose parameters can be efficiently learned. In the context of execution or imagination of motor tasks, we propose techniques that take into account the temporal structure of the signals. Stochastic processes that model temporal dynamics of the brain signals in different frequency bands such as non-parametric Bayesian hidden Markov models are proposed in order to solve the problem of selection of the number of brain states during the execution of motor tasks as well as the selection of the number of components used to model the distribution of the brain signals. Following up on the same line of thought, hidden conditional random fields are proposed for classification of synchronous motor tasks. The combination of hidden states with the discriminative power of conditional random fields is shown to increase the classification performance of imaginary motor movements. In the context of asynchronous BCIs, we propose a method based on latent dynamic conditional random fields that is capable of modeling the internal temporal dynamics related to the generation of the brain signals, and external brain dynamics related to the execution of different mental tasks. Finally, in the context of asynchronous BCIs a model based on discriminative graphical models is presented for continuous classification of finger movements from ECoG data. We show that the incorporation of temporal dynamics of the brain signals in the classification stages increases significantly the classification accuracy of different mental states which can lead to a more effective interaction between the subject and the environment

Contribution to the study and design of advanced controllers : application to smelting furnaces

In this doctoral thesis, contributions to the study and design of advanced controllers and their application to metallurgical smelting furnaces are discussed. For this purpose, this kind of plants has been described in detail. The case of study is an Isasmelt plant in south Peru, which yearly processes 1.200.000 tons of copper concentrate. The current control system is implemented on a distributed control system. The main structure includes a cascade strategy to regulate the molten bath temperature. The manipulated variables are the oxygen enriched air and the oil feed rates. The enrichment rate is periodically adjusted by the operator in order to maintain the oxidizing temperature. This control design leads to large temperature deviations in the range between 15ºC and 30ºC from the set point, which causes refractory brick wear and lance damage, and subsequently high production costs. The proposed control structure is addressed to reduce the temperature deviations. The changes emphasize on better regulate the state variables of the thermodynamic equilibrium: the bath temperature within the furnace, the matte grade of molten sulfides (%Cu) and the silica (%SiO2) slag contents. The design is composed of a fuzzy module for adjusting the ratio oxygen/nitrogen and a metallurgical predictor for forecasting the molten composition. The fuzzy controller emulates the best furnace operator by manipulating the oxygen enrichment rate and the oil feed in order to control the bath temperature. The human model is selected taking into account the operator' practical experience in dealing with the furnace temperature (and taking into account good practices from the Australian Institute of Mining and Metallurgy). This structure is complemented by a neural network based predictor, which estimates measured variables of the molten material as copper (%Cu) and silica (%SiO2) contents. In the current method, those variables are calculated after carrying out slag chemistry assays at hourly intervals, therefore long time delays are introduced to the operation. For testing the proposed control structure, the furnace operation has been modeled based on mass and energy balances. This model has been simulated on a Matlab-Simulink platform (previously validated by comparing real and simulated output variables: bath temperature and tip pressure) as a reference to make technical comparisons between the current and the proposed control structure. To systematically evaluate the results of operations, it has been defined some original proposals on behavior indexes that are related to productivity and cost variables. These indexes, complemented with traditional indexes, allow assessing qualitatively the results of the control comparison. Such productivity based indexes complement traditional performance measures and provide fair information about the efficiency of the control system. The main results is that the use of the proposed control structure presents a better performance in regulating the molten bath temperature than using the current system (forecasting of furnace tapping composition is helpful to reach this improvement). The mean square relative error of temperature error is reduced from 0.72% to 0.21% (72%) and the temperature standard deviation from 27.8ºC to 11.1ºC (approx. 60%). The productivity indexes establish a lower consumption of raw materials (13%) and energy (29%).En esta tesis doctoral, se discuten contribuciones al estudio y diseño de controladores avanzados y su aplicación en hornos metalúrgicos de fundición. Para ello, se ha analizado este tipo de plantas en detalle. El caso de estudio es una planta Isasmelt en el sur de Perú, que procesa anualmente 1.200.000 toneladas de concentrado de cobre. El sistema de control actual opera sobre un sistema de control distribuido. La estructura principal incluye una estrategia de cascada para regular la temperatura del baño. Las variables manipuladas son el aire enriquecido con oxígeno y los flujos de alimentación de petróleo. La tasa de enriquecimiento se ajusta perióodicamente por el operador con el fin de mantener la temperatura de oxidación. Este diseño de control produce desviaciones de temperatura en el rango entre 15º C y 30º C con relación al valor de consigna, que causa desgastes del ladrillo refractario y daños a la lanza, lo cual encarece los costos de producción. La estructura de control propuesta esta orientada a reducir las desviaciones de temperatura. Los cambios consisten en mejorar el control de las variables de estado de equilibrio termodinámico: la temperatura del baño en el horno, el grado de mata (%Cu) y el contenido de escoria en la sílice (%SiO2). El diseño incluye un módulo difuso para ajustar la proporción oxígeno/nitrógeno y un predictor metalúrgico para estimar la composición del material fundido. El controlador difuso emula al mejor operador de horno mediante la manipulación de la tasa de enriquecimiento de oxígeno y alimentación con el fin de controlar la temperatura del baño del aceite. El modelo humano es seleccionado teniendo en cuenta la experiencia del operador en el control de la temperatura del horno (y considerando el principio de buenas prácticas del Instituto Australiano de Minería y Metalurgia). Esta estructura se complementa con un predictor basado en redes neuronales, que estima las variables medidas de material fundido como cobre (%Cu) y el contenido de sílice (%SiO2). En el método actual, esas variables se calculan después de ensayos de química de escoria a intervalos por hora, por lo tanto se introducen tiempos de retardo en la operación. Para probar la estructura de control propuesto, la operación del horno ha sido modelada en base a balances de masa y energía. Este modelo se ha simulado en una plataforma de Matlab-Simulink (previamente validada mediante la comparación de variables de salida real y lo simulado: temperatura de baño y presión en la punta de la lanza) como referencia para hacer comparaciones técnicas entre la actual y la estructura de control propuesta. Para evaluar sistemáticamente los resultados de estas operaciones, se han definido algunas propuestas originales sobre indicadores que se relacionan con las variables de productividad y costos. Estos indicadores, complementados con indicadores tradicionales, permite evaluar cualitativamente los resultados de las comparativas de control. Estos indicadores de productividad complementan las medidas de desempeño tradicionales y mejoran la información sobre la eficiencia de control. El resultado principal muestra que la estructura de control propuesta presenta un mejor rendimiento en el control de temperatura de baño fundido que el actual sistema de control. (La estimación de la composición del material fundido es de gran ayuda para alcanzar esta mejora). El error relativo cuadrático medio de la temperatura se reduce de 0,72% al 0,21% (72%) y la desviación estandar de temperatura de 27,8 C a 11,1 C (aprox. 60%). Los indicadores de productividad establecen asimismo un menor consumo de materias primas (13%) y de consumo de energía (29%)

Neuroengineering of Clustering Algorithms

Cluster analysis can be broadly divided into multivariate data visualization, clustering algorithms, and cluster validation. This dissertation contributes neural network-based techniques to perform all three unsupervised learning tasks. Particularly, the first paper provides a comprehensive review on adaptive resonance theory (ART) models for engineering applications and provides context for the four subsequent papers. These papers are devoted to enhancements of ART-based clustering algorithms from (a) a practical perspective by exploiting the visual assessment of cluster tendency (VAT) sorting algorithm as a preprocessor for ART offline training, thus mitigating ordering effects; and (b) an engineering perspective by designing a family of multi-criteria ART models: dual vigilance fuzzy ART and distributed dual vigilance fuzzy ART (both of which are capable of detecting complex cluster structures), merge ART (aggregates partitions and lessens ordering effects in online learning), and cluster validity index vigilance in fuzzy ART (features a robust vigilance parameter selection and alleviates ordering effects in offline learning). The sixth paper consists of enhancements to data visualization using self-organizing maps (SOMs) by depicting in the reduced dimension and topology-preserving SOM grid information-theoretic similarity measures between neighboring neurons. This visualization\u27s parameters are estimated using samples selected via a single-linkage procedure, thereby generating heatmaps that portray more homogeneous within-cluster similarities and crisper between-cluster boundaries. The seventh paper presents incremental cluster validity indices (iCVIs) realized by (a) incorporating existing formulations of online computations for clusters\u27 descriptors, or (b) modifying an existing ART-based model and incrementally updating local density counts between prototypes. Moreover, this last paper provides the first comprehensive comparison of iCVIs in the computational intelligence literature --Abstract, page iv