Deep fusion of multi-channel neurophysiological signal for emotion recognition and monitoring

How to fuse multi-channel neurophysiological signals for emotion recognition is emerging as a hot research topic in community of Computational Psychophysiology. Nevertheless, prior feature engineering based approaches require extracting various domain knowledge related features at a high time cost. Moreover, traditional fusion method cannot fully utilise correlation information between different channels and frequency components. In this paper, we design a hybrid deep learning model, in which the 'Convolutional Neural Network (CNN)' is utilised for extracting task-related features, as well as mining inter-channel and inter-frequency correlation, besides, the 'Recurrent Neural Network (RNN)' is concatenated for integrating contextual information from the frame cube sequence. Experiments are carried out in a trial-level emotion recognition task, on the DEAP benchmarking dataset. Experimental results demonstrate that the proposed framework outperforms the classical methods, with regard to both of the emotional dimensions of Valence and Arousal

Two-dimensional matrix algorithm using detrended fluctuation analysis to distinguish Burkitt and diffuse large B-cell lymphoma

Copyright © 2012 Rong-Guan Yeh et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.A detrended fluctuation analysis (DFA) method is applied to image analysis. The 2-dimensional (2D) DFA algorithms is proposed for recharacterizing images of lymph sections. Due to Burkitt lymphoma (BL) and diffuse large B-cell lymphoma (DLBCL), there is a significant different 5-year survival rates after multiagent chemotherapy. Therefore, distinguishing the difference between BL and DLBCL is very important. In this study, eighteen BL images were classified as group A, which have one to five cytogenetic changes. Ten BL images were classified as group B, which have more than five cytogenetic changes. Both groups A and B BLs are aggressive lymphomas, which grow very fast and require more intensive chemotherapy. Finally, ten DLBCL images were classified as group C. The short-term correlation exponent α1 values of DFA of groups A, B, and C were 0.370 ± 0.033, 0.382 ± 0.022, and 0.435 ± 0.053, respectively. It was found that α1 value of BL image was significantly lower (P < 0.05) than DLBCL. However, there is no difference between the groups A and B BLs. Hence, it can be concluded that α1 value based on DFA statistics concept can clearly distinguish BL and DLBCL image.National Science Council (NSC) of Taiwan the Center for Dynamical Biomarkers and Translational Medicine, National Central University, Taiwan (also sponsored by National Science Council)

Computational study of resting state network dynamics

Lo scopo di questa tesi è quello di mostrare, attraverso una simulazione con il software The Virtual Brain, le più importanti proprietà della dinamica cerebrale durante il resting state, ovvero quando non si è coinvolti in nessun compito preciso e non si è sottoposti a nessuno stimolo particolare. Si comincia con lo spiegare cos’è il resting state attraverso una breve revisione storica della sua scoperta, quindi si passano in rassegna alcuni metodi sperimentali utilizzati nell’analisi dell’attività cerebrale, per poi evidenziare la differenza tra connettività strutturale e funzionale. In seguito, si riassumono brevemente i concetti dei sistemi dinamici, teoria indispensabile per capire un sistema complesso come il cervello. Nel capitolo successivo, attraverso un approccio ‘bottom-up’, si illustrano sotto il profilo biologico le principali strutture del sistema nervoso, dal neurone alla corteccia cerebrale. Tutto ciò viene spiegato anche dal punto di vista dei sistemi dinamici, illustrando il pionieristico modello di Hodgkin-Huxley e poi il concetto di dinamica di popolazione. Dopo questa prima parte preliminare si entra nel dettaglio della simulazione. Prima di tutto si danno maggiori informazioni sul software The Virtual Brain, si definisce il modello di network del resting state utilizzato nella simulazione e si descrive il ‘connettoma’ adoperato. Successivamente vengono mostrati i risultati dell’analisi svolta sui dati ricavati, dai quali si mostra come la criticità e il rumore svolgano un ruolo chiave nell'emergenza di questa attività di fondo del cervello. Questi risultati vengono poi confrontati con le più importanti e recenti ricerche in questo ambito, le quali confermano i risultati del nostro lavoro. Infine, si riportano brevemente le conseguenze che porterebbe in campo medico e clinico una piena comprensione del fenomeno del resting state e la possibilità di virtualizzare l’attività cerebrale

A Study of Nonlinear Dynamics of EEG Responses to Simulated Unmanned Vehicle Tasks

In the contemporary world, mental workload becomes higher as technology evolves and task demand becomes overwhelming. The operators of a system are usually required to complete tasks with higher complicity within a shorter period of time. Continuous operation under a high level of mental workload can be a major source of risk and human error, thus put the operator in a hazardous working environment. Therefore, it is necessary to monitor and assess mental workload. In this study, an unmanned vehicle operation with visual detection tasks was investigated by means of nonlinear analysis of EEG time series. Nonlinear analysis is considered more advantageous compared with traditional power spectrum analysis of EEG. Besides, nonlinear analysis is more capable to capture the nature of EEG data and human performance, which is a process that subjects to constant changes. By examining the nonlinear dynamics of EEG, it is more likely to obtain a deeper understanding of brain activity. The objective of this study is to investigate the mental workload under different task levels through the examination of brain activity via nonlinear dynamics of EEG time series in simulated unmanned ground vehicle visual detection tasks. The experiment was conducted by the team lead by Dr. Lauren Reinerman Jones at Institute for Simulation & Training, University of Central Florida. One hundred and fifty subjects participated the experiment to complete four visual detection task scenarios (1) change detection, (2) threat detection task, (3) dual task with different change detection task rates, and (4) dual task with different threat detection task rates. Their EEG was recorded during performing the tasks at nine EEG channels. This study develops a massive data processing program to calculate the largest Lyapunov exponent, correlation dimension of the EEG data. This study also develops the program for performing 0-1 test on the EEG data in Python language environment. The result of this study verifies the existence of chaotic dynamics in EEG time series, reveals the change in brain activity as the effect of changing task demand in more detailed level, and obtains new insights from the psychophysiological mental workload measurement used in the preliminary study. The results of this study verified the existence of the chaotic dynamics in the EEG time series. This study also supported the hypothesis that EEG data exhibits change in the level of nonlinearity corresponding to differed task levels. The nonlinear analysis of EEG time series data is able to discriminate the change in brain activity derived from the changes in task load. All nonlinear dynamics analysis techniques used in this study is able to find the difference of nonlinearity in EEG among task levels, as well as between single task scenario and dual task scenario

Medical Images Encryption Based on Adaptive-Robust Multi-Mode Synchronization of Chen Hyper-Chaotic Systems

In this paper, a novel medical image encryption method based on multi-mode synchronization of hyper-chaotic systems is presented. The synchronization of hyper-chaotic systems is of great significance in secure communication tasks such as encryption of images. Multi-mode synchronization is a novel and highly complex issue, especially if there is uncertainty and disturbance. In this work, an adaptive-robust controller is designed for multimode synchronized chaotic systems with variable and unknown parameters, despite the bounded disturbance and uncertainty with a known function in two modes. In the first case, it is a main system with some response systems, and in the second case, it is a circular synchronization. Using theorems it is proved that the two synchronization methods are equivalent. Our results show that, we are able to obtain the convergence of synchronization error and parameter estimation error to zero using Lyapunov’s method. The new laws to update time-varying parameters, estimating disturbance and uncertainty bounds are proposed such that stability of system is guaranteed. To assess the performance of the proposed synchronization method, various statistical analyzes were carried out on the encrypted medical images and standard benchmark images. The results show effective performance of the proposed synchronization technique in the medical images encryption for telemedicine application.MINECO/ FEDER under the RTI2018-098913-B100 CV20-45250 and A-TIC- 080-UGR18 project

Detecting partial synchrony in a complex oscillatory network using pseudo-vortices

Partial synchronization is characteristic phase dynamics of coupled oscillators on various natural and artificial networks, which can remain undetected due to the complexity of the systems. With an analogy between pairwise asynchrony of oscillators and topological defects, i.e., vortices, in the two-dimensional XY spin model, we propose a robust and data-driven method to identify the partial synchronization on complex networks. The proposed method is based on an integer matrix whose element is pseudo-vorticity that discretely quantifies asynchronous phase dynamics in every two oscillators, which results in graphical and entropic representations of partial synchrony. As a first trial, we apply our method to 200 FitzHugh-Nagumo neurons on a complex small-world network. Partially synchronized chimera states are revealed by discriminating synchronized states even with phase lags. Such phase lags also appear in partial synchronization in chimera states. Our topological, graphical, and entropic method is implemented solely with measurable phase dynamics data, which will lead to a straightforward application to general oscillatory networks including neural networks in the brain.Comment: 9 pages, 5 figure

Recent Applications in Graph Theory

Graph theory, being a rigorously investigated field of combinatorial mathematics, is adopted by a wide variety of disciplines addressing a plethora of real-world applications. Advances in graph algorithms and software implementations have made graph theory accessible to a larger community of interest. Ever-increasing interest in machine learning and model deployments for network data demands a coherent selection of topics rewarding a fresh, up-to-date summary of the theory and fruitful applications to probe further. This volume is a small yet unique contribution to graph theory applications and modeling with graphs. The subjects discussed include information hiding using graphs, dynamic graph-based systems to model and control cyber-physical systems, graph reconstruction, average distance neighborhood graphs, and pure and mixed-integer linear programming formulations to cluster networks

Brain-Computer Interface

Brain-computer interfacing (BCI) with the use of advanced artificial intelligence identification is a rapidly growing new technology that allows a silently commanding brain to manipulate devices ranging from smartphones to advanced articulated robotic arms when physical control is not possible. BCI can be viewed as a collaboration between the brain and a device via the direct passage of electrical signals from neurons to an external system. The book provides a comprehensive summary of conventional and novel methods for processing brain signals. The chapters cover a range of topics including noninvasive and invasive signal acquisition, signal processing methods, deep learning approaches, and implementation of BCI in experimental problems