Aesthetic Highlight Detection in Movies Based on Synchronization of Spectators’ Reactions.

Detection of aesthetic highlights is a challenge for understanding the affective processes taking place during movie watching. In this paper we study spectators’ responses to movie aesthetic stimuli in a social context. Moreover, we look for uncovering the emotional component of aesthetic highlights in movies. Our assumption is that synchronized spectators’ physiological and behavioral reactions occur during these highlights because: (i) aesthetic choices of filmmakers are made to elicit specific emotional reactions (e.g. special effects, empathy and compassion toward a character, etc.) and (ii) watching a movie together causes spectators’ affective reactions to be synchronized through emotional contagion. We compare different approaches to estimation of synchronization among multiple spectators’ signals, such as pairwise, group and overall synchronization measures to detect aesthetic highlights in movies. The results show that the unsupervised architecture relying on synchronization measures is able to capture different properties of spectators’ synchronization and detect aesthetic highlights based on both spectators’ electrodermal and acceleration signals. We discover that pairwise synchronization measures perform the most accurately independently of the category of the highlights and movie genres. Moreover, we observe that electrodermal signals have more discriminative power than acceleration signals for highlight detection

Filling the G_ap_s: Multivariate Time Series Imputation by Graph Neural Networks

Dealing with missing values and incomplete time series is a labor-intensive, tedious, inevitable task when handling data coming from real-world applications. Effective spatio-temporal representations would allow imputation methods to reconstruct missing temporal data by exploiting information coming from sensors at different locations. However, standard methods fall short in capturing the nonlinear time and space dependencies existing within networks of interconnected sensors and do not take full advantage of the available - and often strong - relational information. Notably, most state-of-the-art imputation methods based on deep learning do not explicitly model relational aspects and, in any case, do not exploit processing frameworks able to adequately represent structured spatio-temporal data. Conversely, graph neural networks have recently surged in popularity as both expressive and scalable tools for processing sequential data with relational inductive biases. In this work, we present the first assessment of graph neural networks in the context of multivariate time series imputation. In particular, we introduce a novel graph neural network architecture, named GRIN, which aims at reconstructing missing data in the different channels of a multivariate time series by learning spatio-temporal representations through message passing. Empirical results show that our model outperforms state-of-the-art methods in the imputation task on relevant real-world benchmarks with mean absolute error improvements often higher than 20%.Comment: Accepted at ICLR 202

Analysis of the propagation of uterine electrical activity applied to predict preterm labor

There are many open questions concerning the functioning of the human uterus. One of these open questions concerns exactly how the uterus operates as an organ to perform the very organized act of contracting in a synchronized fashion to expulse a new human into this world. If we don‟t understand how it works when it is working normally, it is obvious that we will not be as capable of intervening or preventing when, sometimes with tragic consequences, it does not do its job properly and a child is born before it is ready. The aim of our research is to be able to understand what the electrical activity of the uterus can tell us about the risk of premature birth, to understand better how the uterus works and to benefit from these understanding to find tool that can be used for labor detection and prediction of preterm labor. This idea of using the externally detected electrical activity of the uterus (electrohysterogram or EHG) to predict preterm labor is not new and lot of work has already been put into it. The novel approach in this work is not to use the signal collected from one or two isolated places on the expectant mother‟s abdomen but to map the propagation of the signals and to investigate the auto organization of the contractions. We therefore use a matrix of electrodes to give us a much more complete picture of the organization and operation of the uterus as pregnancy reaches its conclusion. Labor is the physiologic process by which a fetus is expelled from the uterus to the outside world and is defined as regular uterine contractions accompanied by cervical effacement and dilatation. In the normal labor, the uterine contractions and cervix dilatation are preceded by biochemical changes in the cervical connective tissue.Il reste beaucoup de questions ouvertes concernant le fonctionnement de l'utérus humain. L'une de ces questions est comment l'utérus fonctionne en tant qu‟organe organisé pour générer une contraction synchrone et expulser un nouvel être humain dans ce monde ? Si nous ne comprenons pas comment l‟utérus fonctionne, quand il fonctionne normalement, il est évident que nous ne serons pas en mesure d'intervenir ou de prévoir quand, avec parfois des conséquences tragiques, il ne fait pas son travail correctement et qu‟un enfant nait avant d‟être prêt ! Le but de notre recherche est de comprendre ce que l'activité électrique de l'utérus peut nous apporter sur la prévention du risque de naissance prématurée, de mieux comprendre comment fonctionne l'utérus et de bénéficier de ces connaissances pour développer un outil qui peut être utilisé pour la détection de l‟accouchement et la prédiction du travail prématuré. Cette idée d'utiliser l'activité électrique détectée à la surface de l‟abdomen (ou électrohystérogramme EHG) pour prédire un accouchement prématuré n'est pas nouvelle et beaucoup de travaux ont déjà été mis en oeuvre. La nouvelle approche dans ce travail n‟est pas d‟utiliser le signal recueilli par un ou deux endroits isolés sur l'abdomen de la future mère, mais de cartographier la propagation des signaux et d‟explorer l'auto organisation des contractions. Nous utilisons donc une matrice d'électrodes pour nous donner une image beaucoup plus complète de l'organisation et du fonctionnement de l'utérus. L‟accouchement est le processus physiologique par lequel le foetus est expulsé de l'utérus vers le monde extérieur. Il est défini comme la survenue de contractions utérines régulières accompagnées de l'effacement du col et de la dilatation cervicale. Dans le travail normal, les contractions de l'utérus et la dilatation du col sont précédées par des changements biochimiques du tissu conjonctif du col utérin

Etude de la propagation de l’activité électrique utérine dans une optique clinique: Application à la détection des menaces d’accouchement prématuré.

Uterine contractions are essentially controlled by two physiological phenomena: cell excitability and propagation of uterine electrical activity probably related to high and low frequencies of uterine electromyogram, called electrohysterogram -EHG-, respectively. All previous studies have been focused on extracting parameters from the high frequency part and did not show a satisfied potential for clinical application. The objective of this thesis is the analysis of the propagation EHG signals of during pregnancy and labor in the view of extracting tool for clinical application. A novelty of our thesis is the multichannel recordings by using 4x4 electrodes matrix posed on the woman abdomen. Monovariate analysis was aimed to investigate the nonlinear characteristics of EHG signals. Bivariate and multivariate analyses have been done to analyze the propagation of the EHG signals by detecting the connectivity between the signals. An increase of the nonlinearity associated by amplitude synchronization and phase desynchronization were detected. Results indicate a highest EHG propagation during labor than pregnancy and an increase of this propagation with the week of gestations. The results show the high potential of propagation’s parameters in clinical point of view such as labor detection and then preterm labor prediction. We proposed novel combination of Blind Source Separation and empirical mode decomposition to denoise monopolar EHG as a possible way to increase the classification rate of pregnancy and labor.Les contractions utérines sont contrôlées par deux phénomènes physiologiques: l'excitabilité cellulaire et la propagation de l'activité électrique utérine probablement liées aux hautes et basses fréquences de l’electrohysterograme (EHG) respectivement. Toutes les études précédentes ont porté sur l'extraction de paramètres de la partie haute fréquence et n'ont pas montré un potentiel satisfait pour l'application clinique. L'objectif de cette thèse est l'analyse de propagation de l'EHG pendant la grossesse et le travail dans la vue de l'extraction des outils pour une application clinique. Une des nouveautés de la thèse est l’enregistrement multicanaux à l'aide d’une matrice d'électrodes 4x4 posée sur l'abdomen de la femme. Analyse monovariés visait à étudier les caractéristiques non linéaires des signaux EHG, analyses bivariées et multivariées ont été effectuées pour analyser la propagation des signaux EHG par la détection de la connectivité entre les signaux. Une augmentation de la non-linéarité associée par une synchronisation en amplitude et de désynchronisation en phase a été détectée. Les résultats indiquent plus de propagation au cours du travail que la grossesse et une augmentation de cette propagation avec les semaines de gestations. Les résultats montrent le potentiel élevé de paramètres de propagation dans le point de vue clinique tel que la détection du travail et de prédiction du travail prématuré. Finalement, nous avons proposé une nouvelle combinaison entre Séparation Aveugles de Sources et la Décomposition en Modes Empiriques pour débruiter les signaux EHG monopolaires comme un moyen possible d'augmenter le taux de classification de signaux grossesse et l'accouchement

Etude de la propagation de l‟activité électrique utérine dans une optique clinique : Application a la détection des menaces d‟accouchement prématuré

Uterine contractions are essentially controlled by two physiological phenomena: cell excitability and propagation of uterine electrical activity probably related to high and low frequencies of uterine electromyogram, called electrohysterogram -EHG-, respectively. All previous studies have been focused on extracting parameters from the high frequency part and did not show a satisfied potential for clinical application. The objective of this thesis is the analysis of the propagation EHG signals of during pregnancy and labor in the view of extracting tool for clinical application. A novelty of our thesis is the multichannel recordings by using 4x4 electrodes matrix posed on the woman abdomen. Monovariate analysis was aimed to investigate the nonlinear characteristics of EHG signals. Bivariate and multivariate analyses have been done to analyze the propagation of the EHG signals by detecting the connectivity between the signals. An increase of the nonlinearity associated by amplitude synchronization and phase desynchronization were detected. Results indicate a highest EHG propagation during labor than pregnancy and an increase of this propagation with the week of gestations. The results show the high potential of propagation‟s parameters in clinical point of view such as labor detection and then preterm labor prediction. We proposed novel combination of Blind Source Separation and empirical mode decomposition to denoise monopolar EHG as a possible way to increase the classification rate of pregnancy and labor.Les contractions utérines sont contrôlées par deux phénomènes physiologiques: l'excitabilité cellulaire et la propagation de l'activité électrique utérine probablement liées aux hautes et basses fréquences de l‟electrohysterograme (EHG) respectivement. Toutes les études précédentes ont porté sur l'extraction de paramètres de la partie haute fréquence et n'ont pas montré un potentiel satisfait pour l'application clinique. L'objectif de cette thèse est l'analyse de propagation de l'EHG pendant la grossesse et le travail dans la vue de l'extraction des outils pour une application clinique. Une des nouveautés de la thèse est l‟enregistrement multicanaux à l'aide d‟une matrice d'électrodes 4x4 posée sur l'abdomen de la femme. Analyse monovariés visait à étudier les caractéristiques non linéaires des signaux EHG, analyses bivariées et multivariées ont été effectuées pour analyser la propagation des signaux EHG par la détection de la connectivité entre les signaux. Une augmentation de la non- linéarité associée par une synchronisation en amplitude et de désynchronisation en phase a été détectée. Les résultats indiquent plus de propagation au cours du travail que la grossesse et une augmentation de cette propagation avec les semaines de gestations. Les résultats montrent le potentiel élevé de paramètres de propagation dans le point de vue clinique tel que la détection du travail et de prédiction du travail prématuré. Finalement, nous avons proposé une nouvelle combinaison entre Séparation Aveugles de Sources et la Décomposition en Modes Empiriques pour débruiter les signaux EHG monopolaires comme un moyen possible d'augmenter le taux de classification de signaux grossesse et l'accouchement

Data cleaning and knowledge discovery in process data

This dissertation presents several methods for overcoming the Big Data challenges, with an emphasis on data cleaning and knowledge discovery in process data. Data cleaning and knowledge discovery is chosen as a main research area here due to its importance from both theoretical and practical points of view. Theoretical background and recent developments of data cleaning methods are reviewed from four aspects: missing data imputation, outlier detection, noise removal and time delay estimation. Moreover, the impact of contaminated data on model performance and corresponding improvement obtained by data cleaning methods are analyzed through both simulated and industrial case studies. The results provide a starting point for further advanced methodology development. It is hard to find a universally applicable method for data cleaning since every data set may have its own distinctive features. Thus, we have to customize available methods so that the quality of the data set is guaranteed. An integrated data cleaning scheme is proposed, which incorporates model building and performance evaluation, to provide guidance in tuning the parameters of data cleaning methods and prevent over-cleaning. A case study based on industrial data has been used to verify the feasibility and effectiveness of the proposed new method, during which a partial least squares (PLS) model was built and three univariate data cleaning procedures is tested. A time series Kalman filter (TSKF) is proposed that successfully handles outlier detection in dynamic systems, where normal process changes often mask the existence of outliers. The TSKF method combines a time series model fitting procedure with a modified Kalman filter to deal with additive outlier (AO) and innovational outlier (IO) detection problems in dynamic process data set. A comparative analysis of TSKF and available methods is performed on simulated and real chemical plant data. Root cause diagnosis of plant-wide oscillations, as a concrete example of data cleaning and knowledge discovery in the process data, is provided. Plant-wide oscillations can negatively influence the overall control performance of the process and the detection results are often affected by noise at different frequency ranges. To address such a problem, an information transfer method combining spectral envelope algorithm with spectral transfer entropy is proposed to detect and diagnose such oscillations within a specific frequency range, mitigating the effects from measurement noise. The feasibility and effectiveness of the proposed method are verified and compared with available methods through both simulated and industrial case studies.Chemical Engineerin

Learning to Reconstruct Missing Data from Spatiotemporal Graphs with Sparse Observations

Modeling multivariate time series as temporal signals over a (possibly dynamic) graph is an effective representational framework that allows for developing models for time series analysis. In fact, discrete sequences of graphs can be processed by autoregressive graph neural networks to recursively learn representations at each discrete point in time and space. Spatiotemporal graphs are often highly sparse, with time series characterized by multiple, concurrent, and long sequences of missing data, e.g., due to the unreliable underlying sensor network. In this context, autoregressive models can be brittle and exhibit unstable learning dynamics. The objective of this paper is, then, to tackle the problem of learning effective models to reconstruct, i.e., impute, missing data points by conditioning the reconstruction only on the available observations. In particular, we propose a novel class of attention-based architectures that, given a set of highly sparse discrete observations, learn a representation for points in time and space by exploiting a spatiotemporal propagation architecture aligned with the imputation task. Representations are trained end-to-end to reconstruct observations w.r.t. the corresponding sensor and its neighboring nodes. Compared to the state of the art, our model handles sparse data without propagating prediction errors or requiring a bidirectional model to encode forward and backward time dependencies. Empirical results on representative benchmarks show the effectiveness of the proposed method.Comment: Accepted at NeurIPS 202

Network-based brain computer interfaces: principles and applications

Brain-computer interfaces (BCIs) make possible to interact with the external environment by decoding the mental intention of individuals. BCIs can therefore be used to address basic neuroscience questions but also to unlock a variety of applications from exoskeleton control to neurofeedback (NFB) rehabilitation. In general, BCI usability critically depends on the ability to comprehensively characterize brain functioning and correctly identify the user s mental state. To this end, much of the efforts have focused on improving the classification algorithms taking into account localized brain activities as input features. Despite considerable improvement BCI performance is still unstable and, as a matter of fact, current features represent oversimplified descriptors of brain functioning. In the last decade, growing evidence has shown that the brain works as a networked system composed of multiple specialized and spatially distributed areas that dynamically integrate information. While more complex, looking at how remote brain regions functionally interact represents a grounded alternative to better describe brain functioning. Thanks to recent advances in network science, i.e. a modern field that draws on graph theory, statistical mechanics, data mining and inferential modelling, scientists have now powerful means to characterize complex brain networks derived from neuroimaging data. Notably, summary features can be extracted from these networks to quantitatively measure specific organizational properties across a variety of topological scales. In this topical review, we aim to provide the state-of-the-art supporting the development of a network theoretic approach as a promising tool for understanding BCIs and improve usability