Learning to Transform Time Series with a Few Examples

We describe a semi-supervised regression algorithm that learns to transform one time series into another time series given examples of the transformation. This algorithm is applied to tracking, where a time series of observations from sensors is transformed to a time series describing the pose of a target. Instead of defining and implementing such transformations for each tracking task separately, our algorithm learns a memoryless transformation of time series from a few example input-output mappings. The algorithm searches for a smooth function that fits the training examples and, when applied to the input time series, produces a time series that evolves according to assumed dynamics. The learning procedure is fast and lends itself to a closed-form solution. It is closely related to nonlinear system identification and manifold learning techniques. We demonstrate our algorithm on the tasks of tracking RFID tags from signal strength measurements, recovering the pose of rigid objects, deformable bodies, and articulated bodies from video sequences. For these tasks, this algorithm requires significantly fewer examples compared to fully-supervised regression algorithms or semi-supervised learning algorithms that do not take the dynamics of the output time series into account

Data Visualization, Dimensionality Reduction, and Data Alignment via Manifold Learning

The high dimensionality of modern data introduces significant challenges in descriptive and exploratory data analysis. These challenges gave rise to extensive work on dimensionality reduction and manifold learning aiming to provide low dimensional representations that preserve or uncover intrinsic patterns and structures in the data. In this thesis, we expand the current literature in manifold learning developing two methods called DIG (Dynamical Information Geometry) and GRAE (Geometry Regularized Autoencoders). DIG is a method capable of finding low-dimensional representations of high-frequency multivariate time series data, especially suited for visualization. GRAE is a general framework which splices the well-established machinery from kernel manifold learning methods to recover a sensitive geometry, alongside the parametric structure of autoencoders. Manifold learning can also be useful to study data collected from different measurement instruments, conditions, or protocols of the same underlying system. In such cases the data is acquired in a multi-domain representation. The last two Chapters of this thesis are devoted to two new methods capable of aligning multi-domain data, leveraging their geometric structure alongside limited common information. First, we present DTA (Diffusion Transport Alignment), a semi-supervised manifold alignment method that exploits prior one-to-one correspondence knowledge between distinct data views and finds an aligned common representation. And finally, we introduce MALI (Manifold Alignment with Label Information). Here we drop the one-to-one prior correspondences assumption, since in many scenarios such information can not be provided, either due to the nature of the experimental design, or it becomes extremely costly. Instead, MALI only needs side-information in the form of discrete labels/classes present in both domains

A global portrait of expressed mental health signals towards COVID-19 in social media space

Globally, the COVID-19 pandemic has induced a mental health crisis. Social media data offer a unique oppor- tunity to track the mental health signals of a given population and quantify their negativity towards COVID-19. To date, however, we know little about how negative sentiments differ across countries and how these relate to the shifting policy landscape experienced through the pandemic. Using 2.1 billion individual-level geotagged tweets posted between 1 February 2020 and 31 March 2021, we track, monitor and map the shifts in negativity across 217 countries and unpack its relationship with COVID-19 policies. Findings reveal that there are important geographic, demographic, and socioeconomic disparities of negativity across continents, different levels of a nation’s income, population density, and the level of COVID-19 infection. Countries with more stringent policies were associated with lower levels of negativity, a relationship that weakened in later phases of the pandemic. This study provides the first global and multilingual evaluation of the public’s real-time mental health signals to COVID-19 at a large spatial and temporal scale. We offer an empirical framework to monitor mental health signals globally, helping international authorizations, including the United Nations and World Health Organi- zation, to design smart country-specific mental health initiatives in response to the ongoing pandemic and future public emergencies

Temporal Aspect Aware Graph Neural Network in Cybersecurity

Žít v dynamickém světě znamená řešit časově závislé úlohy. Avšak moderní nástroje pro strojové učení na grafech jsou především navržené pro statické sítě. Proto se v této závěrečné práci detailně zabývám problematikou strojového učení respektujícího časový aspekt pro grafové úlohy. Výsledkem tohoto teoretického výzkumu je návrh dynamické grafové neuronové sítě se spojitým časem. Zaměřuji se na problém Cisco Cognitive Intelligence maliciousness classification --- úlohu odhalení internetových domén s bezpečnostním rizikem na základě interakcí mezi uživateli a doménami. Ukazuji, že tento problém lze efektivně vyřešit použitím různých přístupů strojového učení, včetně navrženého. Navíc demonstruji, že obecné zákonitostí bezpečnostního rizika domén nevykazují dynamické vlastnosti v uvažovaných datech z reálného světa.Living in a dynamic world means dealing with time-dependent tasks. However, the modern toolbox for machine learning on graphs is mainly designed for static networks. Therefore, in this thesis, I deepen into the problematics of temporal-aware machine learning approaches for graph problems. The outcome of this study is a proposal for the new continuous-time dynamic graph neural network. I focus on the Cisco Cognitive Intelligence maliciousness classification problem --- the task of malicious Internet domain exposure based on user-domain interactions. I demonstrate that this problem can be efficiently solved employing different approaches, including the proposed one. Moreover, I show that general maliciousness patterns do not exhibit dynamic properties in the considered real-world data

OscoNet: Inferring oscillatory gene networks

Background: Oscillatory genes, with periodic expression at the mRNA and/or protein level, have been shown to play a pivotal role in many biological contexts. However, with the exception of the circadian clock and cell cycle, only a few such genes are known. Detecting oscillatory genes from snapshot single-cell experiments is a challenging task due to the lack of time information. Oscope is a recently proposed method to identify co-oscillatory gene pairs using single-cell RNA-seq data. Although promising, the current implementation of Oscope does not provide a principled statistical criterion for selecting oscillatory genes. Results: We improve the optimisation scheme underlying Oscope and provide a wellcalibrated non-parametric hypothesis test to select oscillatory genes at a given FDR threshold. We evaluate performance on synthetic data and three real datasets and show that our approach is more sensitive than the original Oscope formulation, discovering larger sets of known oscillators while avoiding the need for less interpretable thresholds. We also describe how our proposed pseudo-time estimation method is more accurate in recovering the true cell order for each gene cluster while requiring substantially less computation time than the extended nearest insertion approach. Conclusions: OscoNet is a robust and versatile approach to detect oscillatory gene networks from snapshot single-cell data addressing many of the limitations of the original Oscope method

Simultaneous Learning of Nonlinear Manifold and Dynamical Models for High-dimensional Time Series

The goal of this work is to learn a parsimonious and informative representation for high-dimensional time series. Conceptually, this comprises two distinct yet tightly coupled tasks: learning a low-dimensional manifold and modeling the dynamical process. These two tasks have a complementary relationship as the temporal constraints provide valuable neighborhood information for dimensionality reduction and conversely, the low-dimensional space allows dynamics to be learnt efficiently. Solving these two tasks simultaneously allows important information to be exchanged mutually. If nonlinear models are required to capture the rich complexity of time series, then the learning problem becomes harder as the nonlinearities in both tasks are coupled. The proposed solution approximates the nonlinear manifold and dynamics using piecewise linear models. The interactions among the linear models are captured in a graphical model. By exploiting the model structure, efficient inference and learning algorithms are obtained without oversimplifying the model of the underlying dynamical process. Evaluation of the proposed framework with competing approaches is conducted in three sets of experiments: dimensionality reduction and reconstruction using synthetic time series, video synthesis using a dynamic texture database, and human motion synthesis, classification and tracking on a benchmark data set. In all experiments, the proposed approach provides superior performance.National Science Foundation (IIS 0308213, IIS 0329009, CNS 0202067

On human motion prediction using recurrent neural networks

Human motion modelling is a classical problem at the intersection of graphics and computer vision, with applications spanning human-computer interaction, motion synthesis, and motion prediction for virtual and augmented reality. Following the success of deep learning methods in several computer vision tasks, recent work has focused on using deep recurrent neural networks (RNNs) to model human motion, with the goal of learning time-dependent representations that perform tasks such as short-term motion prediction and long-term human motion synthesis. We examine recent work, with a focus on the evaluation methodologies commonly used in the literature, and show that, surprisingly, state-of-the-art performance can be achieved by a simple baseline that does not attempt to model motion at all. We investigate this result, and analyze recent RNN methods by looking at the architectures, loss functions, and training procedures used in state-of-the-art approaches. We propose three changes to the standard RNN models typically used for human motion, which result in a simple and scalable RNN architecture that obtains state-of-the-art performance on human motion prediction.Comment: Accepted at CVPR 1