Efficient Learning Machines

Computer scienc

Diffeomorphic Transformations for Time Series Analysis: An Efficient Approach to Nonlinear Warping

The proliferation and ubiquity of temporal data across many disciplines has sparked interest for similarity, classification and clustering methods specifically designed to handle time series data. A core issue when dealing with time series is determining their pairwise similarity, i.e., the degree to which a given time series resembles another. Traditional distance measures such as the Euclidean are not well-suited due to the time-dependent nature of the data. Elastic metrics such as dynamic time warping (DTW) offer a promising approach, but are limited by their computational complexity, non-differentiability and sensitivity to noise and outliers. This thesis proposes novel elastic alignment methods that use parametric \& diffeomorphic warping transformations as a means of overcoming the shortcomings of DTW-based metrics. The proposed method is differentiable \& invertible, well-suited for deep learning architectures, robust to noise and outliers, computationally efficient, and is expressive and flexible enough to capture complex patterns. Furthermore, a closed-form solution was developed for the gradient of these diffeomorphic transformations, which allows an efficient search in the parameter space, leading to better solutions at convergence. Leveraging the benefits of these closed-form diffeomorphic transformations, this thesis proposes a suite of advancements that include: (a) an enhanced temporal transformer network for time series alignment and averaging, (b) a deep-learning based time series classification model to simultaneously align and classify signals with high accuracy, (c) an incremental time series clustering algorithm that is warping-invariant, scalable and can operate under limited computational and time resources, and finally, (d) a normalizing flow model that enhances the flexibility of affine transformations in coupling and autoregressive layers.Comment: PhD Thesis, defended at the University of Navarra on July 17, 2023. 277 pages, 8 chapters, 1 appendi

Sparse Modeling for Image and Vision Processing

In recent years, a large amount of multi-disciplinary research has been conducted on sparse models and their applications. In statistics and machine learning, the sparsity principle is used to perform model selection---that is, automatically selecting a simple model among a large collection of them. In signal processing, sparse coding consists of representing data with linear combinations of a few dictionary elements. Subsequently, the corresponding tools have been widely adopted by several scientific communities such as neuroscience, bioinformatics, or computer vision. The goal of this monograph is to offer a self-contained view of sparse modeling for visual recognition and image processing. More specifically, we focus on applications where the dictionary is learned and adapted to data, yielding a compact representation that has been successful in various contexts.Comment: 205 pages, to appear in Foundations and Trends in Computer Graphics and Visio

Advances in Data Mining Knowledge Discovery and Applications

Advances in Data Mining Knowledge Discovery and Applications aims to help data miners, researchers, scholars, and PhD students who wish to apply data mining techniques. The primary contribution of this book is highlighting frontier fields and implementations of the knowledge discovery and data mining. It seems to be same things are repeated again. But in general, same approach and techniques may help us in different fields and expertise areas. This book presents knowledge discovery and data mining applications in two different sections. As known that, data mining covers areas of statistics, machine learning, data management and databases, pattern recognition, artificial intelligence, and other areas. In this book, most of the areas are covered with different data mining applications. The eighteen chapters have been classified in two parts: Knowledge Discovery and Data Mining Applications

Advanced analyses of physiological signals and their role in Neonatal Intensive Care

Preterm infants admitted to the neonatal intensive care unit (NICU) face an array of life-threatening diseases requiring procedures such as resuscitation and invasive monitoring, and other risks related to exposure to the hospital environment, all of which may have lifelong implications. This thesis examined a range of applications for advanced signal analyses in the NICU, from identifying of physiological patterns associated with neonatal outcomes, to evaluating the impact of certain treatments on physiological variability. Firstly, the thesis examined the potential to identify infants at risk of developing intraventricular haemorrhage, often interrelated with factors leading to preterm birth, mechanical ventilation, hypoxia and prolonged apnoeas. This thesis then characterised the cardiovascular impact of caffeine therapy which is often administered to prevent and treat apnoea of prematurity, finding greater pulse pressure variability and enhanced responsiveness of the autonomic nervous system. Cerebral autoregulation maintains cerebral blood flow despite fluctuations in arterial blood pressure and is an important consideration for preterm infants who are especially vulnerable to brain injury. Using various time and frequency domain correlation techniques, the thesis found acute changes in cerebral autoregulation of preterm infants following caffeine therapy. Nutrition in early life may also affect neurodevelopment and morbidity in later life. This thesis developed models for identifying malnutrition risk using anthropometry and near-infrared interactance features. This thesis has presented a range of ways in which advanced analyses including time series analysis, feature selection and model development can be applied to neonatal intensive care. There is a clear role for such analyses in early detection of clinical outcomes, characterising the effects of relevant treatments or pathologies and identifying infants at risk of later morbidity