Deep Dictionary Learning: A PARametric NETwork Approach

Deep dictionary learning seeks multiple dictionaries at different image scales to capture complementary coherent characteristics. We propose a method for learning a hierarchy of synthesis dictionaries with an image classification goal. The dictionaries and classification parameters are trained by a classification objective, and the sparse features are extracted by reducing a reconstruction loss in each layer. The reconstruction objectives in some sense regularize the classification problem and inject source signal information in the extracted features. The performance of the proposed hierarchical method increases by adding more layers, which consequently makes this model easier to tune and adapt. The proposed algorithm furthermore, shows remarkably lower fooling rate in presence of adversarial perturbation. The validation of the proposed approach is based on its classification performance using four benchmark datasets and is compared to a CNN of similar size

Unsupervised Dictionary Learning for Anomaly Detection

We investigate the possibilities of employing dictionary learning to address the requirements of most anomaly detection applications, such as absence of supervision, online formulations, low false positive rates. We present new results of our recent semi-supervised online algorithm, TODDLeR, on a anti-money laundering application. We also introduce a novel unsupervised method of using the performance of the learning algorithm as indication of the nature of the samples.Comment: in Proceedings of iTWIST'20, Paper-ID: 09, Nantes, France, December, 2-4, 202

Automatic Identification of Epileptic Seizures from EEG Signals using Sparse Representation-based Classification

Identifying seizure activities in non-stationary electroencephalography (EEG) is a challenging task, since it is time-consuming, burdensome, and dependent on expensive human resources and subject to error and bias. A computerized seizure identification scheme can eradicate the above problems, assist clinicians and benefit epilepsy research. So far, several attempts were made to develop automatic systems to help neurophysiologists accurately identify epileptic seizures. In this research, a fully automated system is presented to automatically detect the various states of the epileptic seizure. The proposed method is based on sparse representation-based classification (SRC) theory and the proposed dictionary learning using electroencephalogram (EEG) signals. Furthermore, the proposed method does not require additional preprocessing and extraction of features which is common in the existing methods. The proposed method reached the sensitivity, specificity and accuracy of 100% in 8 out of 9 scenarios. It is also robust to the measurement noise of level as much as 0 dB. Compared to state-of-the-art algorithms and other common methods, the proposed method outperformed them in terms of sensitivity, specificity and accuracy. Moreover, it includes the most comprehensive scenarios for epileptic seizure detection, including different combinations of 2 to 5 class scenarios. The proposed automatic identification of epileptic seizures method can reduce the burden on medical professionals in analyzing large data through visual inspection as well as in deprived societies suffering from a shortage of functional magnetic resonance imaging (fMRI) equipment and specialized physician

Sparse Modeling for Image and Vision Processing

In recent years, a large amount of multi-disciplinary research has been conducted on sparse models and their applications. In statistics and machine learning, the sparsity principle is used to perform model selection---that is, automatically selecting a simple model among a large collection of them. In signal processing, sparse coding consists of representing data with linear combinations of a few dictionary elements. Subsequently, the corresponding tools have been widely adopted by several scientific communities such as neuroscience, bioinformatics, or computer vision. The goal of this monograph is to offer a self-contained view of sparse modeling for visual recognition and image processing. More specifically, we focus on applications where the dictionary is learned and adapted to data, yielding a compact representation that has been successful in various contexts.Comment: 205 pages, to appear in Foundations and Trends in Computer Graphics and Visio