Adversarial Black-Box Attacks on Automatic Speech Recognition Systems using Multi-Objective Evolutionary Optimization

Fooling deep neural networks with adversarial input have exposed a significant vulnerability in the current state-of-the-art systems in multiple domains. Both black-box and white-box approaches have been used to either replicate the model itself or to craft examples which cause the model to fail. In this work, we propose a framework which uses multi-objective evolutionary optimization to perform both targeted and un-targeted black-box attacks on Automatic Speech Recognition (ASR) systems. We apply this framework on two ASR systems: Deepspeech and Kaldi-ASR, which increases the Word Error Rates (WER) of these systems by upto 980%, indicating the potency of our approach. During both un-targeted and targeted attacks, the adversarial samples maintain a high acoustic similarity of 0.98 and 0.97 with the original audio.Comment: Published in Interspeech 201

Ensemble of heterogeneous flexible neural trees using multiobjective genetic programming

Machine learning algorithms are inherently multiobjective in nature, where approximation error minimization and model's complexity simplification are two conflicting objectives. We proposed a multiobjective genetic programming (MOGP) for creating a heterogeneous flexible neural tree (HFNT), tree-like flexible feedforward neural network model. The functional heterogeneity in neural tree nodes was introduced to capture a better insight of data during learning because each input in a dataset possess different features. MOGP guided an initial HFNT population towards Pareto-optimal solutions, where the final population was used for making an ensemble system. A diversity index measure along with approximation error and complexity was introduced to maintain diversity among the candidates in the population. Hence, the ensemble was created by using accurate, structurally simple, and diverse candidates from MOGP final population. Differential evolution algorithm was applied to fine-tune the underlying parameters of the selected candidates. A comprehensive test over classification, regression, and time-series datasets proved the efficiency of the proposed algorithm over other available prediction methods. Moreover, the heterogeneous creation of HFNT proved to be efficient in making ensemble system from the final population

Towards an Information Theoretic Framework for Evolutionary Learning

The vital essence of evolutionary learning consists of information flows between the environment and the entities differentially surviving and reproducing therein. Gain or loss of information in individuals and populations due to evolutionary steps should be considered in evolutionary algorithm theory and practice. Information theory has rarely been applied to evolutionary computation - a lacuna that this dissertation addresses, with an emphasis on objectively and explicitly evaluating the ensemble models implicit in evolutionary learning. Information theoretic functionals can provide objective, justifiable, general, computable, commensurate measures of fitness and diversity. We identify information transmission channels implicit in evolutionary learning. We define information distance metrics and indices for ensembles. We extend Price\u27s Theorem to non-random mating, give it an effective fitness interpretation and decompose it to show the key factors influencing heritability and evolvability. We argue that heritability and evolvability of our information theoretic indicators are high. We illustrate use of our indices for reproductive and survival selection. We develop algorithms to estimate information theoretic quantities on mixed continuous and discrete data via the empirical copula and information dimension. We extend statistical resampling. We present experimental and real world application results: chaotic time series prediction; parity; complex continuous functions; industrial process control; and small sample social science data. We formalize conjectures regarding evolutionary learning and information geometry

A novel multi-objective evolutionary algorithm based on space partitioning

To design an e ective multi-objective optimization evolutionary algorithms (MOEA), we need to address the following issues: 1) the sensitivity to the shape of true Pareto front (PF) on decomposition-based MOEAs; 2) the loss of diversity due to paying so much attention to the convergence on domination-based MOEAs; 3) the curse of dimensionality for many-objective optimization problems on grid-based MOEAs. This paper proposes an MOEA based on space partitioning (MOEA-SP) to address the above issues. In MOEA-SP, subspaces, partitioned by a k-dimensional tree (kd-tree), are sorted according to a bi-indicator criterion de ned in this paper. Subspace-oriented and Max-Min selection methods are introduced to increase selection pressure and maintain diversity, respectively. Experimental studies show that MOEA-SP outperforms several compared algorithms on a set of benchmarks

An Effective Ensemble Framework for Multi-Objective Optimization

This work was supported by the National Natural Science Foundation of China under Grants 61876110, 61876163, and 61836005, a grant from ANR/RGC Joint Research Scheme sponsored by the Research Grants Council of the Hong Kong Special Administrative Region, China and France National Research Agency (Project No. A-CityU101/16), the Joint Funds of the National Natural Science Foundation of China under Key Program Grant U1713212, and CONACyT grant no. 221551.Peer reviewedPostprin

Multi-class protein fold recognition using multi-objective evolutionary algorithms

Protein fold recognition (PFR) is an important approach to structure discovery without relying on sequence similarity. In pattern recognition terminology, PFR is a multiclass classification problem to be solved by employing feature analysis and pattern classification techniques. This work reformulates PFR into a multiobjective optimization problem and proposes a multiobjective feature analysis and selection algorithm (MOFASA). We use support vector machines as the classifier. Experimental results on the structural classification of protein (SCOP) data set indicate that MOFASA is capable of achieving comparable performances to the existing results. In addition, MOFASA identifies relevant features for further biological analysis