An Evolutionary Algorithm for the Estimation of Threshold Vector Error Correction Models

We develop an evolutionary algorithm to estimate Threshold Vector Error Correction models (TVECM) with more than two cointegrated variables. Since disregarding a threshold in cointegration models renders standard approaches to the estimation of the cointegration vectors inefficient, TVECM necessitate a simultaneous estimation of the cointegration vector(s) and the threshold. As far as two cointegrated variables are considered this is commonly achieved by a grid search. However, grid search quickly becomes computationally unfeasible if more than two variables are cointegrated. Therefore, the likelihood function has to be maximized using heuristic approaches. Depending on the precise problem structure the evolutionary approach developed in the present paper for this purpose saves 90 to 99 per cent of the computation time of a grid search.evolutionary strategy, genetic algorithm, TVECM

Evolvability signatures of generative encodings: beyond standard performance benchmarks

Evolutionary robotics is a promising approach to autonomously synthesize machines with abilities that resemble those of animals, but the field suffers from a lack of strong foundations. In particular, evolutionary systems are currently assessed solely by the fitness score their evolved artifacts can achieve for a specific task, whereas such fitness-based comparisons provide limited insights about how the same system would evaluate on different tasks, and its adaptive capabilities to respond to changes in fitness (e.g., from damages to the machine, or in new situations). To counter these limitations, we introduce the concept of "evolvability signatures", which picture the post-mutation statistical distribution of both behavior diversity (how different are the robot behaviors after a mutation?) and fitness values (how different is the fitness after a mutation?). We tested the relevance of this concept by evolving controllers for hexapod robot locomotion using five different genotype-to-phenotype mappings (direct encoding, generative encoding of open-loop and closed-loop central pattern generators, generative encoding of neural networks, and single-unit pattern generators (SUPG)). We observed a predictive relationship between the evolvability signature of each encoding and the number of generations required by hexapods to adapt from incurred damages. Our study also reveals that, across the five investigated encodings, the SUPG scheme achieved the best evolvability signature, and was always foremost in recovering an effective gait following robot damages. Overall, our evolvability signatures neatly complement existing task-performance benchmarks, and pave the way for stronger foundations for research in evolutionary robotics.Comment: 24 pages with 12 figures in the main text, and 4 supplementary figures. Accepted at Information Sciences journal (in press). Supplemental videos are available online at, see http://goo.gl/uyY1R

Bias and variance in continuous EDA

International audienceEstimation of Distribution Algorithms are based on statistical estimates. We show that when combining classical tools from statistics, namely bias/variance decomposition, reweighting and quasi-randomization, we can strongly improve the convergence rate. All modifications are easy, compliant with most algorithms, and experimentally very efficient in particular in the parallel case (large offsprings)

Information-geometric optimization with natural selection

Evolutionary algorithms, inspired by natural evolution, aim to optimize difficult objective functions without computing derivatives. Here we detail the relationship between population genetics and evolutionary optimization and formulate a new evolutionary algorithm. Optimization of a continuous objective function is analogous to searching for high fitness phenotypes on a fitness landscape. We summarize how natural selection moves a population along the non-euclidean gradient that is induced by the population on the fitness landscape (the natural gradient). Under normal approximations common in quantitative genetics, we show how selection is related to Newton's method in optimization. We find that intermediate selection is most informative of the fitness landscape. We describe the generation of new phenotypes and introduce an operator that recombines the whole population to generate variants that preserve normal statistics. Finally, we introduce a proof-of-principle algorithm that combines natural selection, our recombination operator, and an adaptive method to increase selection. Our algorithm is similar to covariance matrix adaptation and natural evolutionary strategies in optimization, and has similar performance. The algorithm is extremely simple in implementation with no matrix inversion or factorization, does not require storing a covariance matrix, and may form the basis of more general model-based optimization algorithms with natural gradient updates.Comment: changed titl

The ASD Living Biology: from cell proliferation to clinical phenotype.

Autism spectrum disorder (ASD) has captured the attention of scientists, clinicians and the lay public because of its uncertain origins and striking and unexplained clinical heterogeneity. Here we review genetic, genomic, cellular, postmortem, animal model, and cell model evidence that shows ASD begins in the womb. This evidence leads to a new theory that ASD is a multistage, progressive disorder of brain development, spanning nearly all of prenatal life. ASD can begin as early as the 1st and 2nd trimester with disruption of cell proliferation and differentiation. It continues with disruption of neural migration, laminar disorganization, altered neuron maturation and neurite outgrowth, disruption of synaptogenesis and reduced neural network functioning. Among the most commonly reported high-confidence ASD (hcASD) genes, 94% express during prenatal life and affect these fetal processes in neocortex, amygdala, hippocampus, striatum and cerebellum. A majority of hcASD genes are pleiotropic, and affect proliferation/differentiation and/or synapse development. Proliferation and subsequent fetal stages can also be disrupted by maternal immune activation in the 1st trimester. Commonly implicated pathways, PI3K/AKT and RAS/ERK, are also pleiotropic and affect multiple fetal processes from proliferation through synapse and neural functional development. In different ASD individuals, variation in how and when these pleiotropic pathways are dysregulated, will lead to different, even opposing effects, producing prenatal as well as later neural and clinical heterogeneity. Thus, the pathogenesis of ASD is not set at one point in time and does not reside in one process, but rather is a cascade of prenatal pathogenic processes in the vast majority of ASD toddlers. Despite this new knowledge and theory that ASD biology begins in the womb, current research methods have not provided individualized information: What are the fetal processes and early-age molecular and cellular differences that underlie ASD in each individual child? Without such individualized knowledge, rapid advances in biological-based diagnostic, prognostic, and precision medicine treatments cannot occur. Missing, therefore, is what we call ASD Living Biology. This is a conceptual and paradigm shift towards a focus on the abnormal prenatal processes underlying ASD within each living individual. The concept emphasizes the specific need for foundational knowledge of a living child's development from abnormal prenatal beginnings to early clinical stages. The ASD Living Biology paradigm seeks this knowledge by linking genetic and in vitro prenatal molecular, cellular and neural measurements with in vivo post-natal molecular, neural and clinical presentation and progression in each ASD child. We review the first such study, which confirms the multistage fetal nature of ASD and provides the first in vitro fetal-stage explanation for in vivo early brain overgrowth. Within-child ASD Living Biology is a novel research concept we coin here that advocates the integration of in vitro prenatal and in vivo early post-natal information to generate individualized and group-level explanations, clinically useful prognoses, and precision medicine approaches that are truly beneficial for the individual infant and toddler with ASD

Self-adaptive GA, quantitative semantic similarity measures and ontology-based text clustering

As the common clustering algorithms use vector space model (VSM) to represent document, the conceptual relationships between related terms which do not co-occur literally are ignored. A genetic algorithm-based clustering technique, named GA clustering, in conjunction with ontology is proposed in this article to overcome this problem. In general, the ontology measures can be partitioned into two categories: thesaurus-based methods and corpus-based methods. We take advantage of the hierarchical structure and the broad coverage taxonomy of Wordnet as the thesaurus-based ontology. However, the corpus-based method is rather complicated to handle in practical application. We propose a transformed latent semantic analysis (LSA) model as the corpus-based method in this paper. Moreover, two hybrid strategies, the combinations of the various similarity measures, are implemented in the clustering experiments. The results show that our GA clustering algorithm, in conjunction with the thesaurus-based and the LSA-based method, apparently outperforms that with other similarity measures. Moreover, the superiority of the GA clustering algorithm proposed over the commonly used k-means algorithm and the standard GA is demonstrated by the improvements of the clustering performance