Maximum Likelihood-based Online Adaptation of Hyper-parameters in CMA-ES

The Covariance Matrix Adaptation Evolution Strategy (CMA-ES) is widely accepted as a robust derivative-free continuous optimization algorithm for non-linear and non-convex optimization problems. CMA-ES is well known to be almost parameterless, meaning that only one hyper-parameter, the population size, is proposed to be tuned by the user. In this paper, we propose a principled approach called self-CMA-ES to achieve the online adaptation of CMA-ES hyper-parameters in order to improve its overall performance. Experimental results show that for larger-than-default population size, the default settings of hyper-parameters of CMA-ES are far from being optimal, and that self-CMA-ES allows for dynamically approaching optimal settings.Comment: 13th International Conference on Parallel Problem Solving from Nature (PPSN 2014) (2014

Self-Adaptive Genetic Algorithms with Simulated Binary Crossover

Self-adaptation is an essential feature of natural evolution. However, in the context of function optimization, self-adaptation features of evolutionary search algorithms have been explored only with evolution strategy (ES) and evolutionary programming (EP). In this paper, we demonstrate the self-adaptive feature of real-parameter genetic algorithms (GAs) using simulated binary crossover (SBX) operator and without any mutation operator. The connection between the working of self-adaptive ESs and real-parameter GAs with SBX operator is also discussed. Thereafter, the self-adaptive behavior of real-parameter GAs is demonstrated on a number of test problems commonly-used in the ES literature. The remarkable similarity in the working principle of real-parameter GAs and self-adaptive ESs shown in this study suggests the need of emphasizing further studies on self-adaptive GAs

Dictionary of Invertebrate Zoology

An exhaustive dictionary of over 13,000 terms relating to invertebrate zoology, including etymologies, word derivations and taxonomic classification. Entries cover parasitology, nematology, marine invertebrates, insects, and anatomy, biology, and reproductive processes for the following phyla: Acanthocephala Annelida Arthropoda Brachiopoda Bryozoa Chaetognatha Cnidaria Ctenophora Echinodermata Echiura Entoprocta Gastrotricha Gnathostomulida Kinorhyncha Loricifera Mesozoa Mollusca Nemata Nematomorpha Nemertea Onychophora Pentastoma Phoronida Placozoa Platyhelminthes Pogonophora Porifera Priapula Rotifera Sipuncula Tardigrada.https://digitalcommons.unl.edu/zeabook/1061/thumbnail.jp

Optimality and evolution of transcriptionally regulated gene expression

<p>Abstract</p> <p>Background</p> <p>How transcriptionally regulated gene expression evolves under natural selection is an open question. The cost and benefit of gene expression are the driving factors. While the former can be determined by gratuitous induction, the latter is difficult to measure directly.</p> <p>Results</p> <p>We addressed this problem by decoupling the regulatory and metabolic function of the <it>Escherichia coli lac </it>system, using an inducer that cannot be metabolized and a carbon source that does not induce. Growth rate measurements directly identified the induced expression level that maximizes the metabolism benefits minus the protein production costs, without relying on models. Using these results, we established a controlled mismatch between sensing and metabolism, resulting in sub-optimal transcriptional regulation with the potential to improve by evolution. Next, we tested the evolutionary response by serial transfer. Constant environments showed cells evolving to the predicted expression optimum. Phenotypes with decreased expression emerged several hundred generations later than phenotypes with increased expression, indicating a higher genetic accessibility of the latter. Environments alternating between low and high expression demands resulted in overall rather than differential changes in expression, which is explained by the concave shape of the cross-environmental tradeoff curve that limits the selective advantage of altering the regulatory response.</p> <p>Conclusions</p> <p>This work indicates that the decoupling of regulatory and metabolic functions allows one to directly measure the costs and benefits that underlie the natural selection of gene regulation. Regulated gene expression is shown to evolve within several hundreds of generations to optima that are predicted by these costs and benefits. The results provide a step towards a quantitative understanding of the adaptive origins of regulatory systems.</p

High-dimensional semi-supervised learning: in search for optimal inference of the mean

We provide a high-dimensional semi-supervised inference framework focused on the mean and variance of the response. Our data are comprised of an extensive set of observations regarding the covariate vectors and a much smaller set of labeled observations where we observe both the response as well as the covariates. We allow the size of the covariates to be much larger than the sample size and impose weak conditions on a statistical form of the data. We provide new estimators of the mean and variance of the response that extend some of the recent results presented in low-dimensional models. In particular, at times we will not necessitate consistent estimation of the functional form of the data. Together with estimation of the population mean and variance, we provide their asymptotic distribution and confidence intervals where we showcase gains in efficiency compared to the sample mean and variance. Our procedure, with minor modifications, is then presented to make important contributions regarding inference about average treatment effects. We also investigate the robustness of estimation and coverage and showcase widespread applicability and generality of the proposed method