Born to learn: The inspiration, progress, and future of evolved plastic artificial neural networks

Biological plastic neural networks are systems of extraordinary computational capabilities shaped by evolution, development, and lifetime learning. The interplay of these elements leads to the emergence of adaptive behavior and intelligence. Inspired by such intricate natural phenomena, Evolved Plastic Artificial Neural Networks (EPANNs) use simulated evolution in-silico to breed plastic neural networks with a large variety of dynamics, architectures, and plasticity rules: these artificial systems are composed of inputs, outputs, and plastic components that change in response to experiences in an environment. These systems may autonomously discover novel adaptive algorithms, and lead to hypotheses on the emergence of biological adaptation. EPANNs have seen considerable progress over the last two decades. Current scientific and technological advances in artificial neural networks are now setting the conditions for radically new approaches and results. In particular, the limitations of hand-designed networks could be overcome by more flexible and innovative solutions. This paper brings together a variety of inspiring ideas that define the field of EPANNs. The main methods and results are reviewed. Finally, new opportunities and developments are presented

Cultural enhancement of neuroevolution

textAny transmission of behavior from one generation to the next via non–genetic means is a process of culture. Culture provides major advantages for survival in the biological world. This dissertation develops four methods that harness the mechanisms of culture to enhance the power of neuroevolution: culling overlarge litters, mate selection by complementary competence, phenotypic diversity maintenance, and teaching offspring to respond like an elder. The methods are efficient because they operate without requiring additional fitness evaluations, and because each method addresses a different aspect of neuroevolution, they also combine smoothly. The combined system balances diversity and selection pressure, and improves performance both in terms of learning speed and solution quality in sequential decision tasks.Computer Science

Culling and Teaching in Neuro-evolution

The evolving population of neural nets contains information not only in terms of genes, but also in the collection of behaviors of the population members. Such information can be thought of as a kind of "culture" of the population. Two ways of exploiting that culture are explored in this paper: (1) Culling overlarge litters: Generate a large number of offspring with different crossovers, quickly evaluate them by comparing their performance to the population, and throw away those that appear poor. (2) Teaching: Use backpropagation to train offspring toward the performance of the population. Both techniques result in faster, more effective neuro-evolution, and they can be effectively combined, as is demonstrated on the inverted pendulum problem. Additional methods of cultural exploitation are possible and will be studied in future work. These results suggest that cultural exploitation is a powerful idea that allows leveraging several aspects of the genetic algorithm. 1. Introduction In..

Evolving Neural Networks to Play Go

Go is a difficult game for computers to master, and the best go programs are still weaker than the average human player. Since the traditional game playing techniques have proven inadequate, new approaches to computer go need to be studied. This paper presents a new approach to learning to play go. The SANE (Symbiotic, Adaptive NeuroEvolution) method was used to evolve networks capable of playing go on small boards with no pre-programmed go knowledge. On a 9 \Theta 9 go board, networks that were able to defeat a simple computer opponent were evolved within a few hundred generations. Most significantly, the networks exhibited several aspects of general go playing, which suggests the approach could scale up well. 1 INTRODUCTION Go is hard. For computers at least, this is true. Though the game has not received the level of attention that computer chess, for example, has received, considerable effort has gone into trying to create strong go playing programs. Yet, despite this effort, the ..

Image3_ApoE isoform-dependent effects of xanthohumol on high fat diet-induced cognitive impairments and hippocampal metabolic pathways.JPEG

Consumption of a high fat diet (HFD) is linked to metabolic syndrome and cognitive impairments. This is exacerbated in age-related cognitive decline (ACD) and in individuals with a genetic risk for Alzheimer’s disease (AD). Apolipoprotein E (apoE) is involved in cholesterol metabolism. In humans, there are three major isoforms, E2, E3, and E4. Compared to E3, E4 increases ACD and AD risk and vulnerability to the deleterious cognitive effects of a HFD. The plant compound Xanthohumol (XN) had beneficial effects on cognition and metabolism in C57BL/6J wild-type (WT) male mice put on a HFD at 9 weeks of age for 13 weeks. As the effects of XN in the context of a HFD in older WT, E3, and E4 female and male mice are not known, in the current study male and female WT, E3, and E4 mice were fed a HFD alone or a HFD containing 0.07% XN for 10 or 19 weeks, starting at 6 months of age, prior to the beginning of behavioral and cognitive testing. XN showed sex- and ApoE isoform-dependent effects on cognitive performance. XN-treated E4 and WT, but not E3, mice had higher glucose transporter protein levels in the hippocampus and cortex than HFD-treated mice. E3 and E4 mice had higher glucose transporter protein levels in the hippocampus and lower glucose transporter protein levels in the cortex than WT mice. In the standard experiment, regardless of XN treatment, E4 mice had nearly double as high ceramide and sphingomyelin levels than E3 mice and male mice had higher level of glycosylated ceramide than female mice. When the differential effects of HFD in E3 and E4 males were assessed, the arginine and proline metabolism pathway was affected. In the extended exposure experiment, in E3 males XN treatment affected the arginine and proline metabolism and the glycine, serine, and threonine metabolism. Myristic acid levels were decreased in XN-treated E3 males but not E3 females. These data support the therapeutic potential for XN to ameliorate HFD-induced cognitive impairments and highlight the importance of considering sex and ApoE isoform in determining who might most benefit from this dietary supplement.</p

Image5_ApoE isoform-dependent effects of xanthohumol on high fat diet-induced cognitive impairments and hippocampal metabolic pathways.JPEG

Consumption of a high fat diet (HFD) is linked to metabolic syndrome and cognitive impairments. This is exacerbated in age-related cognitive decline (ACD) and in individuals with a genetic risk for Alzheimer’s disease (AD). Apolipoprotein E (apoE) is involved in cholesterol metabolism. In humans, there are three major isoforms, E2, E3, and E4. Compared to E3, E4 increases ACD and AD risk and vulnerability to the deleterious cognitive effects of a HFD. The plant compound Xanthohumol (XN) had beneficial effects on cognition and metabolism in C57BL/6J wild-type (WT) male mice put on a HFD at 9 weeks of age for 13 weeks. As the effects of XN in the context of a HFD in older WT, E3, and E4 female and male mice are not known, in the current study male and female WT, E3, and E4 mice were fed a HFD alone or a HFD containing 0.07% XN for 10 or 19 weeks, starting at 6 months of age, prior to the beginning of behavioral and cognitive testing. XN showed sex- and ApoE isoform-dependent effects on cognitive performance. XN-treated E4 and WT, but not E3, mice had higher glucose transporter protein levels in the hippocampus and cortex than HFD-treated mice. E3 and E4 mice had higher glucose transporter protein levels in the hippocampus and lower glucose transporter protein levels in the cortex than WT mice. In the standard experiment, regardless of XN treatment, E4 mice had nearly double as high ceramide and sphingomyelin levels than E3 mice and male mice had higher level of glycosylated ceramide than female mice. When the differential effects of HFD in E3 and E4 males were assessed, the arginine and proline metabolism pathway was affected. In the extended exposure experiment, in E3 males XN treatment affected the arginine and proline metabolism and the glycine, serine, and threonine metabolism. Myristic acid levels were decreased in XN-treated E3 males but not E3 females. These data support the therapeutic potential for XN to ameliorate HFD-induced cognitive impairments and highlight the importance of considering sex and ApoE isoform in determining who might most benefit from this dietary supplement.</p

Image4_ApoE isoform-dependent effects of xanthohumol on high fat diet-induced cognitive impairments and hippocampal metabolic pathways.JPEG

Consumption of a high fat diet (HFD) is linked to metabolic syndrome and cognitive impairments. This is exacerbated in age-related cognitive decline (ACD) and in individuals with a genetic risk for Alzheimer’s disease (AD). Apolipoprotein E (apoE) is involved in cholesterol metabolism. In humans, there are three major isoforms, E2, E3, and E4. Compared to E3, E4 increases ACD and AD risk and vulnerability to the deleterious cognitive effects of a HFD. The plant compound Xanthohumol (XN) had beneficial effects on cognition and metabolism in C57BL/6J wild-type (WT) male mice put on a HFD at 9 weeks of age for 13 weeks. As the effects of XN in the context of a HFD in older WT, E3, and E4 female and male mice are not known, in the current study male and female WT, E3, and E4 mice were fed a HFD alone or a HFD containing 0.07% XN for 10 or 19 weeks, starting at 6 months of age, prior to the beginning of behavioral and cognitive testing. XN showed sex- and ApoE isoform-dependent effects on cognitive performance. XN-treated E4 and WT, but not E3, mice had higher glucose transporter protein levels in the hippocampus and cortex than HFD-treated mice. E3 and E4 mice had higher glucose transporter protein levels in the hippocampus and lower glucose transporter protein levels in the cortex than WT mice. In the standard experiment, regardless of XN treatment, E4 mice had nearly double as high ceramide and sphingomyelin levels than E3 mice and male mice had higher level of glycosylated ceramide than female mice. When the differential effects of HFD in E3 and E4 males were assessed, the arginine and proline metabolism pathway was affected. In the extended exposure experiment, in E3 males XN treatment affected the arginine and proline metabolism and the glycine, serine, and threonine metabolism. Myristic acid levels were decreased in XN-treated E3 males but not E3 females. These data support the therapeutic potential for XN to ameliorate HFD-induced cognitive impairments and highlight the importance of considering sex and ApoE isoform in determining who might most benefit from this dietary supplement.</p

DataSheet1_ApoE isoform-dependent effects of xanthohumol on high fat diet-induced cognitive impairments and hippocampal metabolic pathways.docx

Consumption of a high fat diet (HFD) is linked to metabolic syndrome and cognitive impairments. This is exacerbated in age-related cognitive decline (ACD) and in individuals with a genetic risk for Alzheimer’s disease (AD). Apolipoprotein E (apoE) is involved in cholesterol metabolism. In humans, there are three major isoforms, E2, E3, and E4. Compared to E3, E4 increases ACD and AD risk and vulnerability to the deleterious cognitive effects of a HFD. The plant compound Xanthohumol (XN) had beneficial effects on cognition and metabolism in C57BL/6J wild-type (WT) male mice put on a HFD at 9 weeks of age for 13 weeks. As the effects of XN in the context of a HFD in older WT, E3, and E4 female and male mice are not known, in the current study male and female WT, E3, and E4 mice were fed a HFD alone or a HFD containing 0.07% XN for 10 or 19 weeks, starting at 6 months of age, prior to the beginning of behavioral and cognitive testing. XN showed sex- and ApoE isoform-dependent effects on cognitive performance. XN-treated E4 and WT, but not E3, mice had higher glucose transporter protein levels in the hippocampus and cortex than HFD-treated mice. E3 and E4 mice had higher glucose transporter protein levels in the hippocampus and lower glucose transporter protein levels in the cortex than WT mice. In the standard experiment, regardless of XN treatment, E4 mice had nearly double as high ceramide and sphingomyelin levels than E3 mice and male mice had higher level of glycosylated ceramide than female mice. When the differential effects of HFD in E3 and E4 males were assessed, the arginine and proline metabolism pathway was affected. In the extended exposure experiment, in E3 males XN treatment affected the arginine and proline metabolism and the glycine, serine, and threonine metabolism. Myristic acid levels were decreased in XN-treated E3 males but not E3 females. These data support the therapeutic potential for XN to ameliorate HFD-induced cognitive impairments and highlight the importance of considering sex and ApoE isoform in determining who might most benefit from this dietary supplement.</p