Self-Organisation of Neural Topologies by Evolutionary Reinforcement Learning

In this article we present EANT, "Evolutionary Acquisition of Neural Topologies", a method that creates neural networks (NNs) by evolutionary reinforcement learning. The structure of NNs is developed using mutation operators, starting from a minimal structure. Their parameters are optimised using CMA-ES. EANT can create NNs that are very specialised; they achieve a very good performance while being relatively small. This can be seen in experiments where our method competes with a different one, called NEAT, "NeuroEvolution of Augmenting Topologies", to create networks that control a robot in a visual serving scenario

Untersuchung von Helikonwellen zur Plasmaheizung im Torsatron TJ-K

Helikonwellen eignen sich zur Erzeugung von magnetisierten Plasmen hoher Dichte. Die Arbeit stellt die technischen Details, die mit der Heizung des Plasmas verbunden sind, dar. Die physikalischen Aspekte der Wellenpropagation der Helikonwelle werden in toroidaler Geometrie hergeleitet und experimentell im Torsatron TJ-K untersucht. Die Welle wird dabei als geschlossener Wellenzug im toroidalen Umlauf interpretiert. Ergebnisse der Messungen sind Daten zur Dispersionsrelation, zum Wellenfeld und zu den erreichten Plasmaparametern. Der theoretische Verlauf der Dispersionsrelation ist dabei in sehr guter Übereinstimmung mit den experimentellen Ergebnissen

Atomistic Insight into the Role of Threonine 127 in the Functional Mechanism of Channelrhodopsin-2

Channelrhodopsins (ChRs) belong to the unique class of light-gated ion channels. The structure of channelrhodopsin-2 from Chlamydomonas reinhardtii (CrChR2) has been resolved, but the mechanistic link between light-induced isomerization of the chromophore retinal and channel gating remains elusive. Replacements of residues C128 and D156 (DC gate) resulted in drastic effects in channel closure. T127 is localized close to the retinal Schiff base and links the DC gate to the Schiff base. The homologous residue in bacteriorhodopsin (T89) has been shown to be crucial for the visible absorption maximum and dark–light adaptation, suggesting an interaction with the retinylidene chromophore, but the replacement had little effect on photocycle kinetics and proton pumping activity. Here, we show that the T127A and T127S variants of CrChR2 leave the visible absorption maximum unaffected. We inferred from hybrid quantum mechanics/molecular mechanics (QM/MM) calculations and resonance Raman spectroscopy that the hydroxylic side chain of T127 is hydrogen-bonded to E123 and the latter is hydrogen-bonded to the retinal Schiff base. The C=N–H vibration of the Schiff base in the T127A variant was 1674 cm−1, the highest among all rhodopsins reported to date. We also found heterogeneity in the Schiff base ground state vibrational properties due to different rotamer conformations of E123. The photoreaction of T127A is characterized by a long-lived P2380 state during which the Schiff base is deprotonated. The conservative replacement of T127S hardly affected the photocycle kinetics. Thus, we inferred that the hydroxyl group at position 127 is part of the proton transfer pathway from D156 to the Schiff base during rise of the P3530 intermediate. This finding provides molecular reasons for the evolutionary conservation of the chemically homologous residues threonine, serine, and cysteine at this position in all channelrhodopsins known so far

Plastid located WHIRLY1 enhances the responsiveness of Arabidopsis seedlings toward abscisic acid

WHIRLY1 is a protein that can be translocated from the plastids to the nucleus, making it an ideal candidate for communicating information between these two compartments. Mutants of Arabidopsis thaliana lacking WHIRLY1 (why1) were shown to have a reduced sensitivity toward salicylic acid (SA) and abscisic acid (ABA) during germination. Germination assays in the presence of abamine, an inhibitor of ABA biosynthesis, revealed that the effect of SA on germination was in fact caused by a concomitant stimulation of ABA biosynthesis. In order to distinguish whether the plastid or the nuclear isoform of WHIRLY1 is adjusting the responsiveness toward ABA, sequences encoding either the complete WHIRLY1 protein or a truncated form lacking the plastid transit peptide were overexpressed in the why1 mutant background. In plants overexpressing the full-length sequence, WHIRLY1 accumulated in both plastids and the nucleus, whereas in plants overexpressing the truncated sequence, WHIRLY1 accumulated exclusively in the nucleus. Seedlings containing recombinant WHIRLY1 in both compartments were hypersensitive toward ABA. In contrast, seedlings possessing only the nuclear form of WHIRLY1 were as insensitive toward ABA as the why1 mutants. ABA was furthermore shown to lower the rate of germination of wildtype seeds even in the presence of abamine which is known to inhibit the formation of xanthoxin, the plastid located precursor of ABA. From this we conclude that plastid located WHIRLY1 enhances the responsiveness of seeds toward ABA even when ABA is supplied exogenously

Proton transfer in the quinol-dependent nitric oxide reductase from Geobacillus stearothermophilus during reduction of oxygen

Bacterial nitric oxide reductases (NOR) are integral membrane proteins that catalyse the reduction of nitric oxide to nitrous oxide, often as a step in the process of denitrification. Most functional data has been obtained with NORs that receive their electrons from a soluble cytochrome c in the periplasm and are hence termed cNOR. Very recently, the structure of a different type of NOR, the quinol-dependent (q)-NOR from the thermophilic bacterium Geobacillus stearothermophilus was solved to atomic resolution [Y. Matsumoto, T. Tosha, A.V. Pisliakov, T. Hino, H. Sugimoto, S. Nagano, Y. Sugita and Y. Shiro, Nat. Struct. Mol. Biol. 19 (2012) 238–246]. In this study, we have investigated the reaction between this qNOR and oxygen. Our results show that, like some cNORs, the G. stearothermophilus qNOR is capable of O2 reduction with a turnover of ~ 3 electrons s− 1 at 40 °C. Furthermore, using the so-called flow-flash technique, we show that the fully reduced (with three available electrons) qNOR reacts with oxygen in a reaction with a time constant of 1.8 ms that oxidises the low-spin heme b. This reaction is coupled to proton uptake from solution and presumably forms a ferryl intermediate at the active site. The pH dependence of the reaction is markedly different from a corresponding reaction in cNOR from Paracoccus denitrificans, indicating that possibly the proton uptake mechanism and/or pathway differs between qNOR and cNOR. This study furthermore forms the basis for investigation of the proton transfer pathway in qNOR using both variants with putative proton transfer elements modified and measurements of the vectorial nature of the proton transfer. This article is part of a Special Issue entitled: 17th European Bioenergetics Conference (EBEC 2012)

Proton transfer in the quinol-dependent nitric oxide reductase from Geobacillus stearothermophilus during reduction of oxygen

Bacterial nitric oxide reductases (NOR) are integral membrane proteins that catalyse the reduction of nitric oxide to nitrous oxide, often as a step in the process of denitrification. Most functional data has been obtained with NORs that receive their electrons from a soluble cytochrome c in the periplasm and are hence termed cNOR. Very recently, the structure of a different type of NOR, the quinol-dependent (q)-NOR from the thermophilic bacterium Geobacillus stearothermophilus was solved to atomic resolution [Y. Matsumoto, T. Tosha, A.V. Pisliakov, T. Hino, H. Sugimoto, S. Nagano, Y. Sugita and Y. Shiro, Nat. Struct. Mol. Biol. 19 (2012) 238–246]. In this study, we have investigated the reaction between this qNOR and oxygen. Our results show that, like some cNORs, the G. stearothermophilus qNOR is capable of O2 reduction with a turnover of ~ 3 electrons s− 1 at 40 °C. Furthermore, using the so-called flow-flash technique, we show that the fully reduced (with three available electrons) qNOR reacts with oxygen in a reaction with a time constant of 1.8 ms that oxidises the low-spin heme b. This reaction is coupled to proton uptake from solution and presumably forms a ferryl intermediate at the active site. The pH dependence of the reaction is markedly different from a corresponding reaction in cNOR from Paracoccus denitrificans, indicating that possibly the proton uptake mechanism and/or pathway differs between qNOR and cNOR. This study furthermore forms the basis for investigation of the proton transfer pathway in qNOR using both variants with putative proton transfer elements modified and measurements of the vectorial nature of the proton transfer. This article is part of a Special Issue entitled: 17th European Bioenergetics Conference (EBEC 2012)

Self-Organisation of Neural Topologies by Evolutionary Reinforcement Learning

In this article we present EANT, "Evolutionary Acquisition of Neural Topologies", a method that creates neural networks (NNs) by evolutionary reinforcement learning. The structure of NNs is developed using mutation operators, starting from a minimal structure. Their parameters are optimised using CMA-ES. EANT can create NNs that are very specialised; they achieve a very good performance while being relatively small. This can be seen in experiments where our method competes with a different one, called NEAT, "NeuroEvolution of Augmenting Topologies", to create networks that control a robot in a visual serving scenario

Light and pH-induced Changes in Structure and Accessibility of Transmembrane Helix B and Its Immediate Environment in Channelrhodopsin-2

A variant of the cation channel channelrhodopsin-2 from Chlamydomonas reinhardtii (CrChR2) was selectively labeled at position Cys-79 at the end of the first cytoplasmic loop and the beginning of transmembrane helix B with the fluorescent dye fluorescein (acetamidofluorescein). We utilized (i) time- resolved fluorescence anisotropy experiments to monitor the structural dynamics at the cytoplasmic surface close to the inner gate in the dark and after illumination in the open channel state and (ii) time-resolved fluorescence quenching experiments to observe the solvent accessibility of helix B at pH 6.0 and 7.4. The light-induced increase in final anisotropy for acetamidofluorescein bound to the channel variant with a prolonged conducting state clearly shows that the formation of the open channel state is associated with a large conformational change at the cytoplasmic surface, consistent with an outward tilt of helix B. Furthermore, results from solute accessibility studies of the cytoplasmic end of helix B suggest a pH-dependent structural heterogeneity that appears below pH 7. At pH 7.4 conformational homogeneity was observed, whereas at pH 6.0 two protein fractions exist, including one in which residue 79 is buried. This inaccessible fraction amounts to 66% in nanodiscs and 82% in micelles. Knowledge about pH-dependent structural heterogeneity may be important for CrChR2 applications in optogenetics

Social competence improves the performance of biomimetic robots leading live fish

Collective motion is commonly modeled with static interaction rules between agents. Substantial empirical evidence indicates, however, that animals may adapt their interaction rules depending on a variety of factors and social contexts. Here, we hypothesized that leadership performance is linked to the leader's responsiveness to the follower's actions and we predicted that a leader is followed longer if it adapts to the follower's avoidance movements. We tested this prediction with live guppies that interacted with a biomimetic robotic fish programmed to act as a 'socially competent' leader. Fish that were avoiding the robot were approached more carefully in future approaches. In two separate experiments we then asked how the leadership performance of the socially competent robot leader differed to that of a robot leader that either approached all fish in the same, non-responsive, way or one that did change its approach behavior randomly, irrespective of the fish's actions. We found that (1) behavioral variability itself appears attractive and that socially competent robots are better leaders which (2) require fewer approach attempts to (3) elicit longer average following behavior than non-competent agents. This work provides evidence that social responsiveness to avoidance reactions plays a role in the social dynamics of guppies. We showcase how social responsiveness can be modeled and tested directly embedded in a living animal model using adaptive, interactive robots

The role of precuneus and left inferior frontal cortex during source memory episodic retrieval

The posterior medial parietal cortex and left prefrontal cortex (PFC) have both been implicated in the recollection of past episodes. In a previous study, we found the posterior precuneus and left lateral inferior frontal cortex to be activated during episodic source memory retrieval. This study further examines the role of posterior precuneal and left prefrontal activation during episodic source memory retrieval using a similar source memory paradigm but with longer latency between encoding and retrieval. Our results suggest that both the precuneus and the left inferior PFC are important for regeneration of rich episodic contextual associations and that the precuneus activates in tandem with the left inferior PFC during correct source retrieval. Further, results suggest that the left ventro-lateral frontal region/ frontal operculum is involved in searching for task-relevant information (BA 47) and subsequent monitoring or scrutiny (BA 44/45) while regions in the dorsal inferior frontal cortex are important for information selection (BA 45/46). (C) 2005 Elsevier Inc. All rights reserved.NIGMS NIH HHS [2 T32 GM 07266]info:eu-repo/semantics/publishedVersio