Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics

A continuous time model for multiagent systems governed by reinforcement learning with scale-free memory is developed. The agents are assumed to act independently of one another in optimizing their choice of possible actions via trial-and-error search. To gain awareness about the action value the agents accumulate in their memory the rewards obtained from taking a specific action at each moment of time. The contribution of the rewards in the past to the agent current perception of action value is described by an integral operator with a power-law kernel. Finally a fractional differential equation governing the system dynamics is obtained. The agents are considered to interact with one another implicitly via the reward of one agent depending on the choice of the other agents. The pairwise interaction model is adopted to describe this effect. As a specific example of systems with non-transitive interactions, a two agent and three agent systems of the rock-paper-scissors type are analyzed in detail, including the stability analysis and numerical simulation. Scale-free memory is demonstrated to cause complex dynamics of the systems at hand. In particular, it is shown that there can be simultaneously two modes of the system instability undergoing subcritical and supercritical bifurcation, with the latter one exhibiting anomalous oscillations with the amplitude and period growing with time. Besides, the instability onset via this supercritical mode may be regarded as "altruism self-organization". For the three agent system the instability dynamics is found to be rather irregular and can be composed of alternate fragments of oscillations different in their properties.Comment: 17 pages, 7 figur

A Cytoplasmic Complex Mediates Specific mRNA Recognition and Localization in Yeast

The localization of ash mRNA in yeast requires the binding of She2p and the myosin adaptor protein She3p to its localization element, which is highly specific and leads to the assembly of stable transport complexes

Hunger Artists: Yeast Adapted to Carbon Limitation Show Trade-Offs under Carbon Sufficiency

As organisms adaptively evolve to a new environment, selection results in the improvement of certain traits, bringing about an increase in fitness. Trade-offs may result from this process if function in other traits is reduced in alternative environments either by the adaptive mutations themselves or by the accumulation of neutral mutations elsewhere in the genome. Though the cost of adaptation has long been a fundamental premise in evolutionary biology, the existence of and molecular basis for trade-offs in alternative environments are not well-established. Here, we show that yeast evolved under aerobic glucose limitation show surprisingly few trade-offs when cultured in other carbon-limited environments, under either aerobic or anaerobic conditions. However, while adaptive clones consistently outperform their common ancestor under carbon limiting conditions, in some cases they perform less well than their ancestor in aerobic, carbon-rich environments, indicating that trade-offs can appear when resources are non-limiting. To more deeply understand how adaptation to one condition affects performance in others, we determined steady-state transcript abundance of adaptive clones grown under diverse conditions and performed whole-genome sequencing to identify mutations that distinguish them from one another and from their common ancestor. We identified mutations in genes involved in glucose sensing, signaling, and transport, which, when considered in the context of the expression data, help explain their adaptation to carbon poor environments. However, different sets of mutations in each independently evolved clone indicate that multiple mutational paths lead to the adaptive phenotype. We conclude that yeasts that evolve high fitness under one resource-limiting condition also become more fit under other resource-limiting conditions, but may pay a fitness cost when those same resources are abundant

Liste alphabétique des titres

In the last years many populations of anurans have declined and extinctions have been recorded. They were related to environmental pollution, changes of land use and emerging diseases. The main objective of this study was to determine copper sensitivity of the anuran of the Amazon Rhinella granulosa and Scinax ruber tadpoles at stage 25 and Scinax ruber eggs exposed for 96 h to copper concentrations ranging from 15 µg Cu L-1 to 94 µg Cu L-1. LC50 at 96 h of Rhinella granulosa Gosner 25, Scinax ruber Gosner 25 and Scinax ruber eggs in black water of the Amazon were 23.48, 36.37 and 50.02 µg Cu L-1, respectively. The Biotic Ligand Model was used to predict the LC50 values for these species and it can be considered a promising tool for these tropical species and water conditions. Copper toxicity depends on water physical-chemical composition and on the larval stage of the tadpoles. The Gosner stage 19-21 (related to the appearance of external gills) is the most vulnerable and the egg stage is the most resistant. In case of contamination by copper, the natural streams must have special attention, since copper is more bioavailable.Nos últimos anos foram registrados muitas extinções e declínios de populações de anuros. Eles estavam relacionados com a poluição do ambiente, a mudanças no uso da terra e ao surgimento de doenças. O principal objetivo deste estudo foi determinar a sensibilidade dos anuros amazônicos ao cobre. Os girinos de Scinax ruber e Rhinella granulosa no estadio 25 e os ovos de Scinax ruber foram expostos por 96 horas a concentrações de cobre entre 15 µg Cu L-1 a 94 µg Cu L-1. A CL50 -96 h dos girinos de Rhinella granulosa, dos girinos de Scinax ruber e dos ovos de Scinax ruber em águas pretas da Amazônia foram 23,48; 36,37 e 50,02 µg Cu L-1, respectivamente. O modelo do ligante biótico foi usado para prever os valores de CL50 para essas duas espécies e pode ser considerado uma ferramenta promissora para essas espécies tropicais e para essas condições de água. A Toxicidade de cobre depende da composição físico-química da água e do estagio larval dos girinos. O estadio 19-21 de Gosner (relacionados ao aparecimento das brânquias externas) são os mais vulnerável e o estagio de ovo é o mais resistente. Em caso de contaminação por cobre, os igarapés naturais devem ter uma atenção especial, uma vez que o cobre é mais biodisponível nesse ambiente

The Properties of Adaptive Walks in Evolving Populations of Fungus

A novel method to infer the number and fitness effect of beneficial mutations reveals that the bulk of adaptive evolution is attributable to a few mutations with variable effects on fitness

Probing Microsecond Time Scale Dynamics in Proteins by Methyl 1H Carr−Purcell−Meiboom−Gill Relaxation Dispersion NMR Measurements. Application to Activation of the Signaling Protein NtrCr

To study microsecond processes by relaxation dispersion NMR spectroscopy, low power deposition and short pulses are crucial and encourage the development of experiments that employ H-1 Carr-Purcell-Meiboom-Gill (CPMG) pulse trains. Herein, a method is described for the comprehensive study of microsecond to millisecond time scale dynamics of methyl groups in proteins, exploiting their high abundance and favorable relaxation properties. In our approach, protein samples are produced using [H-1, C-13]-D-glucose in similar to 100% D2O, which yields CHD2 methyl groups for alanine, valine, threonine, isoleucine, leucine, and methionine residues with high abundance, in an otherwise largely deuterated background. Methyl groups in such samples can be sequence-specifically assigned to near completion, using C-13 TOCSY NMR spectroscopy, as was recently demonstrated (Often, R.; et al. J. Am. Chem. Soc. 2010, 132, 2952-2960). In this Article, NMR pulse schemes are presented to measure H-1 CPMG relaxation dispersion profiles for CHD2 methyl groups, in a vein similar to that of backbone relaxation experiments. Because of the high deuteration level of methyl-bearing side chains, artifacts arising from proton scalar coupling during the CPMG pulse train are negligible, with the exception of Ile-delta 1 and Thr-gamma 2 methyl groups, and a pulse scheme is described to remove the artifacts for those residues. Strong C-13 scalar coupling effects, observed for several leucine residues, are removed by alternative biochemical and NMR approaches. The methodology is applied to the transcriptional activator NtrC(r), for which an inactive/active state transition was previously measured and the motions in the microsecond time range were estimated through a combination of backbone N-15 CPMG dispersion NMR spectroscopy and a collection of experiments to determine the exchange-free component to the transverse relaxation rate. Exchange contributions to the H-1 line width were detected for 21 methyl groups, and these probes were found to collectively report on a local structural rearrangement around the phosphorylation site, with a rate constant of (15.5 +/- 0.5) x 10(3) per second (i.e., tau(ex) = 64.7 +/- 1.9 mu s). The affected methyl groups indicate that, already before phosphorylation, a substantial, transient rearrangement takes place between helices 3 and 4 and strands 4 and 5. This conformational equilibrium allows the protein to gain access to the active, signaling state in the absence of covalent modification through a shift in a pre-existing dynamic equilibrium. Moreover, the conformational switching maps exactly to the regions that differ between the solution NMR structures of the fully inactive and active states. These results demonstrate that a cost-effective and quantitative study of protein methyl group dynamics by H-1 CPMG relaxation dispersion NMR spectroscopy is possible and can be applied to study functional motions on the microsecond time scale that cannot be accessed by backbone N-15 relaxation dispersion NMR. The use of methyl groups as dynamics probes extends such applications also to larger proteins

Revisions to the derivation of the Australian and New Zealand guidelines for toxicants in fresh and marine waters

The Australian and New Zealand Guidelines for Fresh and Marine Water Quality are a key document in the Australian National Water Quality Management Strategy. These guidelines released in 2000 are currently being reviewed and updated. The revision is being co-ordinated by the Australian Department of Sustainability, Environment, Water, Population and Communities, while technical matters are dealt with by a series of Working Groups. The revision will be evolutionary in nature reflecting the latest scientific developments and a range of stakeholder desires. Key changes will be: increasing the types and sources of data that can be used; working collaboratively with industry to permit the use of commercial-in-confidence data; increasing the minimum data requirements; including a measure of the uncertainty of the trigger value; improving the software used to calculate trigger values; increasing the rigour of site-specific trigger values; improving the method for assessing the reliability of the trigger values; and providing guidance of measures of toxicity and toxicological endpoints that may, in the near future, be appropriate for trigger value derivation. These changes will markedly improve the number and quality of the trigger values that can be derived and will increase end-users’ ability to understand and implement the guidelines in a scientifically rigorous manner

Open-system orchestration as a relational source of sensing capabilities: Evidence from a venture association

Research on innovation networks has highlighted the pivotal role that actors with more prominence and power, such as hub firms, may play in orchestrating the activities of other network members along a collective innovation effort. Our study examined the undertheorized, but no less important, type of orchestration that characterizes other organizations, such as business incubators and venture associations, who seek to support the dispersed entrepreneurial efforts of network members. We refer to this type as ‘open-system’ orchestration, as opposed to the commonly studied ‘closed-system’ type performed by hub firms. Our findings reveal how the processes of open-system orchestration differ markedly from those of closed-system orchestration, and detail how these processes influence the micro-foundations of network members’ sensing capabilities. By doing so, we also offer empirical substantiation and theoretical elaboration to the idea that dynamic capabilities might not reside exclusively inside firms, but could be co-created relationally with other parties in the business ecosystem

The Mitochondrial Genome of the Lycophyte Huperzia squarrosa: The Most Archaic Form in Vascular Plants

Mitochondrial genomes have maintained some bacterial features despite their residence within eukaryotic cells for approximately two billion years. One of these features is the frequent presence of polycistronic operons. In land plants, however, it has been shown that all sequenced vascular plant chondromes lack large polycistronic operons while bryophyte chondromes have many of them. In this study, we provide the completely sequenced mitochondrial genome of a lycophyte, from Huperzia squarrosa, which is a member of the sister group to all other vascular plants. The genome, at a size of 413,530 base pairs, contains 66 genes and 32 group II introns. In addition, it has 69 pseudogene fragments for 24 of the 40 protein- and rRNA-coding genes. It represents the most archaic form of mitochondrial genomes of all vascular plants. In particular, it has one large conserved gene cluster containing up to 10 ribosomal protein genes, which likely represents a polycistronic operon but has been disrupted and greatly reduced in the chondromes of other vascular plants. It also has the least rearranged gene order in comparison to the chondromes of other vascular plants. The genome is ancestral in vascular plants in several other aspects: the gene content resembling those of charophytes and most bryophytes, all introns being cis-spliced, a low level of RNA editing, and lack of foreign DNA of chloroplast or nuclear origin