Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics

A continuous time model for multiagent systems governed by reinforcement learning with scale-free memory is developed. The agents are assumed to act independently of one another in optimizing their choice of possible actions via trial-and-error search. To gain awareness about the action value the agents accumulate in their memory the rewards obtained from taking a specific action at each moment of time. The contribution of the rewards in the past to the agent current perception of action value is described by an integral operator with a power-law kernel. Finally a fractional differential equation governing the system dynamics is obtained. The agents are considered to interact with one another implicitly via the reward of one agent depending on the choice of the other agents. The pairwise interaction model is adopted to describe this effect. As a specific example of systems with non-transitive interactions, a two agent and three agent systems of the rock-paper-scissors type are analyzed in detail, including the stability analysis and numerical simulation. Scale-free memory is demonstrated to cause complex dynamics of the systems at hand. In particular, it is shown that there can be simultaneously two modes of the system instability undergoing subcritical and supercritical bifurcation, with the latter one exhibiting anomalous oscillations with the amplitude and period growing with time. Besides, the instability onset via this supercritical mode may be regarded as "altruism self-organization". For the three agent system the instability dynamics is found to be rather irregular and can be composed of alternate fragments of oscillations different in their properties.Comment: 17 pages, 7 figur

Proteome-Wide Search Reveals Unexpected RNA-Binding Proteins in Saccharomyces cerevisiae

The vast landscape of RNA-protein interactions at the heart of post-transcriptional regulation remains largely unexplored. Indeed it is likely that, even in yeast, a substantial fraction of the regulatory RNA-binding proteins (RBPs) remain to be discovered. Systematic experimental methods can play a key role in discovering these RBPs - most of the known yeast RBPs lack RNA-binding domains that might enable this activity to be predicted. We describe here a proteome-wide approach to identify RNA-protein interactions based on in vitro binding of RNA samples to yeast protein microarrays that represent over 80% of the yeast proteome. We used this procedure to screen for novel RBPs and RNA-protein interactions. A complementary mass spectrometry technique also identified proteins that associate with yeast mRNAs. Both the protein microarray and mass spectrometry methods successfully identify previously annotated RBPs, suggesting that other proteins identified in these assays might be novel RBPs. Of 35 putative novel RBPs identified by either or both of these methods, 12, including 75% of the eight most highly-ranked candidates, reproducibly associated with specific cellular RNAs. Surprisingly, most of the 12 newly discovered RBPs were enzymes. Functional characteristics of the RNA targets of some of the novel RBPs suggest coordinated post-transcriptional regulation of subunits of protein complexes and a possible link between mRNA trafficking and vesicle transport. Our results suggest that many more RBPs still remain to be identified and provide a set of candidates for further investigation

The Dynamics of Ca2+ Ions within the Solvation Shell of Calbindin D9k

The encounter of a Ca2+ ion with a protein and its subsequent binding to specific binding sites is an intricate process that cannot be fully elucidated from experimental observations. We have applied Molecular Dynamics to study this process with atomistic details, using Calbindin D9k (CaB) as a model protein. The simulations show that in most of the time the Ca2+ ion spends within the Debye radius of CaB, it is being detained at the 1st and 2nd solvation shells. While being detained near the protein, the diffusion coefficient of the ion is significantly reduced. However, due to the relatively long period of detainment, the ion can scan an appreciable surface of the protein. The enhanced propagation of the ion on the surface has a functional role: significantly increasing the ability of the ion to scan the protein's surface before being dispersed to the bulk. The contribution of this mechanism to Ca2+ binding becomes significant at low ion concentrations, where the intervals between successive encounters with the protein are getting longer. The efficiency of the surface diffusion is affected by the distribution of charges on the protein's surface. Comparison of the Ca2+ binding dynamics in CaB and its E60D mutant reveals that in the wild type (WT) protein the carboxylate of E60 function as a preferred landing-site for the Ca2+ arriving from the bulk, followed by delivering it to the final binding site. Replacement of the glutamate by aspartate significantly reduced the ability to transfer Ca2+ ions from D60 to the final binding site, explaining the observed decrement in the affinity of the mutated protein to Ca2+

Noninvasive Assessment of Antenatal Hydronephrosis in Mice Reveals a Critical Role for Robo2 in Maintaining Anti-Reflux Mechanism

Antenatal hydronephrosis and vesicoureteral reflux (VUR) are common renal tract birth defects. We recently showed that disruption of the Robo2 gene is associated with VUR in humans and antenatal hydronephrosis in knockout mice. However, the natural history, causal relationship and developmental origins of these clinical conditions remain largely unclear. Although the hydronephrosis phenotype in Robo2 knockout mice has been attributed to the coexistence of ureteral reflux and obstruction in the same mice, this hypothesis has not been tested experimentally. Here we used noninvasive high-resolution micro-ultrasonography and pathological analysis to follow the progression of antenatal hydronephrosis in individual Robo2-deficient mice from embryo to adulthood. We found that hydronephrosis progressed continuously after birth with no spontaneous resolution. With the use of a microbubble ultrasound contrast agent and ultrasound-guided percutaneous aspiration, we demonstrated that antenatal hydronephrosis in Robo2-deficient mice is caused by high-grade VUR resulting from a dilated and incompetent ureterovesical junction rather than ureteral obstruction. We further documented Robo2 expression around the developing ureterovesical junction and identified early dilatation of ureteral orifice structures as a potential fetal origin of antenatal hydronephrosis and VUR. Our results thus demonstrate that Robo2 is crucial for the formation of a normal ureteral orifice and for the maintenance of an effective anti-reflux mechanism. This study also establishes a reproducible genetic mouse model of progressive antenatal hydronephrosis and primary high-grade VUR

Revisions to the derivation of the Australian and New Zealand guidelines for toxicants in fresh and marine waters

The Australian and New Zealand Guidelines for Fresh and Marine Water Quality are a key document in the Australian National Water Quality Management Strategy. These guidelines released in 2000 are currently being reviewed and updated. The revision is being co-ordinated by the Australian Department of Sustainability, Environment, Water, Population and Communities, while technical matters are dealt with by a series of Working Groups. The revision will be evolutionary in nature reflecting the latest scientific developments and a range of stakeholder desires. Key changes will be: increasing the types and sources of data that can be used; working collaboratively with industry to permit the use of commercial-in-confidence data; increasing the minimum data requirements; including a measure of the uncertainty of the trigger value; improving the software used to calculate trigger values; increasing the rigour of site-specific trigger values; improving the method for assessing the reliability of the trigger values; and providing guidance of measures of toxicity and toxicological endpoints that may, in the near future, be appropriate for trigger value derivation. These changes will markedly improve the number and quality of the trigger values that can be derived and will increase end-users’ ability to understand and implement the guidelines in a scientifically rigorous manner

Development of aggression subtypes from childhood to adolescence:a group-based multi-trajectory modelling perspective

The persistence of elevated subtypes of aggression beginning in childhood have been associated with long-term maladaptive outcomes. Yet it remains unclear to what extent there are clusters of individuals following similar developmental trajectories across forms (i.e., physical and indirect) and functions (i.e., proactive and reactive) of aggression. We aimed to identify groups of children with distinct profiles of the joint development of forms and functions of aggression and to identify risk factors for group membership. A sample of 787 children was followed from birth to adolescence. Parent and teacher reports, and standardised assessments were used to measure two forms and two functions of aggressive behaviour, between six and 13 years of age along with preceding child, maternal, and family-level risk-factors. Analyses were conducted using a group-based multi-trajectory modelling approach. Five trajectory groups emerged: non-aggressors, low-stable, moderate-engagers, high-desisting, and high-chronic. Coercive parenting increased membership risk in the moderate-engagers and high-chronic groups. Lower maternal IQ increased membership risk in both high-desisting and high-chronic groups, whereas maternal depression increased membership risk in the high-desisting group only. Never being breastfed increased membership risk in the moderate-engagers group. Boys were at greater risk for belonging to groups displaying elevated aggression. Individuals with chronic aggression problems use all subtypes of aggression. Risk factors suggest that prevention programs should start early in life and target mothers with lower IQ. Strategies to deal with maternal depression and enhance positive parenting while replacing coercive parenting tactics should be highlighted in programming efforts

Surgical management of vesicoureteral reflux in children

Vesicoureteral reflux (VUR) is the most common uropathy affecting children. Compared to children without VUR, those with VUR have a higher rate of pyelonephritis and renal scarring following urinary tract infection (UTI). Options for treatment include observation with or without antibiotic prophylaxis and surgical repair. Surgical intervention may be necessary in patients with persistent reflux, renal scarring, and recurrent or breakthrough febrile UTI. Both open and endoscopic approaches to reflux correction are successful and reduce the occurrence of febrile UTI. Estimated success rates of open and endoscopic reflux correction are 98.1% (95% CI 95.1, 99.1) and 83.0% (95% CI 69.1, 91.4), respectively. Factors that affect the success of endoscopic injection include pre-operative reflux grade and presence of functional or anatomic bladder abnormalities including voiding dysfunction and duplicated collecting systems. Few studies have evaluated the long-term outcomes of endoscopic injection, and with variable results. In patients treated endoscopically, recurrent febrile UTI occurred in 0–21%, new renal damage in 9–12%, and recurrent reflux in 17–47.6% of treated ureters with at least 1 year follow-up. These studies highlight the need for standardized outcome reporting and longer follow-up after endoscopic treatment

Diploids in the Cryptococcus neoformans Serotype A Population Homozygous for the α Mating Type Originate via Unisexual Mating

The ubiquitous environmental human pathogen Cryptococcus neoformans is traditionally considered a haploid fungus with a bipolar mating system. In nature, the α mating type is overwhelmingly predominant over a. How genetic diversity is generated and maintained by this heterothallic fungus in a largely unisexual α population is unclear. Recently it was discovered that C. neoformans can undergo same-sex mating under laboratory conditions generating both diploid intermediates and haploid recombinant progeny. Same-sex mating (α-α) also occurs in nature as evidenced by the existence of natural diploid αADα hybrids that arose by fusion between two α cells of different serotypes (A and D). How significantly this novel sexual style contributes to genetic diversity of the Cryptococcus population was unknown. In this study, ∼500 natural C. neoformans isolates were tested for ploidy and close to 8% were found to be diploid by fluorescence flow cytometry analysis. The majority of these diploids were serotype A isolates with two copies of the α MAT locus allele. Among those, several are intra-varietal allodiploid hybrids produced by fusion of two genetically distinct α cells through same-sex mating. The majority, however, are autodiploids that harbor two seemingly identical copies of the genome and arose via either endoreplication or clonal mating. The diploids identified were isolated from different geographic locations and varied genotypically and phenotypically, indicating independent non-clonal origins. The present study demonstrates that unisexual mating produces diploid isolates of C. neoformans in nature, giving rise to populations of hybrids and mixed ploidy. Our findings underscore the importance of same-sex mating in shaping the current population structure of this important human pathogenic fungus, with implications for mechanisms of selfing and inbreeding in other microbial pathogens

Mitochondrial genomes and Doubly Uniparental Inheritance: new insights from Musculista senhousia sex-linked mitochondrial DNAs (Bivalvia Mytilidae)

BACKGROUND: Doubly Uniparental Inheritance (DUI) is a fascinating exception to matrilinear inheritance of mitochondrial DNA (mtDNA). Species with DUI are characterized by two distinct mtDNAs that are inherited either through females (F-mtDNA) or through males (M-mtDNA). DUI sex-linked mitochondrial genomes share several unusual features, such as additional protein coding genes and unusual gene duplications/structures, which have been related to the functionality of DUI. Recently, new evidence for DUI was found in the mytilid bivalve Musculista senhousia. This paper describes the complete sex-linked mitochondrial genomes of this species. RESULTS: Our analysis highlights that both M and F mtDNAs share roughly the same gene content and order, but with some remarkable differences. The Musculista sex-linked mtDNAs have differently organized putative control regions (CR), which include repeats and palindromic motifs, thought to provide sites for DNA-binding proteins involved in the transcriptional machinery. Moreover, in male mtDNA, two cox2 genes were found, one (M-cox2b) 123bp longer. CONCLUSIONS: The complete mtDNA genome characterization of DUI bivalves is the first step to unravel the complex genetic signals allowing Doubly Uniparental Inheritance, and the evolutionary implications of such an unusual transmission route in mitochondrial genome evolution in Bivalvia. The observed redundancy of the palindromic motifs in Musculista M-mtDNA may have a role on the process by which sperm mtDNA becomes dominant or exclusive of the male germline of DUI species. Moreover, the duplicated M-COX2b gene may have a different, still unknown, function related to DUI, in accordance to what has been already proposed for other DUI species in which a similar cox2 extension has been hypothesized to be a tag for male mitochondria