91 research outputs found

    Scale-free memory model for multiagent reinforcement learning. Mean field approximation and rock-paper-scissors dynamics

    Full text link
    A continuous time model for multiagent systems governed by reinforcement learning with scale-free memory is developed. The agents are assumed to act independently of one another in optimizing their choice of possible actions via trial-and-error search. To gain awareness about the action value the agents accumulate in their memory the rewards obtained from taking a specific action at each moment of time. The contribution of the rewards in the past to the agent current perception of action value is described by an integral operator with a power-law kernel. Finally a fractional differential equation governing the system dynamics is obtained. The agents are considered to interact with one another implicitly via the reward of one agent depending on the choice of the other agents. The pairwise interaction model is adopted to describe this effect. As a specific example of systems with non-transitive interactions, a two agent and three agent systems of the rock-paper-scissors type are analyzed in detail, including the stability analysis and numerical simulation. Scale-free memory is demonstrated to cause complex dynamics of the systems at hand. In particular, it is shown that there can be simultaneously two modes of the system instability undergoing subcritical and supercritical bifurcation, with the latter one exhibiting anomalous oscillations with the amplitude and period growing with time. Besides, the instability onset via this supercritical mode may be regarded as "altruism self-organization". For the three agent system the instability dynamics is found to be rather irregular and can be composed of alternate fragments of oscillations different in their properties.Comment: 17 pages, 7 figur

    Comparison of proteomic profiles of the venoms of two of the \u27Big Four\u27 snakes of India, the Indian Cobra (Naja naja) andthe common krait (Bungarus caeruleus), and analyses of their toxins

    Get PDF
    Snake venoms are mixtures of biologically-active proteins and peptides, and several studies have described the characteristics of some of these toxins. However, complete proteomic profiling of the venoms of many snake species has not yet been done. The Indian cobra (Naja naja) and common krait (Bungarus caeruleus) are elapid snake species that are among the ‘Big Four’ responsible for the majority of human snake envenomation cases in India. As understanding the composition and complexity of venoms is necessary for successful treatment of envenomation in humans, we utilized three different proteomic profiling approaches to characterize these venoms: i) one-dimensional SDS-PAGE coupled with in-gel tryptic digestion and electrospray tandem mass spectrometry (ESI-LC-MS/MS) of individual protein bands; ii) in-solution tryptic digestion of crude venoms coupled with ESI-LC-MS/MS; and iii) separation by gel-filtration chromatography coupled with tryptic digestion and ESI-LC-MS/MS of separated fractions. From the generated data, 81 and 46 different proteins were identified from N. naja and B. caeruleus venoms, respectively, belonging to fifteen different protein families. Venoms from both species were found to contain a variety of phospholipases A2 and three-finger toxins, whereas relatively higher numbers of snake venom metalloproteinases were found in N. naja compared to B. caeruleus venom. The analyses also identified less represented venom proteins including L-amino acid oxidases, cysteine-rich secretory proteins, 5’-nucleotidases and venom nerve growth factors. Further, Kunitz-type serine protease inhibitors, cobra venom factors, phosphodiesterases, vespryns and aminopeptidases were identified in the N. naja venom, while acetylcholinesterases and hyaluronidases were found in the B. caeruleus venom. We further analyzed protein coverage (Lys/Arg rich and poor regions as well as potential glycosylation sites) using in-house software. These studies expand our understanding of the proteomes of the venoms of these two medically-important species
    corecore