Cooperation in the iterated prisoner's dilemma is learned by operant conditioning mechanisms

The prisoner's dilemma (PD) is the leading metaphor for the evolution of cooperative behavior in populations of selfish agents. Although cooperation in the iterated prisoner's dilemma (IPD) has been studied for over twenty years, most of this research has been focused on strategies that involve nonlearned behavior. Another approach is to suppose that players' selection of the preferred reply might he enforced in the same way as feeding animals track the best way to feed in changing nonstationary environments. Learning mechanisms such as operant conditioning enable animals to acquire relevant characteristics of their environment in order to get reinforcements and to avoid punishments. In this study, the role of operant conditioning in the learning of cooperation was evaluated in the PD. We found that operant mechanisms allow the learning of IPD play against other strategies. When random moves are allowed in the game, the operant learning model showed low sensitivity. On the basis of this evidence, it is suggested that operant learning might be involved in reciprocal altruism.Fil: Gutnisky, D. A.. Universidad de Buenos Aires. Facultad de Ingenieria. Instituto de Ingeniería Biomédica; Argentina. Consejo Nacional de Investigaciones Científicas y Técnicas. Instituto de Biología y Medicina Experimental. Fundación de Instituto de Biología y Medicina Experimental. Instituto de Biología y Medicina Experimental; ArgentinaFil: Zanutto, Bonifacio Silvano. Consejo Nacional de Investigaciones Científicas y Técnicas. Instituto de Biología y Medicina Experimental. Fundación de Instituto de Biología y Medicina Experimental. Instituto de Biología y Medicina Experimental; Argentina. Universidad de Buenos Aires. Facultad de Ingenieria. Instituto de Ingeniería Biomédica; Argentin

Learning obstacle avoidance with an operant behavioral model

Artificial intelligence researchers have been attracted by the idea of having robots learn how to accomplish a task, rather than being told explicitly. Reinforcement learning has been proposed as an appealing framework to be used in controlling mobile agents. Robot learning research, as well as research in biological systems, face many similar problems in order to display high flexibility in performing a variety of tasks. In this work, the controlling of a vehicle in an avoidance task by a previously developed operant learning model (a form of animal learning) is studied. An environment in which a mobile robot with proximity sensors has to minimize the punishment for colliding against obstacles is simulated. The results were compared with the Q-Learning algorithm, and the proposed model had better performance. In this way a new artificial intelligence agent inspired by neurobiology, psychology, and ethology research is proposed.Fil: Gutnisky, D. A.. Universidad de Buenos Aires. Facultad de Ingeniería.Instituto de Ingeniería Biomédica; ArgentinaFil: Zanutto, Bonifacio Silvano. Consejo Nacional de Investigaciones Científicas y Técnicas. Instituto de Biología y Medicina Experimental. Fundación de Instituto de Biología y Medicina Experimental. Instituto de Biología y Medicina Experimental; Argentina. Universidad de Buenos Aires. Facultad de Ingeniería.Instituto de Ingeniería Biomédica; Argentin

Comment on the paper by Y.Komura and Y.Okabe [arXiv:1011.3321]

We point out that the claim of strong universality in the paper J.Phys. A 44, 015002, arXiv:1011.3321 is incorrect, as it contradicts known rigorous results.Comment: submitted to J.Phys.

Las luces de la pobreza. Franciscanos y reforma en la Universidad de Córdoba del Tucumán

El siglo XVIII fue un tiempo de reformas administrativas y educativas en la Universidad de Córdoba del Tucumán, producto del plan de la nueva dinastía que ocupó el trono de España. Luego de la expulsión de los jesuitas (sus primitivos administradores) y la toma de posesión de la corporación por los franciscanos (fervientes adherentes al proyecto monárquico) los cambios se aceleraron. El trabajo parte de la hipótesis de que el acompañamiento de la reforma borbónica fue posible gracias a la renovación interna de la disciplina eclesial que experimentó la Orden en el siglo XVIII. Se estudia el pensamiento de los reformadores educativos seráficos y cómo sus ideas se plasmaron en el nuevo currículum de la universidad cordobesa.The eighteenth century was a time of administrative and educational reforms in the University of Córdoba of the Tucumán, which were the result of the plan followed by the new dynasty coming to the throne of Spain. After the Jesuits, its former administrators, were expelled, and once the Franciscans had taken charge of the corporation, the changes were speeded up because of their passionate support to the monarchical project. This article starts from the hypothesis that this support to the monarchical reform was possible thanks to the revival of ecclesiastical discipline within the Order itself in the eighteenth century. The seraphic educational reformers thought is herein studied as well as how their ideas were expressed in the new curriculum of the University of Córdoba of the Tucumán

Targeting the phosphatidylinositol 3-kinase/Akt/mechanistic target of rapamycin signaling pathway in B-lineage acute lymphoblastic leukemia: An update

Despite considerable progress in treatment protocols, B-lineage acute lymphoblastic leukemia (B-ALL) displays a poor prognosis in about 15–20% of pediatric cases and about 60% of adult patients. In addition, life-long irreversible late effects from chemo- and radiation therapy, including secondary malignancies, are a growing problem for leukemia survivors. Targeted therapy holds promising perspectives for cancer treatment as it may be more effective and have fewer side effects than conventional therapies. The phosphatidylinositol 3-phosphate kinase (PI3K)/Akt/mechanistic target of rapamycin (mTOR) signaling pathway is a key regulatory cascade which controls proliferation, survival and drug-resistance of cancer cells, and it is frequently upregulated in the different subtypes of B-ALL, where it plays important roles in the pathophysiology, maintenance and progression of the disease. Moreover, activation of this signaling cascade portends a poorer prognosis in both pediatric and adult B-ALL patients. Promising preclinical data on PI3K/Akt/mTOR inhibitors have documented their anticancer activity in B-ALL and some of these novel drugs have entered clinical trials as they could lead to a longer event-free survival and reduce therapy-associated toxicity for patients with B-ALL. This review highlights the current status of PI3K/Akt/mTOR inhibitors in B-ALL, with an emphasis on emerging evidence of the superior efficacy of synergistic combinations involving the use of traditional chemotherapeutics or other novel, targeted agents

Attack-Surface Metrics, OSSTMM and Common Criteria Based Approach to “Composable Security” in Complex Systems

In recent studies on Complex Systems and Systems-of-Systems theory, a huge effort has been put to cope with behavioral problems, i.e. the possibility of controlling a desired overall or end-to-end behavior by acting on the individual elements that constitute the system itself. This problem is particularly important in the “SMART” environments, where the huge number of devices, their significant computational capabilities as well as their tight interconnection produce a complex architecture for which it is difficult to predict (and control) a desired behavior; furthermore, if the scenario is allowed to dynamically evolve through the modification of both topology and subsystems composition, then the control problem becomes a real challenge. In this perspective, the purpose of this paper is to cope with a specific class of control problems in complex systems, the “composability of security functionalities”, recently introduced by the European Funded research through the pSHIELD and nSHIELD projects (ARTEMIS-JU programme). In a nutshell, the objective of this research is to define a control framework that, given a target security level for a specific application scenario, is able to i) discover the system elements, ii) quantify the security level of each element as well as its contribution to the security of the overall system, and iii) compute the control action to be applied on such elements to reach the security target. The main innovations proposed by the authors are: i) the definition of a comprehensive methodology to quantify the security of a generic system independently from the technology and the environment and ii) the integration of the derived metrics into a closed-loop scheme that allows real-time control of the system. The solution described in this work moves from the proof-of-concepts performed in the early phase of the pSHIELD research and enrich es it through an innovative metric with a sound foundation, able to potentially cope with any kind of pplication scenarios (railways, automotive, manufacturing, ...)

Andreev reflection in Si-engineered Al/InGaAs hybrid junctions

Andreev-reflection dominated transport is demonstrated in Al/n-In0.38Ga0.62As superconductor-semiconductor junctions grown by molecular beam epitaxy on GaAs(001). High junction transparency was achieved in low-doped devices by exploiting Si interface bilayers to suppress the native Schottky barrier. It is argued that this technique is ideally suited for the fabrication of ballistic transport hybrid microstructures.Comment: 9 REVTEX pages + 3 postscript figures, to be published in APL 73, (28dec98

Thermodynamic formalism for dissipative quantum walks

We consider the dynamical properties of dissipative continuous-time quantum walks on directed graphs. Using a large-deviation approach we construct a thermodynamic formalism allowing us to define a dynamical order parameter, and to identify transitions between dynamical regimes. For a particular class of dissipative quantum walks we propose a quantum generalization of the the classical PageRank vector, used to rank the importance of nodes in a directed graph. We also provide an example where one can characterize the dynamical transition from an effective classical random walk to a dissipative quantum walk as a thermodynamic crossover between distinct dynamical regimes.Comment: 8 page