Prisoner's Dilemma cellular automata revisited: evolution of cooperation under environmental pressure

We propose an extension of the evolutionary Prisoner's Dilemma cellular automata, introduced by Nowak and May \cite{nm92}, in which the pressure of the environment is taken into account. This is implemented by requiring that individuals need to collect a minimum score $U_{min}$, representing indispensable resources (nutrients, energy, money, etc.) to prosper in this environment. So the agents, instead of evolving just by adopting the behaviour of the most successful neighbour (who got $U^{msn}$), also take into account if $U^{msn}$ is above or below the threshold $U_{min}$. If $U^{msn}<U_{min}$ an individual has a probability of adopting the opposite behaviour from the one used by its most successful neighbour. This modification allows the evolution of cooperation for payoffs for which defection was the rule (as it happens, for example, when the sucker's payoff is much worse than the punishment for mutual defection). We also analyse a more sophisticated version of this model in which the selective rule is supplemented with a "win-stay, lose-shift" criterion. The cluster structure is analyzed and, for this more complex version we found power-law scaling for a restricted region in the parameter space.Comment: 15 pages, 8 figures; added figures and revised tex

Spatial patterns and scale freedom in a Prisoner's Dilemma cellular automata with Pavlovian strategies

A cellular automaton in which cells represent agents playing the Prisoner's Dilemma (PD) game following the simple "win-stay, loose-shift" strategy is studied. Individuals with binary behavior, such as they can either cooperate (C) or defect (D), play repeatedly with their neighbors (Von Neumann's and Moore's neighborhoods). Their utilities in each round of the game are given by a rescaled payoff matrix described by a single parameter Tau, which measures the ratio of 'temptation to defect' to 'reward for cooperation'. Depending on the region of the parameter space Tau, the system self-organizes - after a transient - into dynamical equilibrium states characterized by different definite fractions of C agents (2 states for the Von Neumann neighborhood and 4 for Moore neighborhood). For some ranges of Tau the cluster size distributions, the power spectrums P(f) and the perimeter-area curves follow power-law scalings. Percolation below threshold is also found for D agent clusters. We also analyze the asynchronous dynamics version of this model and compare results.Comment: Accepted for publication in JSTA

Do rats learn conditional independence?

If acquired associations are to accurately represent real relevance relations, there is motivation for the hypothesis that learning will, in some circumstances, be more appropriately modelled, not as direct dependence, but as conditional independence. In a serial compound conditioning experiment, two groups of rats were presented with a conditioned stimulus (CS1) that imperfectly (50%) predicted food, and was itself imperfectly predicted by a CS2. Groups differed in the proportion of CS2 presentations that were ultimately followed by food (25% versus 75%). Thus, the information presented regarding the relevance of CS2 to food was ambiguous between direct dependence and conditional independence (given CS1). If rats learnt that food was conditionally independent of CS2, given CS1, subjects of both groups should thereafter respond similarly to CS2 alone. Contrary to the conditionality hypothesis, subjects attended to the direct food predictability of CS2, suggesting that rats treat even distal stimuli in a CS sequence as immediately relevant to food, not conditional on an intermediate stimulus. These results urge caution in representing indirect associations as conditional associations, accentuate the theoretical weight of the Markov condition in graphical models, and challenge theories to articulate the conditions under which animals are expected to learn conditional associations, if ever.All funding for the project was internal, from Indiana University

Physical activity monitoring to assess disability progression in multiple sclerosis

Background: Clinical outcome measurement in multiple sclerosis (MS) usually requires a physical visit. Remote activity monitoring (RAM) using wearable technology provides a rational alternative, especially desirable when distance is involved or in a pandemic setting. Objective: To validate RAM in progressive MS using (1) traditional psychometric methods (2) brain atrophy. Methods: 56 people with progressive MS participated in a longitudinal study over 2.5 years. An arm-worn RAM device measured activity over six days, every six months, and incorporated triaxial accelerometry and transcutaneous physiological variable measurement. Five RAM variables were assessed: physical activity duration, step count, active energy expenditure, metabolic equivalents and a composite RAM score incorporating all four variables. Other assessments every six months included EDSS, MSFC, MSIS-29, Chalder Fatigue Scale and Beck’s Depression Inventory. Annualized brain atrophy was measured using SIENA. Results: RAM was tolerated well by people with MS; the device was worn 99.4% of the time. RAM had good convergent and divergent validity and was responsive, especially with respect to step count. Measurement of physical activity over one day was as responsive as six days. The composite RAM score positively correlated with brain volume loss. Conclusion: Remote activity monitoring is a valid and acceptable outcome measure in MS

A cellular defense memory imprinted by early life toxic stress

Stress exposure early in life is implicated in various behavioural and somatic diseases. Experiences during the critical perinatal period form permanent, imprinted memories promoting adult survival. Although imprinting is widely recognized to dictate behaviour, whether it actuates specific transcriptional responses at the cellular level is unknown. Here we report that in response to early life stresses, Caenorhabditis elegans nematodes form an imprinted cellular defense memory. We show that exposing newly-born worms to toxic antimycin A and paraquat, respectively, stimulates the expression of toxin-specific cytoprotective reporters. Toxin exposure also induces avoidance of the toxin-containing bacterial lawn. In contrast, adult worms do not exhibit aversive behaviour towards stress-associated bacterial sensory cues. However, the mere re-encounter with the same cues reactivates the previously induced cytoprotective reporters. Learned adult defenses require memory formation during the L1 larval stage and do not appear to confer increased protection against the toxin. Thus, exposure of C. elegans to toxic stresses in the critical period elicits adaptive behavioural and cytoprotective responses, which do not form imprinted aversive behaviour, but imprint a cytoprotective memory. Our findings identify a novel form of imprinting and suggest that imprinted molecular defenses might underlie various pathophysiological alterations related to early life stress. © 2019, The Author(s)

Specific Activation of Estrogen Receptor Alpha and Beta Enhances Male Sexual Behavior and Neuroplasticity in Male Japanese Quail

Two subtypes of estrogen receptors (ER), ERα and ERβ, have been identified in humans and numerous vertebrates, including the Japanese quail. We investigated in this species the specific role(s) of each receptor in the activation of male sexual behavior and the underlying estrogen-dependent neural plasticity. Castrated male Japanese quail received empty (CX) or testosterone-filled (T) implants or were daily injected with the ER general agonist diethylstilbestrol (DES), the ERα-specific agonist PPT, the ERβ-specific agonist DPN or the vehicle, propylene glycol. Three days after receiving the first treatment, subjects were alternatively tested for appetitive (rhythmic cloacal sphincter movements, RCSM) and consummatory aspects (copulatory behavior) of male sexual behavior. 24 hours after the last behavioral testing, brains were collected and analyzed for aromatase expression and vasotocinergic innervation in the medial preoptic nucleus. The expression of RCSM was activated by T and to a lesser extent by DES and PPT but not by the ERβagonist DPN. In parallel, T fully restored the complete sequence of copulation, DES was partially active and the specific activation of ERα or ERβ only resulted in a very low frequency of mount attempts in few subjects. T increased the volume of the medial preoptic nucleus as measured by the dense cluster of aromatase-immunoreactive cells and the density of the vasotocinergic innervation within this nucleus. DES had only a weak action on vasotocinergic fibers and the two specific ER agonists did not affect these neural responses. Simultaneous activation of both receptors or treatments with higher doses may be required to fully activate sexual behavior and the associated neurochemical events

Interplay between Structure and Dynamics in Chitosan Films Investigated with Solid-State NMR, Dynamic Mechanical Analysis, and X-ray Diffraction

Modern solid-state NMR techniques, combined with X-ray diffraction, revealed the molecular origin of the difference in mechanical properties of self-associated chitosan films. Films cast from acidic aqueous solutions were compared before and after neutralization, and the role of the counterion (acetate vs Cl⁻) was investigated. There is a competition between local structure and long-range order. Hydrogen bonding gives good mechanical strength to neutralized films, which lack long-range organization. The long-range structure is better defined in films cast from acidic solutions in which strong electrostatic interactions cause rotational distortion around the chitosan chains. Plasticization by acetate counterions enhances long-range molecular organization and film flexibility. In contrast, Cl⁻ counterions act as a defect and impair the long-range organization by immobilizing hydration water. Molecular motion and proton exchange are restricted, resulting in brittle films despite the high moisture content

The Predictive Nature of Individual Differences in Early Associative Learning and Emerging Social Behavior

Across the first year of life, infants achieve remarkable success in their ability to interact in the social world. The hierarchical nature of circuit and skill development predicts that the emergence of social behaviors may depend upon an infant's early abilities to detect contingencies, particularly socially-relevant associations. Here, we examined whether individual differences in the rate of associative learning at one month of age is an enduring predictor of social, imitative, and discriminative behaviors measured across the human infant's first year. One-month learning rate was predictive of social behaviors at 5, 9, and 12 months of age as well as face-evoked discriminative neural activity at 9 months of age. Learning was not related to general cognitive abilities. These results underscore the importance of early contingency learning and suggest the presence of a basic mechanism underlying the ontogeny of social behaviors

Altering the Motivational Function of Nicotine through Conditioning Processes

The collection of chapters in this 55th Nebraska Symposium on Motivation Volume clearly highlights that effective strategies for reducing compulsive tobacco use will require a multifaceted approach in which genetic, neurobiological, individual, and cultural factors are considered. It is difficult, if not impossible, to predict where the next important breakthrough will come from (Bevins & Bardo, 2004; Dethier, 1966; Laidler, 1998). Accordingly, further research that extends and challenges current theory and practice at each of these levels of analysis is needed. The continuing focus of our research program, and the topic of the present chapter, is on the role of Pavlovian conditioning processes involving nicotine. Theoretical and empirical approaches to nicotine dependence that include Pavlovian conditioning processes have lead to important advances in our understanding and treatment of chronic tobacco use (e.g., see Rose, Chapter 8 and Tiffany, Warthen, & Goedecker, Chapter 10 in current Volume). These approaches conceptualize the drug as an unconditioned stimulus (US) or reinforcer. That is, the pharmacological effects of the drug (e.g., reward, analgesia, psychomotor stimulation) enter into an association with stimuli that reliably co-occur with these effects (e.g., paraphernalia, situational cues). Later exposure to these conditioned stimuli (CSs) can evoke conditioned responses (CRs) that increase the chances an individual will seek drug. More recently, we have suggested that the interoceptive stimulus effects of nicotine might also serve as a CS for other appetitive non-drug outcomes (i.e., USs) and/or a stimulus that occasions whether other CS-US associations will or will not occur (i.e., an occasion setter or facilitator; see Bevins & Palmatier, 2004). We have further suggested that such an associative learning history could impact the tenacity of nicotine addiction—e.g., shorten the time between experimentation and dependence, increase the difficulty of quitting, make sustaining abstinence more difficult, etc. At the current time these suggestions are speculative. With this in mind, the present chapter will review the research in this area, as well as highlight some of its historical precursors and suggest some possible future directions for research. In doing so, hopefully the reader will gain an appreciation for how this approach might lead to further insight into how Pavlovian conditioning processes can alter the motivational function of nicotine in a manner that contributes to chronic tobacco use