Prisoner's Dilemma cellular automata revisited: evolution of cooperation under environmental pressure

We propose an extension of the evolutionary Prisoner's Dilemma cellular automata, introduced by Nowak and May \cite{nm92}, in which the pressure of the environment is taken into account. This is implemented by requiring that individuals need to collect a minimum score $U_{min}$, representing indispensable resources (nutrients, energy, money, etc.) to prosper in this environment. So the agents, instead of evolving just by adopting the behaviour of the most successful neighbour (who got $U^{msn}$), also take into account if $U^{msn}$ is above or below the threshold $U_{min}$. If $U^{msn}<U_{min}$ an individual has a probability of adopting the opposite behaviour from the one used by its most successful neighbour. This modification allows the evolution of cooperation for payoffs for which defection was the rule (as it happens, for example, when the sucker's payoff is much worse than the punishment for mutual defection). We also analyse a more sophisticated version of this model in which the selective rule is supplemented with a "win-stay, lose-shift" criterion. The cluster structure is analyzed and, for this more complex version we found power-law scaling for a restricted region in the parameter space.Comment: 15 pages, 8 figures; added figures and revised tex

Do rats learn conditional independence?

If acquired associations are to accurately represent real relevance relations, there is motivation for the hypothesis that learning will, in some circumstances, be more appropriately modelled, not as direct dependence, but as conditional independence. In a serial compound conditioning experiment, two groups of rats were presented with a conditioned stimulus (CS1) that imperfectly (50%) predicted food, and was itself imperfectly predicted by a CS2. Groups differed in the proportion of CS2 presentations that were ultimately followed by food (25% versus 75%). Thus, the information presented regarding the relevance of CS2 to food was ambiguous between direct dependence and conditional independence (given CS1). If rats learnt that food was conditionally independent of CS2, given CS1, subjects of both groups should thereafter respond similarly to CS2 alone. Contrary to the conditionality hypothesis, subjects attended to the direct food predictability of CS2, suggesting that rats treat even distal stimuli in a CS sequence as immediately relevant to food, not conditional on an intermediate stimulus. These results urge caution in representing indirect associations as conditional associations, accentuate the theoretical weight of the Markov condition in graphical models, and challenge theories to articulate the conditions under which animals are expected to learn conditional associations, if ever.All funding for the project was internal, from Indiana University

Spatial patterns and scale freedom in a Prisoner's Dilemma cellular automata with Pavlovian strategies

A cellular automaton in which cells represent agents playing the Prisoner's Dilemma (PD) game following the simple "win-stay, loose-shift" strategy is studied. Individuals with binary behavior, such as they can either cooperate (C) or defect (D), play repeatedly with their neighbors (Von Neumann's and Moore's neighborhoods). Their utilities in each round of the game are given by a rescaled payoff matrix described by a single parameter Tau, which measures the ratio of 'temptation to defect' to 'reward for cooperation'. Depending on the region of the parameter space Tau, the system self-organizes - after a transient - into dynamical equilibrium states characterized by different definite fractions of C agents (2 states for the Von Neumann neighborhood and 4 for Moore neighborhood). For some ranges of Tau the cluster size distributions, the power spectrums P(f) and the perimeter-area curves follow power-law scalings. Percolation below threshold is also found for D agent clusters. We also analyze the asynchronous dynamics version of this model and compare results.Comment: Accepted for publication in JSTA

Physical activity monitoring to assess disability progression in multiple sclerosis

Background: Clinical outcome measurement in multiple sclerosis (MS) usually requires a physical visit. Remote activity monitoring (RAM) using wearable technology provides a rational alternative, especially desirable when distance is involved or in a pandemic setting. Objective: To validate RAM in progressive MS using (1) traditional psychometric methods (2) brain atrophy. Methods: 56 people with progressive MS participated in a longitudinal study over 2.5 years. An arm-worn RAM device measured activity over six days, every six months, and incorporated triaxial accelerometry and transcutaneous physiological variable measurement. Five RAM variables were assessed: physical activity duration, step count, active energy expenditure, metabolic equivalents and a composite RAM score incorporating all four variables. Other assessments every six months included EDSS, MSFC, MSIS-29, Chalder Fatigue Scale and Beck’s Depression Inventory. Annualized brain atrophy was measured using SIENA. Results: RAM was tolerated well by people with MS; the device was worn 99.4% of the time. RAM had good convergent and divergent validity and was responsive, especially with respect to step count. Measurement of physical activity over one day was as responsive as six days. The composite RAM score positively correlated with brain volume loss. Conclusion: Remote activity monitoring is a valid and acceptable outcome measure in MS

Interplay between Structure and Dynamics in Chitosan Films Investigated with Solid-State NMR, Dynamic Mechanical Analysis, and X-ray Diffraction

Modern solid-state NMR techniques, combined with X-ray diffraction, revealed the molecular origin of the difference in mechanical properties of self-associated chitosan films. Films cast from acidic aqueous solutions were compared before and after neutralization, and the role of the counterion (acetate vs Cl⁻) was investigated. There is a competition between local structure and long-range order. Hydrogen bonding gives good mechanical strength to neutralized films, which lack long-range organization. The long-range structure is better defined in films cast from acidic solutions in which strong electrostatic interactions cause rotational distortion around the chitosan chains. Plasticization by acetate counterions enhances long-range molecular organization and film flexibility. In contrast, Cl⁻ counterions act as a defect and impair the long-range organization by immobilizing hydration water. Molecular motion and proton exchange are restricted, resulting in brittle films despite the high moisture content

The Predictive Nature of Individual Differences in Early Associative Learning and Emerging Social Behavior

Across the first year of life, infants achieve remarkable success in their ability to interact in the social world. The hierarchical nature of circuit and skill development predicts that the emergence of social behaviors may depend upon an infant's early abilities to detect contingencies, particularly socially-relevant associations. Here, we examined whether individual differences in the rate of associative learning at one month of age is an enduring predictor of social, imitative, and discriminative behaviors measured across the human infant's first year. One-month learning rate was predictive of social behaviors at 5, 9, and 12 months of age as well as face-evoked discriminative neural activity at 9 months of age. Learning was not related to general cognitive abilities. These results underscore the importance of early contingency learning and suggest the presence of a basic mechanism underlying the ontogeny of social behaviors

The Course of Habituation of the Proboscis Extension Reflex Can Be Predicted by Sucrose Responsiveness in Drosophila

The proboscis extension reflex (PER) is triggered when insects’ gustatory receptors contact appetitive stimuli, so it provides a behavioral readout for perceptual encoding of tastants. Research on the experience dependent modulation of PER in Drosophila has been hindered by the difficulty of obtaining reliable measures of memory-driven change in PER probability in the background of larger changes induced by physiological state. In this study, we showed that the course of PER habituation can be predicted by the degree of sucrose responsiveness in Drosophila. We assessed early response parameters, including the number of proboscis extensions and labellar movements in the first five trials, the trial to start responding, and the trial to make the first stop to quantify responsiveness, which predicted the upcoming pattern of both the short-term and 1 hour memory of PER habituation for individual flies. The cAMP signaling pathway mutant rutabaga displayed deficits in attunement of perceptual salience of sucrose to physiological demands and stimulus-driven sensitization

Altering the Motivational Function of Nicotine through Conditioning Processes

The collection of chapters in this 55th Nebraska Symposium on Motivation Volume clearly highlights that effective strategies for reducing compulsive tobacco use will require a multifaceted approach in which genetic, neurobiological, individual, and cultural factors are considered. It is difficult, if not impossible, to predict where the next important breakthrough will come from (Bevins & Bardo, 2004; Dethier, 1966; Laidler, 1998). Accordingly, further research that extends and challenges current theory and practice at each of these levels of analysis is needed. The continuing focus of our research program, and the topic of the present chapter, is on the role of Pavlovian conditioning processes involving nicotine. Theoretical and empirical approaches to nicotine dependence that include Pavlovian conditioning processes have lead to important advances in our understanding and treatment of chronic tobacco use (e.g., see Rose, Chapter 8 and Tiffany, Warthen, & Goedecker, Chapter 10 in current Volume). These approaches conceptualize the drug as an unconditioned stimulus (US) or reinforcer. That is, the pharmacological effects of the drug (e.g., reward, analgesia, psychomotor stimulation) enter into an association with stimuli that reliably co-occur with these effects (e.g., paraphernalia, situational cues). Later exposure to these conditioned stimuli (CSs) can evoke conditioned responses (CRs) that increase the chances an individual will seek drug. More recently, we have suggested that the interoceptive stimulus effects of nicotine might also serve as a CS for other appetitive non-drug outcomes (i.e., USs) and/or a stimulus that occasions whether other CS-US associations will or will not occur (i.e., an occasion setter or facilitator; see Bevins & Palmatier, 2004). We have further suggested that such an associative learning history could impact the tenacity of nicotine addiction—e.g., shorten the time between experimentation and dependence, increase the difficulty of quitting, make sustaining abstinence more difficult, etc. At the current time these suggestions are speculative. With this in mind, the present chapter will review the research in this area, as well as highlight some of its historical precursors and suggest some possible future directions for research. In doing so, hopefully the reader will gain an appreciation for how this approach might lead to further insight into how Pavlovian conditioning processes can alter the motivational function of nicotine in a manner that contributes to chronic tobacco use

Protein Hydrolysates Are Avoided by Herbivores but Not by Omnivores in Two-Choice Preference Tests

Background: The negative sensory properties of casein hydrolysates (HC) often limit their usage in products intended for human consumption, despite HC being nutritious and having many functional benefits. Recent, but taxonomically limited, evidence suggests that other animals also avoid consuming HC when alternatives exist. Methodology/Principal Findings: We evaluated ingestive responses of five herbivorous species (guinea pig, mountain beaver, gopher, vole, and rabbit) and five omnivorous species (rat, coyote, house mouse, white-footed mouse, and deer mouse; N = 16–18/species) using solid foods containing 20% HC in a series of two-choice preference tests that used a nonprotein, cellulose-based alternative. Individuals were also tested with collagen hydrolysate (gelatin; GE) to determine whether it would induce similar ingestive responses to those induced by HC. Despite HC and GE having very different nutritional and sensory qualities, both hydrolysates produced similar preference score patterns. We found that the herbivores generally avoided the hydrolysates while the omnivores consumed them at similar levels to the cellulose diet or, more rarely, preferred them (HC by the white-footed mouse; GE by the rat). Follow-up preference tests pairing HC and the nutritionally equivalent intact casein (C) were performed on the three mouse species and the guinea pigs. For the mice, mean HC preference scores were lower in the HC v C compared to the HC v Cel tests, indicating that HC’s sensory qualities negatively affected its consumption. However, responses were species-specific. For the guinea pigs, repeated exposure to HC or C (4.7-h sessions; N = 10) were found to increase subsequent HC preference scores in an HC v C preference test, which was interpreted in the light of conservative foraging strategies thought to typify herbivores. Conclusions/Significance: This is the first empirical study of dietary niche-related taxonomic differences in ingestive responses to protein hydrolysates using multiple species under comparable conditions. Our results provide a basis for future work in sensory, physiological, and behavioral mechanisms of hydrolysate avoidance and on the potential use of hydrolysates for pest management