Discounting and Reciprocity in an Iterated Prisoner’s Dilemma

The Iterated Prisoner’s Dilemma (IPD) is a central paradigm in the study of animal cooperation. According to the IPD framework, repeated play (repetition) and reciprocity combine to maintain a cooperative equilibrium. However, experimental studies with animals suggest that cooperative behavior in IPDs is unstable, and some have suggested that strong preferences for immediate benefits (that is, temporal discounting) might explain the fragility of cooperative equilibria. We studied the effects of discounting and strategic reciprocity on cooperation in captive blue jays. Our results demonstrate an interaction between discounting and reciprocity. Blue jays show high stable levels of cooperation in treatments with reduced discounting when their opponent reciprocates, but their levels of cooperation decline in all other treatment combinations. This suggests that stable cooperation requires both reduced discounting and reciprocity, and it offers an explanation of earlier failures to find cooperation in controlled payoff games

Assessment of course-based undergraduate research experiences: a meeting report

The Course-Based Undergraduate Research Experiences Network (CUREnet) was initiated in 2012 with funding from the National Science Foundation program for Research Coordination Networks in Undergraduate Biology Education. CUREnet aims to address topics, problems, and opportunities inherent to integrating research experiences into undergraduate courses. During CUREnet meetings and discussions, it became apparent that there is need for a clear definition of what constitutes a CURE and systematic exploration of what makes CUREs meaningful in terms of student learning. Thus, we assembled a small working group of people with expertise in CURE instruction and assessment to: 1) draft an operational definition of a CURE, with the aim of defining what makes a laboratory course or project a "research experience"; 2) summarize research on CUREs, as well as findings fromstudies of undergraduate research internships that would be useful for thinking about how students are influenced by participating in CUREs; and 3) identify areas of greatest need with respect to CURE assessment, and directions for future research on and evaluation of CUREs. This report summarizes the outcomes and recommendations of this meeting

Effects of temporal clumping and payoff accumulation on impulsiveness and cooperation

Animals show impulsiveness when they prefer a smaller more immediate option, even though a larger more delayed option produces a higher intake rate. This impulsive behavior has implications for several behavioral problems including social cooperation. This paper presents two experiments using captive blue jays (Cyanocitta cristata) that consider the effects of payoff accumulation and temporal clumping on impulsiveness and cooperation. Payoff accumulation refers to a situation where the benefits gained from each choice trial accumulate from one trial to the next, and only become available to the animal after it has completed a fixed number of trials. We hypothesized that this would reduce impulsiveness because it removes the advantage of quickly realizing food gains. Clumping refers to situation in which the animal experiences several choice trials in quick succession followed by a long pause before the next clump. We hypothesized that if payoffs accumulated over a clump of trials this would enhance the effect of accumulation. We tested the effects of accumulation and clumping on impulsiveness in a self-control situation. We found a significant interaction between clumping and accumulation. Payoff accumulation reduced impulsiveness, but only when trials were clumped. Post hoc analyses suggest that clumping alone increases impulsiveness. A second experiment applied these results to cooperation. This experiment reveals an interaction between payoff accumulation and trial’s position within the clump. Jays were more likely to cooperate on the first trial of a clump, but the likelihood of cooperation dropped after the first trial. However, this drop was larger when payoffs did not accumulate. This observation suggests that the difference between accumulated and unaccumulated treatments that we reported previously (Science 198: 2216–2218) may be largely due to differences in how animals behave in the first trial of a clump

Discounting and Reciprocity in an Iterated Prisoner’s Dilemma

The Iterated Prisoner’s Dilemma (IPD) is a central paradigm in the study of animal cooperation. According to the IPD framework, repeated play (repetition) and reciprocity combine to maintain a cooperative equilibrium. However, experimental studies with animals suggest that cooperative behavior in IPDs is unstable, and some have suggested that strong preferences for immediate benefits (that is, temporal discounting) might explain the fragility of cooperative equilibria. We studied the effects of discounting and strategic reciprocity on cooperation in captive blue jays. Our results demonstrate an interaction between discounting and reciprocity. Blue jays show high stable levels of cooperation in treatments with reduced discounting when their opponent reciprocates, but their levels of cooperation decline in all other treatment combinations. This suggests that stable cooperation requires both reduced discounting and reciprocity, and it offers an explanation of earlier failures to find cooperation in controlled payoff games

Why some memories do not last a lifetime: dynamic long-term retrieval in changing environments

Memory is a fundamental component of learning, a process by which individuals alter their behavior through experience. Although memory most likely has explicit costs such as synaptic maintenance and metabolic demands, there are also implicit costs to memory, in particular, the use of information that is no longer appropriate or is incorrect. Specifically, the period of retrievability for memories, or "memory window," should be sensitive to the rate of environmental change of information stored in memory. Much empirical data suggest that memory length--this period of retrievability--changes with both the age and state of the individual. Here, we use a dynamic programming approach to examine how optimal memory retrieval might change within the lifetime of the individual learner. We find that optimal memory length varies with both age and state (e.g., energy reserves) of the organism and that features of the environment determine how this change in memory occurs. In our model, retrieval decreases as the environment becomes unreliable but roughly increases with the cost of living. Cost of living interacts with the state of the organism: with high cost of living, an organism in a very poor state should have a long memory length, but an organism in a very good state with low costs of living should have a short memory length. Finally, we find there are circumstances where it is optimal for memory retrieval to decline toward the end of the lifetime. Because this framework does not incorporate inevitable degradation of neural mechanisms, this result implies that memory loss with age might actually be adaptive. Copyright 2009, Oxford University Press.