Signal detection analysis of contingency assessment: Associative interference and nonreinforcement impact cue-outcome contingency sensitivity, whereas cue density affects bias

In a signal detection theory approach to associative learning, the perceived (i.e., subjective) contingency between a cue and an outcome is a random variable drawn from a Gaussian distribution. At the end of the sequence, participants report a positive cue-outcome contingency provided the subjective contingency is above some threshold. Some researchers have suggested that the mean of the subjective contingency distributions and the threshold are controlled by different variables. The present data provide empirical support for this claim. In three experiments, participants were exposed to rapid streams of trials at the end of which they had to indicate whether a target outcome O1 was more likely following a target cue X. Interfering treatments were incorporated in some streams to impend participants' ability to identify the objective X-O1 contingency: interference trials (X was paired with an irrelevant outcome O2), nonreinforced trials (X was presented alone), plus control trials (an irrelevant cue W was paired with O2). Overall, both interference and nonreinforced trials impaired participants' sensitivity to the contingencies as measured by signal detection theory's d', but they also enhanced detection of positive contingencies through a cue density effect, with nonreinforced trials being more susceptible to this effect than interference trials. These results are explicable if one assumes interference and nonreinforced trials impact the mean of the associative strength distribution, while the cue density influences the threshold. (PsycInfo Database Record (c) 2022 APA, all rights reserved)

Genetic and environmental influences on one-trial conditioned context aversion in mice

Anticipatory nausea (AN) is caused by an association between contextual cues and the experience of nausea (the side effects of chemotherapy or radiation treatment) and it develops predominantly in female patients undergoing chemotherapy. Preclinical studies in rodents show that the administration of an illness‐inducing agent in the presence of novel contextual cues can cause conditioned context aversion (CCA) and this has been proposed to model AN. The literature also suggests that brief pre‐exposure to a novel context prior to shock delivery is critical in the development of contextual fear conditioning in rodents (a phenomenon known as Immediate Shock Deficit), but this has not been assessed in CCA. The aim of present study was to develop a CCA paradigm to assess this in outbred (CD1) and inbred (C57BL/6J) mice and evaluate potential sex differences. The results revealed that a single conditioning trial in which a distinctive context was paired with LiCl‐induced illness was sufficient to elicit a conditioned response in both female and male CD1 outbred mice, but not in C57BL/6J inbred mice. In addition, CCA was facilitated when animals had prior experience with the context. Finally, outbred female mice showed longer and more robust retention of CCA than male mice, which parallels clinical findings. The results indicate the importance of using CD1 outbred mice as an animal model of AN as well as examining sex differences in the CCA paradigm. Similar findings in humans encourage the future use of this novel CCA preclinical mouse model

Safety signals as instrumental reinforcers during free-operant avoidance.

Safety signals provide "relief" through predicting the absence of an aversive event. At issue is whether these signals also act as instrumental reinforcers. Four experiments were conducted using a free-operant lever-press avoidance paradigm in which each press avoided shock and was followed by the presentation of a 5-sec auditory safety signal. When given a choice between two levers in Experiment 1, both avoiding shock, rats preferentially responded on the lever that produced the safety signal as feedback, even when footshock was omitted. Following avoidance training with a single lever in Experiment 2, removal of the signal led to a decrease in avoidance responses and an increase in responses during the safety period normally denoted by the signal. These behavioral changes demonstrate the dual conditioned reinforcing and fear inhibiting properties of the safety signal. The associative processes that support the reinforcing properties of a safety signal were tested using a novel revaluation procedure. Prior experience of systemic morphine during safety signal presentations resulted in an increased rate of avoidance responses to produce the safety signal during a drug-free extinction test, a finding not seen with d-amphetamine in Experiment 3. Morphine revaluation of the safety signal was repeated in Experiment 4 followed by a drug-free extinction test in which responses did not produce the signal for the first 10 min of the session. Instrumental avoidance in the absence of the signal was shown to be insensitive to prior signal revaluation, suggesting that the signal reinforces free-operant avoidance behavior through a habit-like mechanism.This study was supported by a Wellcome Trust Programme grant to TWR, JW Dalley, BJ Everitt, AC Roberts and BJ Sahakian (089589/z/09/z). AF was supported by an MRC Case studentship and GU was supported by a Marie Curie Fellowship. The authors would also like to thank Dr Rudolf Cardinal for his helpful comments and critiques of the manuscript. The study was completed within the Behavioural and Clinical Neuroscience Institute, supported by a joint award from the MRC and the Wellcome Trust (G00001354).This is the final published version. It's also available from the publishers at http://learnmem.cshlp.org/content/21/9/488.long

Predictive and motivational factors influencing anticipatory contrast: A comparison of contextual and gustatory predictors in food restricted and free-fed rats

In anticipation of palatable food, rats can learn to restrict consumption of a less rewarding food type resulting in an increased consumption of the preferred food when it is made available. This construct is known as anticipatory negative contrast (ANC) and can help elucidate the processes that underlie binge-like behavior as well as self-control in rodent motivation models. In the current investigation we aimed to shed light on the ability of distinct predictors of a preferred food choice to generate contrast effects and the motivational processes that underlie this behavior. Using a novel set of rewarding solutions, we directly compared contextual and gustatory ANC predictors in both food restricted and free-fed Sprague-Dawley rats. Our results indicate that, despite being food restricted, rats are selective in their eating behavior and show strong contextually-driven ANC similar to free-fed animals. These differences mirrored changes in palatability for the less preferred solution across the different sessions as measured by lick microstructure analysis. In contrast to previous research, predictive cues in both food restricted and free-fed rats were sufficient for ANC to develop although flavor-driven ANC did not relate to a corresponding change in lick patterning. These differences in the lick microstructure between context- and flavor-driven ANC indicate that the motivational processes underlying ANC generated by the two predictor types are distinct. Moreover, an increase in premature port entries to the unavailable sipper – a second measure of ANC – in all groups reveals a direct influence of response competition on ANC development

Temporal and Spatial Contiguity Are Necessary for Competition Between Events

Over the last 50 years, cue competition phenomena have shaped theoretical developments in animal and human learning. However, recent failures to observe competition effects in standard conditioning procedures, as well as the lengthy and ongoing debate surrounding cue competition in the spatial learning literature, have cast doubts on the generality of these phenomena. In the present study, we manipulated temporal contiguity between simultaneously trained predictors and outcomes (Experiments 1–4), and spatial contiguity between landmarks and goals in spatial learning (Supplemental Experiments 1 and 2; Experiment 5). Across different parametric variations, we observed overshadowing when temporal and spatial contiguity were strong, but no overshadowing when contiguity was weak. Thus, across temporal and spatial domains, we observed that contiguity is necessary for competition to occur, and that competition between cues presented simultaneously during learning is absent when these cues were either spatially or temporally discontiguous from the outcome. Consequently, we advance a model in which the contiguity between events is accounted for and which explains these results and reconciles the previously contradictory findings observed in spatial learning

Fear memory modulation by incentive down and up-shifts

Research on retrieval-induced malleability of maladaptive emotional memories has been mostly focused on the effect of drugs and extinction (i.e. post-retrieval extinction). Only a few studies addressed post-retrieval appetitive-aversive interactions. Due to the relevance that the understanding of the interactions between memory content and appetitive or aversive states under retrieval circumstances has for translational research, here we explored the relation between fear (i.e. contextual fear conditioning) and sucrose concentration down (32–4%) or up-shifts (4–32%). These have been reported as methods to induce aversive or appetitive internal states, respectively. We observed that fear expression is differentially susceptible to incentive contrast manipulations depending on the memory stage: acquisition, mere retrieval or retrieval-induced memory malleability. After fear acquisition, freezing behavior and incentive shift direction followed an inverse relation, that is: up-shift decreased fear responding and down-shift increased it. However, freezing behavior remained unaltered when incentive contrast was absent, regardless of the sucrose concentration employed (4–4% and 32–32%). When incentive shifts occurred after mere-retrieval, both negative and positive incentive shifts resulted in increased freezing behavior. Strikingly, this effect was unrelated to the nature of the incentive contrast (either positive or negative), occurring only when animals had no previous experience with the shifted solution. On the other hand, when fear retrieval led to memory malleability, up-shifts in sucrose concentration dampened freezing behavior as much as unshifted controls, whilst down-shift left freezing unaltered. Freezing facilitation was finally achieved after retrieval-induced memory malleability only after prior sampling of the down-shifted solution (i.e. 4% SUC). These results reveal a complex pattern of interactions between memory retrieval and incentive shift-induced internal states

The dopamine D2/D3 receptor agonist quinpirole increases checking-like behaviour in an operant observing response task with uncertain reinforcement: a novel possible model of OCD.

Excessive checking is a common, debilitating symptom of obsessive-compulsive disorder (OCD). In an established rodent model of OCD checking behaviour, quinpirole (dopamine D2/3-receptor agonist) increased checking in open-field tests, indicating dopaminergic modulation of checking-like behaviours. We designed a novel operant paradigm for rats (observing response task (ORT)) to further examine cognitive processes underpinning checking behaviour and clarify how and why checking develops. We investigated i) how quinpirole increases checking, ii) dependence of these effects on D2/3 receptor function (following treatment with D2/3 receptor antagonist sulpiride) and iii) effects of reward uncertainty. In the ORT, rats pressed an 'observing' lever for information about the location of an 'active' lever that provided food reinforcement. High- and low-checkers (defined from baseline observing) received quinpirole (0.5mg/kg, 10 treatments) or vehicle. Parametric task manipulations assessed observing/checking under increasing task demands relating to reinforcement uncertainty (variable response requirement and active-lever location switching). Treatment with sulpiride further probed the pharmacological basis of long-term behavioural changes. Quinpirole selectively increased checking, both functional observing lever presses (OLPs) and non-functional extra OLPs (EOLPs). The increase in OLPs and EOLPs was long-lasting, without further quinpirole administration. Quinpirole did not affect the immediate ability to use information from checking. Vehicle and quinpirole-treated rats (VEH and QNP respectively) were selectively sensitive to different forms of uncertainty. Sulpiride reduced non-functional EOLPs in QNP rats but had no effect on functional OLPs. These data have implications for treatment of compulsive checking in OCD, particularly for serotonin-reuptake-inhibitor treatment-refractory cases, where supplementation with dopamine receptor antagonists may be beneficial

Renewal of instrumental avoidance in humans

Set of two experiments investigating the renewal of instrumental avoidance in hu man participants