A Bio-Logical Theory of Animal Learning

This article provides the foundation for a new predictive theory of animal learning that is based upon a simple logical model. The knowledge of experimental subjects at a given time is described using logical equations. These logical equations are then used to predict a subject’s response when presented with a known or a previously unknown situation. This new theory suc- cessfully anticipates phenomena that existing theories predict, as well as phenomena that they cannot. It provides a theoretical account for phenomena that are beyond the domain of existing models, such as extinction and the detection of novelty, from which “external inhibition” can be explained. Examples of the methods applied to make predictions are given using previously published results. The present theory proposes a new way to envision the minimal functions of the nervous system, and provides possible new insights into the way that brains ultimately create and use knowledge about the world

Simulation of associative learning with the replaced elements model

Associative learning theories can be categorised according to whether they treat the representation of stimulus compounds in an elemental or configural manner. Since it is clear that a simple elemental approach to stimulus representation is inadequate there have been several attempts to produce more elaborate elemental models. One recent approach, the Replaced Elements Model (Wagner, 2003), reproduces many results that have until recently been uniquely predicted by Pearce’s Configural Theory (Pearce, 1994). Although it is possible to simulate the Replaced Elements Model using “standard” simulation programs the generation of the correct stimulus representation is complex. The current paper describes a method for simulation of the Replaced Elements Model and presents the results of two example simulations that show differential predictions of Replaced Elements and Pearce’s Configural Theor

Extinction of cue-evoked drug-seeking relies on degrading hierarchical instrumental expectancies

There has long been need for a behavioural intervention that attenuates cue-evoked drug-seeking, but the optimal method remains obscure. To address this, we report three approaches to extinguish cue-evoked drug-seeking measured in a Pavlovian to instrumental transfer design, in non-treatment seeking adult smokers and alcohol drinkers. The results showed that the ability of a drug stimulus to transfer control over a separately trained drug-seeking response was not affected by the stimulus undergoing Pavlovian extinction training in experiment 1, but was abolished by the stimulus undergoing discriminative extinction training in experiment 2, and was abolished by explicit verbal instructions stating that the stimulus did not signal a more effective response-drug contingency in experiment 3. These data suggest that cue-evoked drug-seeking is mediated by a propositional hierarchical instrumental expectancy that the drug-seeking response is more likely to be rewarded in that stimulus. Methods which degraded this hierarchical expectancy were effective in the laboratory, and so may have therapeutic potential

Negative priming and occasion setting in an appetitive Pavlovian procedure

Rats received training in which two auditory target stimuli, X and Y, were signaled by two visual stimuli, A and B, and followed by food (i.e., A→X1, B→Y+). The test consisted of presentations of X and Y preceded either by the same signal as during training (same trials: A→X, B→Y) or by the alternative signal (different trials: A→Y, B→X). After 8 training sessions, the animals responded less on same trials than on different trials; this effect was significantly reduced after 24 training sessions. In two additional experiments, animals that had also experienced presentations of A and B alone, either before or during training, showed the opposite pattern of results, responding more on same trials than on different trials. These results are interpreted as being due to the interaction between the effects of occasion setting andnegative priming (see Wagner, 1981)

Blocking by fixed and variable stimuli: effects of stimulus distribution on blocking

An experiment with rats compared the ability of fixed and variable duration cues to produce blocking. Rats in Group B (Blocking) were trained that both fixed- (F) and variable- (V) duration cues would be followed by food delivery. In a subsequent training stage F and V continued to be reinforced, but F was accompanied by X, and V by Y. In the test phase responding to X and Y was examined. Control Group O (Overshadowing) received identical treatment, except that F and V were nonreinforced in the first training stage. In Group B there was evidence for blocking, but only of X which had been conditioned in compound with the fixed-duration F; there was no evidence for blocking of Y, which had been conditioned in compound with the variable duration V. It is suggested that this result may occur because fixed cues reach a higher, more stable asymptote of associative strength than their variable equivalents

Plain cigarette packs do not exert Pavlovian to instrumental transfer of control over tobacco-seeking

Journal ArticleResearch Support, Non-U.S. Gov'tCopyright © 2014 The Authors. Addiction published by John Wiley & Sons Ltd on behalf of Society for the Study of AddictionAIMS: To gain insight into the potential impact of plain tobacco packaging policy, two experiments were undertaken to test whether 'prototype' plain compared with branded UK cigarette pack stimuli would differentially elicit instrumental tobacco-seeking in a nominal Pavlovian to instrumental transfer (PIT) procedure. DESIGN, SETTING AND PARTICIPANTS: Two experiments were undertaken at the University of Bristol UK, with a convenience sample of adult smokers (experiment 1, n = 23, experiment 2, n = 121). MEASUREMENT: In both experiments, smokers were trained on a concurrent choice procedure in which two responses earned points for cigarettes and chocolate, respectively, before images of branded and plain packs were tested for capacity to elicit the tobacco-seeking response in extinction. The primary outcome was percentage choice of the tobacco- over the chocolate-seeking response in plain pack, branded pack and no-stimulus conditions. FINDINGS: Both experiments found that branded packs primed a greater percentage of tobacco-seeking (overall mean = 62%) than plain packs (overall mean = 53%) and the no-stimulus condition (overall mean = 52%; Ps ≤ 0.01, ŋp (2) s ≥ 0.16), and that there was no difference in percentage tobacco-seeking between plain packs and the no-stimulus condition (Ps ≥ 0.17, ŋp (2) s ≤ 0.04). Plain tobacco packs showed an overall 9% reduction in the priming of a tobacco choice response compared to branded tobacco packs. CONCLUSIONS: Plain packaging may reduce smoking in current smokers by degrading cue-elicited tobacco-seeking.British Heart FoundationCancer Research UKNIHRMRCESR

Chaotic exploration and learning of locomotion behaviours

We present a general and fully dynamic neural system, which exploits intrinsic chaotic dynamics, for the real-time goal-directed exploration and learning of the possible locomotion patterns of an articulated robot of an arbitrary morphology in an unknown environment. The controller is modeled as a network of neural oscillators that are initially coupled only through physical embodiment, and goal-directed exploration of coordinated motor patterns is achieved by chaotic search using adaptive bifurcation. The phase space of the indirectly coupled neural-body-environment system contains multiple transient or permanent self-organized dynamics, each of which is a candidate for a locomotion behavior. The adaptive bifurcation enables the system orbit to wander through various phase-coordinated states, using its intrinsic chaotic dynamics as a driving force, and stabilizes on to one of the states matching the given goal criteria. In order to improve the sustainability of useful transient patterns, sensory homeostasis has been introduced, which results in an increased diversity of motor outputs, thus achieving multiscale exploration. A rhythmic pattern discovered by this process is memorized and sustained by changing the wiring between initially disconnected oscillators using an adaptive synchronization method. Our results show that the novel neurorobotic system is able to create and learn multiple locomotion behaviors for a wide range of body configurations and physical environments and can readapt in realtime after sustaining damage

Learning to fear a second-order stimulus following vicarious learning

Vicarious fear learning refers to the acquisition of fear via observation of the fearful responses of others. The present study aims to extend current knowledge by exploring whether second-order vicarious fear learning can be demonstrated in children. That is, whether vicariously learnt fear responses for one stimulus can be elicited in a second stimulus associated with that initial stimulus. Results demonstrated that children's (5–11 years) fear responses for marsupials and caterpillars increased when they were seen with fearful faces compared to no faces. Additionally, the results indicated a second-order effect in which fear-related learning occurred for other animals seen together with the fear-paired animal, even though the animals were never observed with fearful faces themselves. Overall, the findings indicate that for children in this age group vicariously learnt fear-related responses for one stimulus can subsequently be observed for a second stimulus without it being experienced in a fear-related vicarious learning event. These findings may help to explain why some individuals do not recall involvement of a traumatic learning episode in the development of their fear of a specific stimulus