Computational Models of Classical Conditioning: A Qualitative Evaluation and Comparison

Classical conditioning is a fundamental paradigm in the study of learning and thus in understanding cognitive processes and behaviour, for which we need comprehensive and accurate models. This paper aims at evaluating and comparing a collection of influential computational models of classical conditioning by analysing the models themselves and against one another qualitatively. The results will clarify the state of the art in the area and help develop a standard model of classical conditioning

Computational Models of Classical Conditioning guest editors’ introduction

In the present special issue, the performance of current computational models of classical conditioning was evaluated under three requirements: (1) Models were to be tested against a list of previously agreed-upon phenomena; (2) the parameters were fixed across simulations; and (3) the simulations used to test the models had to be made available. These requirements resulted in three major products: (a) a list of fundamental classical-conditioning results for which there is a consensus about their reliability; (b) the necessary information to evaluate each of the models on the basis of its ordinal successes in accounting for the experimental data; and (c) a repository of computational models ready to generate simulations. We believe that the contents of this issue represent the 2012 state of the art in computational modeling of classical conditioning and provide a way to find promising avenues for future model development

Uses, Abuses and Misuses of Computational Models in Classical Conditioning

Classical conditioning is at the heart of most learning phenomena. It is thus essential that we develop accurate models of conditioning; since, psychological models rely heavily in verbal accounts that are necessarily imprecise it has become apparent that the development of computational models is imperious. However, we need to separate the wheat from the chaff. In this paper we review the main uses of the term computational model in conditioning

Integrating incremental learning and episodic memory models of the hippocampal region.

By integrating previous computational models of corticohippocampal function, the authors develop and test a unified theory of the neural substrates of familiarity, recollection, and classical conditioning. This approach integrates models from 2 traditions of hippocampal modeling, those of episodic memory and incremental learning, by drawing on an earlier mathematical model of conditioning, SOP (A. Wagner, 1981). The model describes how a familiarity signal may arise from parahippocampal cortices, giving a novel explanation for the finding that the neural response to a stimulus in these regions decreases with increasing stimulus familiarity. Recollection is ascribed to the hippocampus proper. It is shown how the properties of episodic representations in the neocortex, parahippocampal gyrus, and hippocampus proper may explain phenomena in classical conditioning. The model reproduces the effects of hippocampal, septal, and broad hippocampal region lesions on contextual modulation of classical conditioning, blocking, learned irrelevance, and latent inhibition

What Have Computational Models Ever Done for Us?: A Case Study in Classical Conditioning

The last 50 years have seen the progressive refinement of our understanding of the mechanisms of classical conditioning and this has resulted in the development of several influential theories that are able to explain with considerable precision a wide variety of experimental findings, and to make non-intuitive predictions that have been confirmed. This success has spurred the development of increasingly sophisticated models that encompass more complex phenomena. In such context, it is widely acknowledged that computational modeling plays a fundamental part. In this paper the authors analyze critically the role that computational models, as simulators and as psychological models by proxy, have played in this enterprise

A Rescorla-Wagner Drift-Diffusion Model of Conditioning and Timing

Computational models of classical conditioning have made significant contributions to the theoretic understanding of associative learning, yet they still struggle when the temporal aspects of conditioning are taken into account. Interval timing models have contributed a rich variety of time representations and provided accurate predictions for the timing of responses, but they usually have little to say about associative learning. In this article we present a unified model of conditioning and timing that is based on the influential Rescorla-Wagner conditioning model and the more recently developed Timing Drift-Diffusion model. We test the model by simulating 10 experimental phenomena and show that it can provide an adequate account for 8, and a partial account for the other 2. We argue that the model can account for more phenomena in the chosen set than these other similar in scope models: CSC-TD, MS-TD, Learning to Time and Modular Theory. A comparison and analysis of the mechanisms in these models is provided, with a focus on the types of time representation and associative learning rule used

Cortico-hippocampal computational modeling using quantum-inspired neural networks

Many current computational models that aim to simulate cortical and hippocampal modules of the brain depend on artificial neural networks. However, such classical or even deep neural networks are very slow, sometimes taking thousands of trials to obtain the final response with a considerable amount of error. The need for a large number of trials at learning and the inaccurate output responses are due to the complexity of the input cue and the biological processes being simulated. This article proposes a computational model for an intact and a lesioned cortico-hippocampal system using quantum-inspired neural networks. This cortico-hippocampal computational quantum-inspired (CHCQI) model simulates cortical and hippocampal modules by using adaptively updated neural networks entangled with quantum circuits. The proposed model is used to simulate various classical conditioning tasks related to biological processes. The output of the simulated tasks yielded the desired responses quickly and efficiently compared with other computational models, including the recently published Green model

Study of classical conditioning in Aplysia through the implementation of computational models of its learning circuit

“This is an Accepted Manuscript of an article published by Taylor & Francis in Journal of Experimental & Theoretical Artificial Intelligence on 04 Jul 2007, available online: http://wwww.tandfonline.com/DOI:10.1080/09528130601052177.”The learning phenomenon can be analysed at various levels, but in this paper we treat a specific paradigm of artificial intelligence, i.e. artificial neural networks (ANNs), whose main virtue is their capacity to seek unified and mutually satisfactory solutions which are relevant to biological and psychological models. Many of the procedures and methods proposed previously have used biological and/or psychological principles, models, and data; here, we focus on models which look for a greater degree of coherence. Therefore we analyse and compare all aspects of the Gluck–Thompson and Hawkins ANN models. A multithread computer model is developed for analysis of these models in order to study simple learning phenomena in a marine invertebrate (Aplysia californica) and to check their applicability to research in psychology and neurobiology. The predictive capacities of the models differs significantly: the Hawkins model provides a better analysis of the behavioural repertory of Aplysia on both the associative and the non-associative learning level. The scope of the ANN modelling technique is broadened by integration with neurobiological and behavioural models of associative learning, allowing enhancement of some architectures and procedures that are currently being used