A Local Circuit Model of Learned Striatal and Dopamine Cell Responses under Probabilistic Schedules of Reward

Before choosing, it helps to know both the expected value signaled by a predictive cue and the associated uncertainty that the reward will be forthcoming. Recently, Fiorillo et al. (2003) found the dopamine (DA) neurons of the SNc exhibit sustained responses related to the uncertainty that a cure will be followed by reward, in addition to phasic responses related to reward prediction errors (RPEs). This suggests that cue-dependent anticipations of the timing, magnitude, and uncertainty of rewards are learned and reflected in components of the DA signals broadcast by SNc neurons. What is the minimal local circuit model that can explain such multifaceted reward-related learning? A new computational model shows how learned uncertainty responses emerge robustly on single trial along with phasic RPE responses, such that both types of DA responses exhibit the empirically observed dependence on conditional probability, expected value of reward, and time since onset of the reward-predicting cue. The model includes three major pathways for computing: immediate expected values of cures, timed predictions of reward magnitudes (and RPEs), and the uncertainty associated with these predictions. The first two model pathways refine those previously modeled by Brown et al. (1999). A third, newly modeled, pathway is formed by medium spiny projection neurons (MSPNs) of the matrix compartment of the striatum, whose axons co-release GABA and a neuropeptide, substance P, both at synapses with GABAergic neurons in the SNr and with the dendrites (in SNr) of DA neurons whose somas are in ventral SNc. Co-release enables efficient computation of sustained DA uncertainty responses that are a non-monotonic function of the conditonal probability that a reward will follow the cue. The new model's incorporation of a striatal microcircuit allowed it to reveals that variability in striatal cholinergic transmission can explain observed difference, between monkeys, in the amplitutude of the non-monotonic uncertainty function. Involvement of matriceal MSPNs and striatal cholinergic transmission implpies a relation between uncertainty in the cue-reward contigency and action-selection functions of the basal ganglia. The model synthesizes anatomical, electrophysiological and behavioral data regarding the midbrain DA system in a novel way, by relating the ability to compute uncertainty, in parallel with other aspects of reward contingencies, to the unique distribution of SP inputs in ventral SN.National Science Foundation (SBE-354378); Higher Educational Council of Turkey; Canakkale Onsekiz Mart University of Turke

Acetylcholine neuromodulation in normal and abnormal learning and memory: vigilance control in waking, sleep, autism, amnesia, and Alzheimer's disease

This article provides a unified mechanistic neural explanation of how learning, recognition, and cognition break down during Alzheimer's disease, medial temporal amnesia, and autism. It also clarifies whey there are often sleep disturbances during these disorders. A key mechanism is how acetylcholine modules vigilance control in cortical layer

Towards building a more complex view of the lateral geniculate nucleus: Recent advances in understanding its role

The lateral geniculate nucleus (LGN) has often been treated in the past as a linear filter that adds little to retinal processing of visual inputs. Here we review anatomical, neurophysiological, brain imaging, and modeling studies that have in recent years built up a much more complex view of LGN . These include effects related to nonlinear dendritic processing, cortical feedback, synchrony and oscillations across LGN populations, as well as involvement of LGN in higher level cognitive processing. Although recent studies have provided valuable insights into early visual processing including the role of LGN, a unified model of LGN responses to real-world objects has not yet been developed. In the light of recent data, we suggest that the role of LGN deserves more careful consideration in developing models of high-level visual processing

How Laminar Frontal Cortex and Basal Ganglia Circuits Interact to Control Planned and Reactive Saccades

The basal ganglia and frontal cortex together allow animals to learn adaptive responses that acquire rewards when prepotent reflexive responses are insufficient. Anatomical studies show a rich pattern of interactions between the basal ganglia and distinct frontal cortical layers. Analysis of the laminar circuitry of the frontal cortex, together with its interactions with the basal ganglia, motor thalamus, superior colliculus, and inferotemporal and parietal cortices, provides new insight into how these brain regions interact to learn and perform complexly conditioned behaviors. A neural model whose cortical component represents the frontal eye fields captures these interacting circuits. Simulations of the neural model illustrate how it provides a functional explanation of the dynamics of 17 physiologically identified cell types found in these areas. The model predicts how action planning or priming (in cortical layers III and VI) is dissociated from execution (in layer V), how a cue may serve either as a movement target or as a discriminative cue to move elsewhere, and how the basal ganglia help choose among competing actions. The model simulates neurophysiological, anatomical, and behavioral data about how monkeys perform saccadic eye movement tasks, including fixation; single saccade, overlap, gap, and memory-guided saccades; anti-saccades; and parallel search among distractors.Defense Advanced Research Projects Agency and the Office of Naval Research (N00014-95-l-0409, N00014-92-J-1309, N00014-95-1-0657); National Science Foundation (IRI-97-20333)

A Paleocortico-Thalamo-Cortical Circuit Operating Giant Synapses

The thalamus is a critical relay station in the pathway for sensory information to the cortex and additionally important for the intercortical information transfer. An exception is the olfactory system, as it does not require a thalamic relay step before the information reaches the cortex. Olfactory receptor neurons send axonal projections to the olfactory bulb, from where the information proceeds to the primary olfactory cortex. It is only from the piriform cortex (PIR) that the information is passed to the prefrontal cortex via direct projections and via the mediodorsal thalamus (MD). Aside the for a sensory system exceptional connectivity, does this circuit also stand out against other cortico-thalamo-cortical loops. The PIR belongs to the paleocortex instead of neocortex, the contributor to most other cortico-thalamo-cortical loops. This situation raises the question if paleocorticothalamic projections have the same function as their subcorticothalamic or neocorticothalamic equivalents? In this thesis, I utilize a highly precise spatiotemporal gene transfer system via adeno-associated viruses to label PIR synapses. In acute slice preparations these synapses may be excited individually by juxtapositioned near field simulation electrodes. Based on the kinetics of the evoked postsynaptic currents and immunohistological stainings, I propose glutamate as the principle neurotransmitter. The PIR-MD synapse displays short-term depression, as it has been shown for other thalamic afferences, classified as “drivers”. In an electronmicroscopic preparation the complex dendritic interface of PIR-MD synapses becomes apparent. Often multiple dendritic excrescences invade the presynaptic profile. The presynaptic lumen is filled with vesicles and mitochondria. Altogether the morphology is that of a typical driver synapse in the thalamus. Surprisingly, I found chemical synapses onto intermediate stretches of labeled axons, a constellation that has not been described in MD or elsewhere previously. In summary, the results show that the olfactory brain circuit may have an additional level of complexity, imposed by axo-axonal contacts, and that PIR-MD synapses function like driver synapses in other transthalamic projections. However, as the term “driver” suggests that it always evokes postsynaptic action potentials, which is not true for the PIR-MD synapse, the recently proposed term “class I” synapse is adopted

The general anaesthetic etomidate inhibits the excitability of mouse thalamocortical relay neurons by modulating multiple modes of GABA_A receptor-mediated inhibition

Modulation of thalamocortical (TC) relay neuron function has been implicated in the sedative and hypnotic effects of general anaesthetics. Inhibition of TC neurons is mediated predominantly by a combination of phasic and tonic inhibition, together with a recently described ‘spillover’ mode of inhibition, generated by the dynamic recruitment of extrasynaptic γ-aminobutyric acid (GABA)(A) receptors (GABA(A)Rs). Previous studies demonstrated that the intravenous anaesthetic etomidate enhances tonic and phasic inhibition in TC relay neurons, but it is not known how etomidate may influence spillover inhibition. Moreover, it is unclear how etomidate influences the excitability of TC neurons. Thus, to investigate the relative contribution of synaptic (α1β2γ2) and extrasynaptic (α4β2δ) GABA(A)Rs to the thalamic effects of etomidate, we performed whole-cell recordings from mouse TC neurons lacking synaptic (α1(0/0)) or extrasynaptic (δ(0/0)) GABA(A)Rs. Etomidate (3 μm) significantly inhibited action-potential discharge in a manner that was dependent on facilitation of both synaptic and extrasynaptic GABA(A)Rs, although enhanced tonic inhibition was dominant in this respect. Additionally, phasic inhibition evoked by stimulation of the nucleus reticularis exhibited a spillover component mediated by δ-GABA(A)Rs, which was significantly prolonged in the presence of etomidate. Thus, etomidate greatly enhanced the transient suppression of TC spike trains by evoked inhibitory postsynaptic potentials. Collectively, these results suggest that the deactivation of thalamus observed during etomidate-induced anaesthesia involves potentiation of tonic and phasic inhibition, and implicate amplification of spillover inhibition as a novel mechanism to regulate the gating of sensory information through the thalamus during anaesthetic states

Neuromodulation of Thalamic Sensory Processing of Tactile Stimuli

Neuromodulatory systems, such as the locus coeruleus (LC) - norepinephrine (NE) system, are integral in the modulation of behavioral state, which in turn exerts a heavy influence on sensory processing, perception, and behavior. LC neurons project diffusely through the forebrain as the sole source of NE. LC tonic firing rate has been shown to correlate with arousal level and behavioral performance. As the LC-NE system innervates sensory pathways and NE has been shown to affect neuronal response, the LC-NE system could potentially allow for state-dependent modulation of sensory processing. However, the precise link between LC activation and sensory processing in the various stages of the sensory pathway that underly perception remained elusive. It is well established that thalamic relay nuclei play an essential role in gating the flow of sensory information to the neocortex, serving to establish cortical representation of sensory environment. Thalamocortical information transmission has been proposed to be strongly modulated by the dynamic interplay between the thalamic relay nuclei and the thalamic reticular nucleus (TRN). Neurons in the early stages of sensory pathways selectively respond to specific features of sensory stimuli. In the rodent vibrissa pathway, thalamocortical neurons in the ventral posteromedial nucleus (VPm) encode kinetic features of whisker movement, allowing stimuli to be encoded by distinctive, temporally precise firing patterns. Therefore, understanding feature selectivity is crucial to understanding sensory processing and perception. However, whether LC activation modulates this feature selectivity, and if it does, the mechanisms through which this modulation occurs, remained largely unknown. This work investigates LC modulation of thalamic feature selectivity through reverse correlation analysis of single-unit recordings from different stages of the rat vibrissa pathway. LC activation increased feature selectivity, drastically improving thalamic information transmission. This improvement was dependent on both local activation of α-adrenergic receptors and modulation of T-type calcium channels in the thalamus and was not due to LC modulation of trigeminothalamic feedforward or corticothalamic feedback inputs. LC activation reduced thalamic bursting, but this change in thalamic firing mode was not the primary cause of the improved information transmission as tonic spikes with LC stimulation carried three-times the information than tonic spikes without LC stimulation. Modelling confirmed NE regulation of intrathalamic circuit dynamics led to the improved information transmission as LC-NE modulation of either relay or reticular nucleus alone cannot account for the improvement. These results suggest a new sub-dimension within the tonic mode in which brain state can optimize thalamic sensory processing through modulation of intrathalamic circuit dynamics. Subsequent computational work was then performed to determine exactly how the encoding of sensory information by thalamic relay neurons was altered to allow for an increase in both information transmission efficiency and rate. The results show that LC-NE induced improvements in feature selectivity are not simply due to an increased signal-to-noise ratio, a shift from bursting to tonic firing, or improvements in reliability or precision. Rather, LC-NE-induced modulation of intrathalamic dynamics changed the temporal response structure thalamic neurons used to encode the same stimuli to a new structure that increased the information carried by both tonic and burst spikes. The shift in events times favors optimal encoding, as more events occur at ideal positions, i.e. when the stimulus most closely matches the neuron’s feature selectivity. Further, this work analyzed the ability to reconstruct the original stimulus using the evoked spike trains of multiple neurons and their recovered feature selectivity from an ideal observer point-of-view. The results showed that LC-activation improved the accuracy of this reconstruction, indicating it may improve the accuracy of perception of whisker stimuli. Finally, to make this work translatable, the use of vagus nerve stimulation (VNS) was investigated as a potential method for minimally invasive enhancement of thalamic sensory processing. The vagus nerve, which runs through the side of the neck, has long been known to have profound effects on brain-state and VNS has been shown to evoke LC firing. This work elucidates the previously uninvestigated short-term effects of VNS on thalamic sensory processing. Similar to direct LC stimulation, VNS enhanced the feature selectivity of thalamic neurons, resulting in a significant increase in the efficiency and rate of stimulus-related information conveyed by thalamic spikes. VNS-induced improvement in thalamic sensory processing also coincided with a decrease in thalamic burst firing, suggesting the same underlying mechanism as the improvements induced with direct LC stimulation

Intrinsic and synaptic membrane properties of neurons in the thalamic reticular nucleus

Tableau d’honneur de la Faculté des études supérieures et postdoctorales, 2004-2005Le noyau réticulaire thalamique (RE) est une structure qui engendre des fuseaux, une oscillation bioélectrique de marque pendant les stades précoces du sommeil. De multiples propriétés neuronales, intrinsèques et synaptiques, sont impliquées dans la génération, la propagation, le maintien et la terminaison des ondes en fuseaux. D’un autre côté, ce rythme constitue un état spécial de l’activité du réseau qui est généré par le réseau lui-même et affecte les propriétés cellulaires du noyau RE. Cette étude se concentre sur ces sujets: comment les propriétés cellulaires et les propriétés du réseau sont inter-reliées et interagissent pour engendrer les ondes fuseaux dans les neurones du RE et leurs cibles, les neurones thalamocorticaux. La présente thèse fournit de nouvelles évidences montrant le rôle fondamental joué par les neurones du noyau RE dans la genèse des ondes en fuseaux, dû aux synapses chimiques établies par ces neurones. La propagation et la synchronisation de l’activité sont modulées par les synapses électriques entre les neurones réticulaires thalamiques, mais aussi par les composantes dépolarisantes secondaires des réponses synaptiques évoquées par le cortex. De plus, la forme générale et la terminaison des oscillations thalamiques sont probablement contrôlées en grande partie par les neurones du RE, lesquels expriment une conductance intrinsèque leurs procurant une membrane avec un comportement bistable. Finalement, les oscillations thalamiques en fuseaux sont aussi capables de moduler les propriétés membranaires et l’activité des neurones individuels du RE.The thalamic reticular nucleus (RE) is a key structure related to spindles, a hallmark bioelectrical oscillation during early stages of sleep. Multiple neuronal properties, both intrinsic and synaptic, are implicated in the generation, propagation, maintenance and termination of spindle waves. On the other hand, this rhythm constitutes a special state of network activity, which is generated within, and affects single-cell properties of the RE nucleus. This study is focused on these topics: how cellular and network properties are interrelated and interact to generate spindle waves in the pacemaking RE neurons and their targets, thalamocortical neurons. The present thesis provides new evidence showing the fundamental role played by the RE nucleus in the generation of spindle waves, due to chemical synapses established by its neurons. The propagation and synchronization of activity is modulated by electrical synapses between thalamic reticular neurons, but also by the secondary depolarizing component of cortically-evoked synaptic responses. Additionally, the general shaping and probably the termination of thalamic oscillations could be controlled to a great extent by RE neurons, which express an intrinsic conductance endowing them with membrane bistable behaviour. Finally, thalamic spindle oscillations are also able to modulate the membrane properties and activities of individual RE neurons

Basic mechanisms of DBS for Parkinson’s disease: computational and experimental studies on neural dynamics

Deep Brain Stimulation (DBS) has become an accepted therapy of last resort for Parkinson’s disease (PD). The acceptance of DBS for the management of PD motor symptoms is based on its success rate and contrasts sharply with ones understanding of the pathophysiology underlying the disease state and mechanism of DBS. Theoretical and experimental studies at a neuronal and population level continue to shed light on the mechanism of DBS. In this thesis, we employ computational models in order to test certain hypothesis put forward in the field regarding the mechanism of DBS and efficacy of high frequency stimulation. Moreover, we make use of cellular recordings in order to test the validity of observations made using computational models. We incorporate population level recordings, obtained from PD patients, into a theoretical population level model in order to infer possible neuronal mechanisms underlying the differences observed in the recordings, arising from different experimental conditions. Last but not least, we analyze experimental recordings obtained from PD patients and assess which signal properties are selective to certain brain regions of interest