Reinforcement learning in populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral responses in the face of neuronal variability. But in standard reinforcement learning a flip-side becomes apparent. Learning slows down with increasing population size since the global reinforcement becomes less and less related to the performance of any single neuron. We show that, in contrast, learning speeds up with increasing population size if feedback about the populationresponse modulates synaptic plasticity in addition to global reinforcement. The two feedback signals (reinforcement and population-response signal) can be encoded by ambient neurotransmitter concentrations which vary slowly, yielding a fully online plasticity rule where the learning of a stimulus is interleaved with the processing of the subsequent one. The assumption of a single additional feedback mechanism therefore reconciles biological plausibility with efficient learning

Stimulating learning: A functional MRI and behavioral investigation of the effects of transcranial direct current stimulation on stochastic learning in schizophrenia

Transcranial direct current stimulation (tDCS) of the medial prefrontal cortex (mPFC) is under clinical investigation as a treatment for cognitive deficits. We investigate the effects of tDCS over the mPFC on performance SSLT in individuals with schizophrenia, and the underlying neurophysiological effect in regions associated with learning values and stimulus-outcome relationships. In this parallel-design double-blind pilot study, 49 individuals with schizophrenia, of whom 28 completed a fMRI, were randomized into active or sham tDCS stimulation groups. Subjects participated in 4 days of SSLT training (days 1, 2, 14, 56) with tDCS applied at day-1, and during a concurrent MRI scan at day-14. The SSLT demonstrated a significant mean difference in performance in the tDCS treatment group: at day-2 and at day-56. Active tDCS was associated with increased insular activity, and reduced amygdala activation. tDCS may offer an important novel approach to modulating brain networks to ameliorate cognitive deficits in schizophrenia, with this study being the first to show a longer-term effect on SSLT

An assessment of J/Psi formation in the light of initial RHIC data

Predictions of J/Psi formation at RHIC via "off-diagonal" combinations of charm and anticharm quarks in a region of color deconfinement are confronted with initial data from the PHENIX collaboration. We find that the measured centrality behavior places significant constraints on the various parameters which control model calculations of J/Psi formation. Within present statistical and systematic uncertainties, one can map out a region of parameter space within which the contribution of formation in a deconfined phase is allowed. As these uncertainties decrease and new data from d-Au interactions becomes available, it is expected that definitive tests for the presence of this formation mechanism will be possible. We anticipate that the rapidity and transverse momentum spectra will prove decisive for a final determination.Comment: 6 pages, 5 figures, presented at SQM2003, March 12-17, 2003. To be published in J. Phys.

Impulsivity in Parkinson’s disease is associated with alterations in affective and sensorimotor striatal networks

A subset of patients with Parkinson’s disease (PD) experiences problems with impulse control, characterized by a loss of voluntary control over impulses, drives, or temptations regarding excessive hedonic behavior. The present study aimed to better understand the neural basis of such impulse control disorders (ICDs) in PD. We collected resting-state functional connectivity and structural MRI data from 21 PD patients with ICDs and 30 patients without such disorders. To assess impulsivity, all patients completed the Barratt Impulsiveness Scale and performed an information-gathering task. MRI results demonstrated substantial differences in neural characteristics between PD patients with and without ICDs. Results showed that impulsivity was linked to alterations in affective basal ganglia circuitries. Specifically, reduced frontal–striatal connectivity and GPe volume were associated with more impulsivity. We suggest that these changes affect decision making and result in a preference for risky or inappropriate actions. Results further showed that impulsivity was linked to alterations in sensorimotor striatal networks. Enhanced connectivity within this network and larger putamen volume were associated with more impulsivity. We propose that these changes affect sensorimotor processing such that patients have a greater propensity to act. Our findings suggest that the two mechanisms jointly contribute to impulsive behaviors in PD

Neutral Pions and Eta Mesons as Probes of the Hadronic Fireball in Nucleus-Nucleus Collisions around 1A GeV

Chemical and thermal freeze-out of the hadronic fireball formed in symmetric collisions of light, intermediate-mass, and heavy nuclei at beam energies between 0.8A GeV and 2.0A GeV are discussed in terms of an equilibrated, isospin-symmetric ideal hadron gas with grand-canonical baryon-number conservation. For each collision system the baryochemical potential mu_B and the chemical freeze-out temperature T_c are deduced from the inclusive neutral pion and eta yields which are augmented by interpolated data on deuteron production. With increasing beam energy mu_B drops from 800 MeV to 650 MeV, while T_c rises from 55 MeV to 90 MeV. For given beam energy mu_B grows with system size, whereas T_c remains constant. The centrality dependence of the freeze-out parameters is weak as exemplified by the system Au+Au at 0.8A GeV. For the highest beam energies the fraction of nucleons excited to resonance states reaches freeze-out values of nearly 15 %, suggesting resonance densities close to normal nuclear density at maximum compression. In contrast to the particle yields, which convey the status at chemical freeze-out, the shapes of the related transverse-mass spectra do reflect thermal freeze-out. The observed thermal freeze-out temperatures T_th are equal to or slightly lower than T_c, indicative of nearly simultaneous chemical and thermal freeze-out.Comment: 42 pages, 12 figure

On the exact conservation laws in thermal models and the analysis of AGS and SIS experimental results

The production of hadrons in relativistic heavy ion collisions is studied using a statistical ensemble with thermal and chemical equilibrium. Special attention is given to exact conservation laws, i.e. certain charges are treated canonically instead of using the usual grand canonical approach. For small systems, the exact conservation of baryon number, strangeness and electric charge is to be taken into account. We have derived compact, analytical expressions for particle abundances in such ensemble. As an application, the change in $K/\pi$ ratios in AGS experiments with different interaction system sizes is well reproduced. The canonical treatment of three charges becomes impractical very quickly with increasing system size. Thus, we draw our attention to exact conservation of strangeness, and treat baryon number and electric charge grand canonically. We present expressions for particle abundances in such ensemble as well, and apply them to reproduce the large variety of particle ratios in GSI SIS 2 A GeV Ni-Ni experiments. At the energies considered here, the exact strangeness conservation fully accounts for strange particle suppression, and no extra chemical factor is needed.Comment: Talk given at Strangeness in Quark Matter '98, Padova, Italy (1998). Submitted to J.Phys. G. 5 pages, 2 figure