Reinforcement learning in populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral responses in the face of neuronal variability. But in standard reinforcement learning a flip-side becomes apparent. Learning slows down with increasing population size since the global reinforcement becomes less and less related to the performance of any single neuron. We show that, in contrast, learning speeds up with increasing population size if feedback about the populationresponse modulates synaptic plasticity in addition to global reinforcement. The two feedback signals (reinforcement and population-response signal) can be encoded by ambient neurotransmitter concentrations which vary slowly, yielding a fully online plasticity rule where the learning of a stimulus is interleaved with the processing of the subsequent one. The assumption of a single additional feedback mechanism therefore reconciles biological plausibility with efficient learning

Neutral Pions and Eta Mesons as Probes of the Hadronic Fireball in Nucleus-Nucleus Collisions around 1A GeV

Chemical and thermal freeze-out of the hadronic fireball formed in symmetric collisions of light, intermediate-mass, and heavy nuclei at beam energies between 0.8A GeV and 2.0A GeV are discussed in terms of an equilibrated, isospin-symmetric ideal hadron gas with grand-canonical baryon-number conservation. For each collision system the baryochemical potential mu_B and the chemical freeze-out temperature T_c are deduced from the inclusive neutral pion and eta yields which are augmented by interpolated data on deuteron production. With increasing beam energy mu_B drops from 800 MeV to 650 MeV, while T_c rises from 55 MeV to 90 MeV. For given beam energy mu_B grows with system size, whereas T_c remains constant. The centrality dependence of the freeze-out parameters is weak as exemplified by the system Au+Au at 0.8A GeV. For the highest beam energies the fraction of nucleons excited to resonance states reaches freeze-out values of nearly 15 %, suggesting resonance densities close to normal nuclear density at maximum compression. In contrast to the particle yields, which convey the status at chemical freeze-out, the shapes of the related transverse-mass spectra do reflect thermal freeze-out. The observed thermal freeze-out temperatures T_th are equal to or slightly lower than T_c, indicative of nearly simultaneous chemical and thermal freeze-out.Comment: 42 pages, 12 figure

An assessment of J/Psi formation in the light of initial RHIC data

Predictions of J/Psi formation at RHIC via "off-diagonal" combinations of charm and anticharm quarks in a region of color deconfinement are confronted with initial data from the PHENIX collaboration. We find that the measured centrality behavior places significant constraints on the various parameters which control model calculations of J/Psi formation. Within present statistical and systematic uncertainties, one can map out a region of parameter space within which the contribution of formation in a deconfined phase is allowed. As these uncertainties decrease and new data from d-Au interactions becomes available, it is expected that definitive tests for the presence of this formation mechanism will be possible. We anticipate that the rapidity and transverse momentum spectra will prove decisive for a final determination.Comment: 6 pages, 5 figures, presented at SQM2003, March 12-17, 2003. To be published in J. Phys.

Impulsivity in Parkinson’s disease is associated with alterations in affective and sensorimotor striatal networks

A subset of patients with Parkinson’s disease (PD) experiences problems with impulse control, characterized by a loss of voluntary control over impulses, drives, or temptations regarding excessive hedonic behavior. The present study aimed to better understand the neural basis of such impulse control disorders (ICDs) in PD. We collected resting-state functional connectivity and structural MRI data from 21 PD patients with ICDs and 30 patients without such disorders. To assess impulsivity, all patients completed the Barratt Impulsiveness Scale and performed an information-gathering task. MRI results demonstrated substantial differences in neural characteristics between PD patients with and without ICDs. Results showed that impulsivity was linked to alterations in affective basal ganglia circuitries. Specifically, reduced frontal–striatal connectivity and GPe volume were associated with more impulsivity. We suggest that these changes affect decision making and result in a preference for risky or inappropriate actions. Results further showed that impulsivity was linked to alterations in sensorimotor striatal networks. Enhanced connectivity within this network and larger putamen volume were associated with more impulsivity. We propose that these changes affect sensorimotor processing such that patients have a greater propensity to act. Our findings suggest that the two mechanisms jointly contribute to impulsive behaviors in PD

The statistical neuroanatomy of frontal networks in the macaque

We were interested in gaining insight into the functional properties of frontal networks based upon their anatomical inputs. We took a neuroinformatics approach, carrying out maximum likelihood hierarchical cluster analysis on 25 frontal cortical areas based upon their anatomical connections, with 68 input areas representing exterosensory, chemosensory, motor, limbic, and other frontal inputs. The analysis revealed a set of statistically robust clusters. We used these clusters to divide the frontal areas into 5 groups, including ventral-lateral, ventral-medial, dorsal-medial, dorsal-lateral, and caudal-orbital groups. Each of these groups was defined by a unique set of inputs. This organization provides insight into the differential roles of each group of areas and suggests a gradient by which orbital and ventral-medial areas may be responsible for decision-making processes based on emotion and primary reinforcers, and lateral frontal areas are more involved in integrating affective and rational information into a common framework

Resonance structure in the {\gamma}{\gamma} and π0π0\pi^0\pi^0 systems in dC interactions

Along with $\pi^0$ and {\eta} mesons, a resonance structure in the invariant mass spectrum of two photons at M{\gamma}{\gamma} = 360 \pm 7 \pm 9 MeV is observed in the reaction d + C \rightarrow {\gamma} + {\gamma} + X at momentum 2.75 GeV/c per nucleon. Estimates of its width and production cross section are {\Gamma} = 64 \pm 18 MeV and $\sigma_{\gamma\gamma}$ = 98 \pm 24 {\mu}b, respectively. The collected statistics amount to 2339 \pm 340 events of 1.5 \cdot 10^6 triggered interactions of a total number ~ 10^12 of dC-interactions. The results on observation of the resonance in the invariant mass spectra of two $\pi^0$ mesons are presented: the data obtained in the d + C \rightarrow {\gamma} + {\gamma} reaction is confirmed by the d + C \rightarrow $\pi^0$ + $\pi^0$ reaction: $M_{\pi^0\pi^0}$ = 359.2 \pm 1.9 MeV, {\Gamma} = 48.9 \pm 4.9 MeV; the ratio of Br(R\rightarrow{\gamma}{\gamma}) / Br(R\rightarrow$\pi^0\pi^0$) = (1.8 {\div} 3.7)\cdot10^-3.Comment: 10 pages, 11 figure

Strangeness Production in Nuclear Matter and Expansion Dynamics

Thermodynamical properties of hot and dense nuclear matter are analyzed and compared for different equation of state (EoS). It is argued that the softest point of the equation of state and the strangeness separation on the phase boundary can manifest themselves in observables. The influence of the EoS and the order of the phase transition on the expansion dynamics of nuclear matter and strangeness excitation function is analyzed. It is shown that bulk properties of strangeness production in A-A collisions depend only weakly on the particular form of the EoS. The predictions of different models are related with experimental data on strangeness production.Comment: 38 page

Direct comparison of phase-space distributions of K- and K+ mesons in heavy-ion collisions at SIS energies - evidence for in-medium modifications of kaons ?

The ratio of K- to K+ meson yields has been measured in the systems RuRu at 1.69 A GeV, Ru+Zr at 1.69 A GeV, and Ni+Ni at 1.93 A GeV incident beam kinetic energy. The yield ratio is observed to vary across the measured phase space. Relativistic transport-model calculations indicate that the data are best understood if in-medium modifications of the kaons are taken into account.Comment: 14 pages including 3 figure

On the exact conservation laws in thermal models and the analysis of AGS and SIS experimental results

The production of hadrons in relativistic heavy ion collisions is studied using a statistical ensemble with thermal and chemical equilibrium. Special attention is given to exact conservation laws, i.e. certain charges are treated canonically instead of using the usual grand canonical approach. For small systems, the exact conservation of baryon number, strangeness and electric charge is to be taken into account. We have derived compact, analytical expressions for particle abundances in such ensemble. As an application, the change in $K/\pi$ ratios in AGS experiments with different interaction system sizes is well reproduced. The canonical treatment of three charges becomes impractical very quickly with increasing system size. Thus, we draw our attention to exact conservation of strangeness, and treat baryon number and electric charge grand canonically. We present expressions for particle abundances in such ensemble as well, and apply them to reproduce the large variety of particle ratios in GSI SIS 2 A GeV Ni-Ni experiments. At the energies considered here, the exact strangeness conservation fully accounts for strange particle suppression, and no extra chemical factor is needed.Comment: Talk given at Strangeness in Quark Matter '98, Padova, Italy (1998). Submitted to J.Phys. G. 5 pages, 2 figure