Continuous-time spike-based reinforcement learning for working memory tasks

As the brain purportedly employs on-policy reinforcement learning compatible with SARSA learning, and most interesting cognitive tasks require some form of memory while taking place in continuous-time, recent work has developed plausible reinforcement learning schemes that are compatible with these requirements. Lacking is a formulation of both computation and learning in terms of spiking neurons. Such a formulation creates both a closer mapping to biology, and also expresses such learning in terms of asynchronous and sparse neural computation. We present a spiking neural network with memory that learns cognitive tasks in continuous time. Learning is biologically plausibly implemented using the AuGMeNT framework, and we show how separate spiking forward and feedback networks suffice for learning the tasks just as fast the analog CT-AuGMeNT counterpart, while computing efficiently using very few spikes: 1–20 Hz on average

Synchronized dynamics of cortical neurons with time-delay feedback

The dynamics of three mutually coupled cortical neurons with time delays in the coupling are explored numerically and analytically. The neurons are coupled in a line, with the middle neuron sending a somewhat stronger projection to the outer neurons than the feedback it receives, to model for instance the relay of a signal from primary to higher cortical areas. For a given coupling architecture, the delays introduce correlations in the time series at the time-scale of the delay. It was found that the middle neuron leads the outer ones by the delay time, while the outer neurons are synchronized with zero lag times. Synchronization is found to be highly dependent on the synaptic time constant, with faster synapses increasing both the degree of synchronization and the firing rate. Analysis shows that presynaptic input during the interspike interval stabilizes the synchronous state, even for arbitrarily weak coupling, and independent of the initial phase. The finding may be of significance to synchronization of large groups of cells in the cortex that are spatially distanced from each other.Comment: 21 pages, 11 figure

Incremental grouping of image elements in vision

One important task for the visual system is to group image elements that belong to an object and to segregate them from other objects and the background. We here present an incremental grouping theory (IGT) that addresses the role of object-based attention in perceptual grouping at a psychological level and, at the same time, outlines the mechanisms for grouping at the neurophysiological level. The IGT proposes that there are two processes for perceptual grouping. The first process is base grouping and relies on neurons that are tuned to feature conjunctions. Base grouping is fast and occurs in parallel across the visual scene, but not all possible feature conjunctions can be coded as base groupings. If there are no neurons tuned to the relevant feature conjunctions, a second process called incremental grouping comes into play. Incremental grouping is a time-consuming and capacity-limited process that requires the gradual spread of enhanced neuronal activity across the representation of an object in the visual cortex. The spread of enhanced neuronal activity corresponds to the labeling of image elements with object-based attention

SWS observations of IR emission features towards compact HII regions

We present ISO Short Wavelength Spectrometer (SWS) grating spectra of six compact HII regions. In addition to strong emission lines from atomic species these spectra display infrared bands attributed to Polycyclic Aromatic Hydrocarbons (PAHs). The continuous spectral coverage of the present observations and the high spectral resolution allow to describe the detailed structure of the emission bands: the 7.7μm band is composed of two bands at 7.6 and 7.8μm, the 6.2 μm band has a long wavelength extension, there is a plateau of emission between 6 and 7μm and a new feature is reported at 11.0μm in addition to the well-known 11.2μm band. These observations also reveal large variations in the relative intensities of the dust bands, in particular between the 7.7 and 8.6μm bands. In one extreme case, the 8.6μm band is stronger than the 7.7μm band. These observations are compared to a mixed population of ionized PAHs, using new laboratory measurements

Rotation Curves of Spiral Galaxies

Rotation curves of spiral galaxies are the major tool for determining the distribution of mass in spiral galaxies. They provide fundamental information for understanding the dynamics, evolution and formation of spiral galaxies. We describe various methods to derive rotation curves, and review the results obtained. We discuss the basic characteristics of observed rotation curves in relation to various galaxy properties, such as Hubble type, structure, activity, and environment.Comment: 40 pages, 6 gif figures; Ann. Rev. Astron. Astrophys. Vol. 39, p.137, 200

ISO spectroscopy of compact HII regions in the Galaxy - I. The catalogue

Infrared spectra between 2.3 and 196 mum were taken towards a sample of 45 compact H II regions using the two spectrometers (SWS and LWS) on board ISO. The primary goal is to determine the distribution of element abundances in the Galaxy, although there are also many other uses of this database. The spectra contain a wealth of information on the ionized gas and the associated photodissociation regions through the atomic fine-structure lines and on the dust properties via the dust emission bands and the continuum. Significant variations are found from source to source in both spectral shape and content. The sample of H II regions spans a wide range in galactocentric distance (from 0 to 22 kpc) enabling to investigate the variations of the nebular properties across the Galactic plane. The observations and the data reduction are described in detail in the present paper. The ISO spectral catalogue of compact H II regions contains the combined SWS-LWS spectra for each of the sources, the fluxes of the atomic fine-structure lines and hydrogen recombination lines, and an inventory of the spectra in terms of molecular lines, dust and ice bands

The Brain's Router: A Cortical Network Model of Serial Processing in the Primate Brain

The human brain efficiently solves certain operations such as object recognition and categorization through a massively parallel network of dedicated processors. However, human cognition also relies on the ability to perform an arbitrarily large set of tasks by flexibly recombining different processors into a novel chain. This flexibility comes at the cost of a severe slowing down and a seriality of operations (100–500 ms per step). A limit on parallel processing is demonstrated in experimental setups such as the psychological refractory period (PRP) and the attentional blink (AB) in which the processing of an element either significantly delays (PRP) or impedes conscious access (AB) of a second, rapidly presented element. Here we present a spiking-neuron implementation of a cognitive architecture where a large number of local parallel processors assemble together to produce goal-driven behavior. The precise mapping of incoming sensory stimuli onto motor representations relies on a “router” network capable of flexibly interconnecting processors and rapidly changing its configuration from one task to another. Simulations show that, when presented with dual-task stimuli, the network exhibits parallel processing at peripheral sensory levels, a memory buffer capable of keeping the result of sensory processing on hold, and a slow serial performance at the router stage, resulting in a performance bottleneck. The network captures the detailed dynamics of human behavior during dual-task-performance, including both mean RTs and RT distributions, and establishes concrete predictions on neuronal dynamics during dual-task experiments in humans and non-human primates

Feedback Enhances Feedforward Figure-Ground Segmentation by Changing Firing Mode

In the visual cortex, feedback projections are conjectured to be crucial in figure-ground segregation. However, the precise function of feedback herein is unclear. Here we tested a hypothetical model of reentrant feedback. We used a previous developed 2-layered feedforwardspiking network that is able to segregate figure from ground and included feedback connections. Our computer model data show that without feedback, neurons respond with regular low-frequency (∼9 Hz) bursting to a figure-ground stimulus. After including feedback the firing pattern changed into a regular (tonic) spiking pattern. In this state, we found an extra enhancement of figure responses and a further suppression of background responses resulting in a stronger figure-ground signal. Such push-pull effect was confirmed by comparing the figure-ground responses withthe responses to a homogenous texture. We propose that feedback controlsfigure-ground segregation by influencing the neural firing patterns of feedforward projecting neurons

Brains swinging in concert: cortical phase synchronization while playing guitar

<p>Abstract</p> <p>Background</p> <p>Brains interact with the world through actions that are implemented by sensory and motor processes. A substantial part of these interactions consists in synchronized goal-directed actions involving two or more individuals. Hyperscanning techniques for assessing fMRI simultaneously from two individuals have been developed. However, EEG recordings that permit the assessment of synchronized neuronal activities at much higher levels of temporal resolution have not yet been simultaneously assessed in multiple individuals and analyzed in the time-frequency domain. In this study, we simultaneously recorded EEG from the brains of each of eight pairs of guitarists playing a short melody together to explore the extent and the functional significance of synchronized cortical activity in the course of interpersonally coordinated actions.</p> <p>Results</p> <p>By applying synchronization algorithms to intra- and interbrain analyses, we found that phase synchronization both within and between brains increased significantly during the periods of (i) preparatory metronome tempo setting and (ii) coordinated play onset. Phase alignment extracted from within-brain dynamics was related to behavioral play onset asynchrony between guitarists.</p> <p>Conclusion</p> <p>Our findings show that interpersonally coordinated actions are preceded and accompanied by between-brain oscillatory couplings. Presumably, these couplings reflect similarities in the temporal properties of the individuals' percepts and actions. Whether between-brain oscillatory couplings play a causal role in initiating and maintaining interpersonal action coordination needs to be clarified by further research.</p