Reinforcement learning in populations of spiking neurons

Population coding is widely regarded as a key mechanism for achieving reliable behavioral responses in the face of neuronal variability. But in standard reinforcement learning a flip-side becomes apparent. Learning slows down with increasing population size since the global reinforcement becomes less and less related to the performance of any single neuron. We show that, in contrast, learning speeds up with increasing population size if feedback about the populationresponse modulates synaptic plasticity in addition to global reinforcement. The two feedback signals (reinforcement and population-response signal) can be encoded by ambient neurotransmitter concentrations which vary slowly, yielding a fully online plasticity rule where the learning of a stimulus is interleaved with the processing of the subsequent one. The assumption of a single additional feedback mechanism therefore reconciles biological plausibility with efficient learning

Metal-insulator transition in vanadium dioxide nanobeams: probing sub-domain properties of strongly correlated materials

Many strongly correlated electronic materials, including high-temperature superconductors, colossal magnetoresistance and metal-insulator-transition (MIT) materials, are inhomogeneous on a microscopic scale as a result of domain structure or compositional variations. An important potential advantage of nanoscale samples is that they exhibit the homogeneous properties, which can differ greatly from those of the bulk. We demonstrate this principle using vanadium dioxide, which has domain structure associated with its dramatic MIT at 68 degrees C. Our studies of single-domain vanadium dioxide nanobeams reveal new aspects of this famous MIT, including supercooling of the metallic phase by 50 degrees C; an activation energy in the insulating phase consistent with the optical gap; and a connection between the transition and the equilibrium carrier density in the insulating phase. Our devices also provide a nanomechanical method of determining the transition temperature, enable measurements on individual metal-insulator interphase walls, and allow general investigations of a phase transition in quasi-one-dimensional geometry.Comment: 9 pages, 3 figures, original submitted in June 200

Ataxia with oculomotor apraxia type 2: clinical, biological and genotype/phenotype correlation study of a cohort of 90 patients

Ataxia with oculomotor apraxia type 2 (AOA2) is an autosomal recessive disease due to mutations in the senataxin gene, causing progressive cerebellar ataxia with peripheral neuropathy, cerebellar atrophy, occasional oculomotor apraxia and elevated alpha-feto-protein (AFP) serum level. We compiled a series of 67 previously reported and 58 novel ataxic patients who underwent senataxin gene sequencing because of suspected AOA2. An AOA2 diagnosis was established for 90 patients, originating from 15 countries worldwide, and 25 new senataxin gene mutations were found. In patients with AOA2, median AFP serum level was 31.0 mu g/l at diagnosis, which was higher than the median AFP level of AOA2 negative patients: 13.8 mu g/l, P = 0.0004; itself higher than the normal level (3.4 mu g/l, range from 0.5 to 17.2 mu g/l) because elevated AFP was one of the possible selection criteria. Polyneuropathy was found in 97.5% of AOA2 patients, cerebellar atrophy in 96%, occasional oculomotor apraxia in 51%, pyramidal signs in 20.5%, head tremor in 14%, dystonia in 13.5%, strabismus in 12.3% and chorea in 9.5%. No patient was lacking both peripheral neuropathy and cerebellar atrophy. The age at onset and presence of occasional oculomotor apraxia were negatively correlated to the progression rate of the disease (P = 0.03 and P = 0.009, respectively), whereas strabismus was positively correlated to the progression rate (P = 0.03). An increased AFP level as well as cerebellar atrophy seem to be stable in the course of the disease and to occur mostly at or before the onset of the disease. One of the two patients with a normal AFP level at diagnosis had high AFP levels 4 years later, while the other had borderline levels. The probability of missing AOA2 diagnosis, in case of sequencing senataxin gene only in non-Friedreich ataxia non-ataxia-telangiectasia ataxic patients with AFP level >= 7 mu g/l, is 0.23% and the probability for a non-Friedreich ataxia non-ataxia-telangiectasia ataxic patient to be affected with AOA2 with AFP levels >= 7 mu g/l is 46%. Therefore, selection of patients with an AFP level above 7 mu g/l for senataxin gene sequencing is a good strategy for AOA2 diagnosis. Pyramidal signs and dystonia were more frequent and disease was less severe with missense mutations in the helicase domain of senataxin gene than with missense mutations out of helicase domain and deletion and nonsense mutations (P = 0.001, P = 0.008 and P = 0.01, respectively). The lack of pyramidal signs in most patients may be explained by masking due to severe motor neuropathy

The Skeletal Organic Matrix from Mediterranean Coral Balanophyllia europaea Influences Calcium Carbonate Precipitation

Scleractinian coral skeletons are made mainly of calcium carbonate in the form of aragonite. The mineral deposition occurs in a biological confined environment, but it is still a theme of discussion to what extent the calcification occurs under biological or environmental control. Hence, the shape, size and organization of skeletal crystals from the cellular level through the colony architecture, were attributed to factors as diverse as mineral supersaturation levels and organic mediation of crystal growth. The skeleton contains an intra-skeletal organic matrix (OM) of which only the water soluble component was chemically and physically characterized. In this work that OM from the skeleton of the Balanophyllia europaea, a solitary scleractinian coral endemic to the Mediterranean Sea, is studied in vitro with the aim of understanding its role in the mineralization of calcium carbonate. Mineralization of calcium carbonate was conducted by overgrowth experiments on coral skeleton and in calcium chloride solutions containing different ratios of water soluble and/or insoluble OM and of magnesium ions. The precipitates were characterized by diffractometric, spectroscopic and microscopic techniques. The results showed that both soluble and insoluble OM components influence calcium carbonate precipitation and that the effect is enhanced by their co-presence. The role of magnesium ions is also affected by the presence of the OM components. Thus, in vitro, OM influences calcium carbonate crystal morphology, aggregation and polymorphism as a function of its composition and of the content of magnesium ions in the precipitation media. This research, although does not resolve the controversy between environmental or biological control on the deposition of calcium carbonate in corals, sheds a light on the role of OM, which appears mediated by the presence of magnesium ions

Spatio-Temporal Credit Assignment in Neuronal Population Learning

In learning from trial and error, animals need to relate behavioral decisions to environmental reinforcement even though it may be difficult to assign credit to a particular decision when outcomes are uncertain or subject to delays. When considering the biophysical basis of learning, the credit-assignment problem is compounded because the behavioral decisions themselves result from the spatio-temporal aggregation of many synaptic releases. We present a model of plasticity induction for reinforcement learning in a population of leaky integrate and fire neurons which is based on a cascade of synaptic memory traces. Each synaptic cascade correlates presynaptic input first with postsynaptic events, next with the behavioral decisions and finally with external reinforcement. For operant conditioning, learning succeeds even when reinforcement is delivered with a delay so large that temporal contiguity between decision and pertinent reward is lost due to intervening decisions which are themselves subject to delayed reinforcement. This shows that the model provides a viable mechanism for temporal credit assignment. Further, learning speeds up with increasing population size, so the plasticity cascade simultaneously addresses the spatial problem of assigning credit to synapses in different population neurons. Simulations on other tasks, such as sequential decision making, serve to contrast the performance of the proposed scheme to that of temporal difference-based learning. We argue that, due to their comparative robustness, synaptic plasticity cascades are attractive basic models of reinforcement learning in the brain

Rubber Hands Feel Touch, but Not in Blind Individuals

Psychology and neuroscience have a long-standing tradition of studying blind individuals to investigate how visual experience shapes perception of the external world. Here, we study how blind people experience their own body by exposing them to a multisensory body illusion: the somatic rubber hand illusion. In this illusion, healthy blindfolded participants experience that they are touching their own right hand with their left index finger, when in fact they are touching a rubber hand with their left index finger while the experimenter touches their right hand in a synchronized manner (Ehrsson et al. 2005). We compared the strength of this illusion in a group of blind individuals (n = 10), all of whom had experienced severe visual impairment or complete blindness from birth, and a group of age-matched blindfolded sighted participants (n = 12). The illusion was quantified subjectively using questionnaires and behaviorally by asking participants to point to the felt location of the right hand. The results showed that the sighted participants experienced a strong illusion, whereas the blind participants experienced no illusion at all, a difference that was evident in both tests employed. A further experiment testing the participants' basic ability to localize the right hand in space without vision (proprioception) revealed no difference between the two groups. Taken together, these results suggest that blind individuals with impaired visual development have a more veridical percept of self-touch and a less flexible and dynamic representation of their own body in space compared to sighted individuals. We speculate that the multisensory brain systems that re-map somatosensory signals onto external reference frames are less developed in blind individuals and therefore do not allow efficient fusion of tactile and proprioceptive signals from the two upper limbs into a single illusory experience of self-touch as in sighted individuals

Modelling Visual Neglect: Computational Insights into Conscious Perception

Background: Visual neglect is an attentional deficit typically resulting from parietal cortex lesion and sometimes frontal lesion. Patients fail to attend to objects and events in the visual hemifield contralateral to their lesion during visual search. Methodology/Principal Finding: The aim of this work was to examine the effects of parietal and frontal lesion in an existing computational model of visual attention and search and simulate visual search behaviour under lesion conditions. We find that unilateral parietal lesion in this model leads to symptoms of visual neglect in simulated search scan paths, including an inhibition of return (IOR) deficit, while frontal lesion leads to milder neglect and to more severe deficits in IOR and perseveration in the scan path. During simulations of search under unilateral parietal lesion, the model’s extrastriate ventral stream area exhibits lower activity for stimuli in the neglected hemifield compared to that for stimuli in the normally perceived hemifield. This could represent a computational correlate of differences observed in neuroimaging for unconscious versus conscious perception following parietal lesion. Conclusions/Significance: Our results lead to the prediction, supported by effective connectivity evidence, that connections between the dorsal and ventral visual streams may be an important factor in the explanation of perceptua

Investigating the Causal Relationship of C-Reactive Protein with 32 Complex Somatic and Psychiatric Outcomes: A Large-Scale Cross-Consortium Mendelian Randomization Study

BACKGROUND: C-reactive protein (CRP) is associated with immune, cardiometabolic, and psychiatric traits and diseases. Yet it is inconclusive whether these associations are causal. METHODS AND FINDINGS: We performed Mendelian randomization (MR) analyses using two genetic risk scores (GRSs) as instrumental variables (IVs). The first GRS consisted of four single nucleotide polymorphisms (SNPs) in the CRP gene (GRSCRP), and the second consisted of 18 SNPs that were significantly associated with CRP levels in the largest genome-wide association study (GWAS) to date (GRSGWAS). To optimize power, we used summary statistics from GWAS consortia and tested the association of these two GRSs with 32 complex somatic and psychiatric outcomes, with up to 123,865 participants per outcome from populations of European ancestry. We performed heterogeneity tests to disentangle the pleiotropic effect of IVs. A Bonferroni-corrected significance level of less than 0.0016 was considered statistically significant. An observed p-value equal to or less than 0.05 was considered nominally significant evidence for a potential causal association, yet to be confirmed. The strengths (F-statistics) of the IVs were 31.92-3,761.29 and 82.32-9,403.21 for GRSCRP and GRSGWAS, respectively. CRP GRSGWAS showed a statistically significant protective relationship of a 10% genetically elevated CRP level with the risk of schizophrenia (odds ratio [OR] 0.86 [95% CI 0.79-0.94]; p < 0.001). We validated this finding with individual-level genotype data from the schizophrenia GWAS (OR 0.96 [95% CI 0.94-0.98]; p < 1.72 × 10-6). Further, we found that a standardized CRP polygenic risk score (CRPPRS) at p-value thresholds of 1 × 10-4, 0.001, 0.01, 0.05, and 0.1 using individual-level data also showed a protective effect (OR < 1.00) against schizophrenia; the first CRPPRS (built of SNPs with p < 1 × 10-4) showed a statistically significant (p < 2.45 × 10-4) protective effect with an OR of 0.97 (95% CI 0.95-0.99). The CRP GRSGWAS showed that a 10% increase in genetically determined CRP level was significantly associated with coronary artery disease (OR 0.88 [95% CI 0.84-0.94]; p < 2.4 × 10-5) and was nominally associated with the risk of inflammatory bowel disease (OR 0.85 [95% CI 0.74-0.98]; p < 0.03), Crohn disease (OR 0.81 [95% CI 0.70-0.94]; p < 0.005), psoriatic arthritis (OR 1.36 [95% CI 1.00-1.84]; p < 0.049), knee osteoarthritis (OR 1.17 [95% CI 1.01-1.36]; p < 0.04), and bipolar disorder (OR 1.21 [95% CI 1.05-1.40]; p < 0.007) and with an increase of 0.72 (95% CI 0.11-1.34; p < 0.02) mm Hg in systolic blood pressure, 0.45 (95% CI 0.06-0.84; p < 0.02) mm Hg in diastolic blood pressure, 0.01 ml/min/1.73 m2 (95% CI 0.003-0.02; p < 0.005) in estimated glomerular filtration rate from serum creatinine, 0.01 g/dl (95% CI 0.0004-0.02; p < 0.04) in serum albumin level, and 0.03 g/dl (95% CI 0.008-0.05; p < 0.009) in serum protein level. However, after adjustment for heterogeneity, neither GRS showed a significant effect of CRP level (at p < 0.0016) on any of these outcomes, including coronary artery disease, nor on the other 20 complex outcomes studied. Our study has two potential limitations: the limited variance explained by our genetic instruments modeling CRP levels in blood and the unobserved bias introduced by the use of summary statistics in our MR analyses. CONCLUSIONS: Genetically elevated CRP levels showed a significant potentially protective causal relationship with risk of schizophrenia. We observed nominal evidence at an observed p < 0.05 using either GRSCRP or GRSGWAS-with persistence after correction for heterogeneity-for a causal relationship of elevated CRP levels with psoriatic osteoarthritis, rheumatoid arthritis, knee osteoarthritis, systolic blood pressure, diastolic blood pressure, serum albumin, and bipolar disorder. These associations remain yet to be confirmed. We cannot verify any causal effect of CRP level on any of the other common somatic and neuropsychiatric outcomes investigated in the present study. This implies that interventions that lower CRP level are unlikely to result in decreased risk for the majority of common complex outcomes