Robustness of Learning That Is Based on Covariance-Driven Synaptic Plasticity

It is widely believed that learning is due, at least in part, to long-lasting modifications of the strengths of synapses in the brain. Theoretical studies have shown that a family of synaptic plasticity rules, in which synaptic changes are driven by covariance, is particularly useful for many forms of learning, including associative memory, gradient estimation, and operant conditioning. Covariance-based plasticity is inherently sensitive. Even a slight mistuning of the parameters of a covariance-based plasticity rule is likely to result in substantial changes in synaptic efficacies. Therefore, the biological relevance of covariance-based plasticity models is questionable. Here, we study the effects of mistuning parameters of the plasticity rule in a decision making model in which synaptic plasticity is driven by the covariance of reward and neural activity. An exact covariance plasticity rule yields Herrnstein's matching law. We show that although the effect of slight mistuning of the plasticity rule on the synaptic efficacies is large, the behavioral effect is small. Thus, matching behavior is robust to mistuning of the parameters of the covariance-based plasticity rule. Furthermore, the mistuned covariance rule results in undermatching, which is consistent with experimentally observed behavior. These results substantiate the hypothesis that approximate covariance-based synaptic plasticity underlies operant conditioning. However, we show that the mistuning of the mean subtraction makes behavior sensitive to the mistuning of the properties of the decision making network. Thus, there is a tradeoff between the robustness of matching behavior to changes in the plasticity rule and its robustness to changes in the properties of the decision making network

Neutrophils in cancer: neutral no more

Neutrophils are indispensable antagonists of microbial infection and facilitators of wound healing. In the cancer setting, a newfound appreciation for neutrophils has come into view. The traditionally held belief that neutrophils are inert bystanders is being challenged by the recent literature. Emerging evidence indicates that tumours manipulate neutrophils, sometimes early in their differentiation process, to create diverse phenotypic and functional polarization states able to alter tumour behaviour. In this Review, we discuss the involvement of neutrophils in cancer initiation and progression, and their potential as clinical biomarkers and therapeutic targets

Treatment of isoniazid-resistant pulmonary tuberculosis

<p>Abstract</p> <p>Background</p> <p>Although resistance to isoniazid (INH) is the most common form of drug resistance seen among <it>Mycobacterium tuberculosis </it>isolates, there have been few studies on the efficacy and optimal duration of treatment for patients with INH-resistant tuberculosis (TB).</p> <p>Methods</p> <p>We evaluated retrospectively the treatment outcomes of 39 patients who were treated for INH-resistant pulmonary TB. The treatment regimens consisted of a 12-month regimen of rifampin (RIF) and ethambutol (EMB), with pyrazinamide (PZA) given during the first 2 months (2HREZ/10RE) (<it>n </it>= 21), a 9-month regimen of RIF and EMB with PZA during the first 2 months (2HREZ/7RE) (<it>n </it>= 5), and a 6-month regimen of RIF, EMB, and PZA (2HREZ/4REZ) (<it>n </it>= 13). After drug susceptibility testing confirmed the INH-resistance of the isolated <it>M. tuberculosis </it>strains, INH was discontinued for all the patients.</p> <p>Results</p> <p>Among the 39 patients, treatment was successfully completed by 36 patients (92%). However, treatment failure occurred, and acquired resistance to other first-line drugs, such as RIF, developed in three patients (8%). Cavitary and bilateral extensive lesions were commonly found in the chest radiographs of the patients who exhibited treatment failure.</p> <p>Conclusion</p> <p>These findings underline the seriousness of concerns regarding treatment failure and the development of multidrug-resistant TB in patients with INH-resistant TB following treatment with recommended regimens.</p

A neural integrator model for planning and value-based decision making of a robotics assistant

Modern manufacturing and assembly environments are characterized by a high variability in the built process which challenges human–robot cooperation. To reduce the cognitive workload of the operator, the robot should not only be able to learn from experience but also to plan and decide autonomously. Here, we present an approach based on Dynamic Neural Fields that apply brain-like computations to endow a robot with these cognitive functions. A neural integrator is used to model the gradual accumulation of sensory and other evidence as time-varying persistent activity of neural populations. The decision to act is modeled by a competitive dynamics between neural populations linked to different motor behaviors. They receive the persistent activation pattern of the integrators as input. In the first experiment, a robot learns rapidly by observation the sequential order of object transfers between an assistant and an operator to subsequently substitute the assistant in the joint task. The results show that the robot is able to proactively plan the series of handovers in the correct order. In the second experiment, a mobile robot searches at two different workbenches for a specific object to deliver it to an operator. The object may appear at the two locations in a certain time period with independent probabilities unknown to the robot. The trial-by-trial decision under uncertainty is biased by the accumulated evidence of past successes and choices. The choice behavior over a longer period reveals that the robot achieves a high search efficiency in stationary as well as dynamic environments.The work received financial support from FCT through the PhD fellowships PD/BD/128183/2016 and SFRH/BD/124912/2016, the project “Neurofield” (PTDC/MAT-APL/31393/2017) and the research centre CMAT within the project UID/MAT/00013/2013

An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals

Serotonin has widespread, but computationally obscure, modulatory effects on learning and cognition. Here, we studied the impact of optogenetic stimulation of dorsal raphe serotonin neurons in mice performing a non-stationary, reward-driven decision-making task. Animals showed two distinct choice strategies. Choices after short inter-trial-intervals (ITIs) depended only on the last trial outcome and followed a win-stay-lose-switch pattern. In contrast, choices after long ITIs reflected outcome history over multiple trials, as described by reinforcement learning models. We found that optogenetic stimulation during a trial significantly boosted the rate of learning that occurred due to the outcome of that trial, but these effects were only exhibited on choices after long ITIs. This suggests that serotonin neurons modulate reinforcement learning rates, and that this influence is masked by alternate, unaffected, decision mechanisms. These results provide insight into the role of serotonin in treating psychiatric disorders, particularly its modulation of neural plasticity and learning.info:eu-repo/semantics/publishedVersio

A Common Cortical Circuit Mechanism for Perceptual Categorical Discrimination and Veridical Judgment

Perception involves two types of decisions about the sensory world: identification of stimulus features as analog quantities, or discrimination of the same stimulus features among a set of discrete alternatives. Veridical judgment and categorical discrimination have traditionally been conceptualized as two distinct computational problems. Here, we found that these two types of decision making can be subserved by a shared cortical circuit mechanism. We used a continuous recurrent network model to simulate two monkey experiments in which subjects were required to make either a two-alternative forced choice or a veridical judgment about the direction of random-dot motion. The model network is endowed with a continuum of bell-shaped population activity patterns, each representing a possible motion direction. Slow recurrent excitation underlies accumulation of sensory evidence, and its interplay with strong recurrent inhibition leads to decision behaviors. The model reproduced the monkey's performance as well as single-neuron activity in the categorical discrimination task. Furthermore, we examined how direction identification is determined by a combination of sensory stimulation and microstimulation. Using a population-vector measure, we found that direction judgments instantiate winner-take-all (with the population vector coinciding with either the coherent motion direction or the electrically elicited motion direction) when two stimuli are far apart, or vector averaging (with the population vector falling between the two directions) when two stimuli are close to each other. Interestingly, for a broad range of intermediate angular distances between the two stimuli, the network displays a mixed strategy in the sense that direction estimates are stochastically produced by winner-take-all on some trials and by vector averaging on the other trials, a model prediction that is experimentally testable. This work thus lends support to a common neurodynamic framework for both veridical judgment and categorical discrimination in perceptual decision making

Computational modeling with spiking neural networks

This chapter reviews recent developments in the area of spiking neural networks (SNN) and summarizes the main contributions to this research field. We give background information about the functioning of biological neurons, discuss the most important mathematical neural models along with neural encoding techniques, learning algorithms, and applications of spiking neurons. As a specific application, the functioning of the evolving spiking neural network (eSNN) classification method is presented in detail and the principles of numerous eSNN based applications are highlighted and discussed

Neuron-glial Interactions

Although lagging behind classical computational neuroscience, theoretical and computational approaches are beginning to emerge to characterize different aspects of neuron-glial interactions. This chapter aims to provide essential knowledge on neuron-glial interactions in the mammalian brain, leveraging on computational studies that focus on structure (anatomy) and function (physiology) of such interactions in the healthy brain. Although our understanding of the need of neuron-glial interactions in the brain is still at its infancy, being mostly based on predictions that await for experimental validation, simple general modeling arguments borrowed from control theory are introduced to support the importance of including such interactions in traditional neuron-based modeling paradigms.Junior Leader Fellowship Program by “la Caixa” Banking Foundation (LCF/BQ/LI18/11630006

Neuron-Glial Interactions

Although lagging behind classical computational neuroscience, theoretical and computational approaches are beginning to emerge to characterize different aspects of neuron-glial interactions. This chapter aims to provide essential knowledge on neuron-glial interactions in the mammalian brain, leveraging on computational studies that focus on structure (anatomy) and function (physiology) of such interactions in the healthy brain. Although our understanding of the need of neuron-glial interactions in the brain is still at its infancy, being mostly based on predictions that await for experimental validation, simple general modeling arguments borrowed from control theory are introduced to support the importance of including such interactions in traditional neuron-based modeling paradigms.Comment: 43 pages, 2 figures, 1 table. Accepted for publication in the "Encyclopedia of Computational Neuroscience," D. Jaeger and R. Jung eds., Springer-Verlag New York, 2020 (2nd edition