Robustness of Learning That Is Based on Covariance-Driven Synaptic Plasticity

It is widely believed that learning is due, at least in part, to long-lasting modifications of the strengths of synapses in the brain. Theoretical studies have shown that a family of synaptic plasticity rules, in which synaptic changes are driven by covariance, is particularly useful for many forms of learning, including associative memory, gradient estimation, and operant conditioning. Covariance-based plasticity is inherently sensitive. Even a slight mistuning of the parameters of a covariance-based plasticity rule is likely to result in substantial changes in synaptic efficacies. Therefore, the biological relevance of covariance-based plasticity models is questionable. Here, we study the effects of mistuning parameters of the plasticity rule in a decision making model in which synaptic plasticity is driven by the covariance of reward and neural activity. An exact covariance plasticity rule yields Herrnstein's matching law. We show that although the effect of slight mistuning of the plasticity rule on the synaptic efficacies is large, the behavioral effect is small. Thus, matching behavior is robust to mistuning of the parameters of the covariance-based plasticity rule. Furthermore, the mistuned covariance rule results in undermatching, which is consistent with experimentally observed behavior. These results substantiate the hypothesis that approximate covariance-based synaptic plasticity underlies operant conditioning. However, we show that the mistuning of the mean subtraction makes behavior sensitive to the mistuning of the properties of the decision making network. Thus, there is a tradeoff between the robustness of matching behavior to changes in the plasticity rule and its robustness to changes in the properties of the decision making network

When Does Reward Maximization Lead to Matching Law?

What kind of strategies subjects follow in various behavioral circumstances has been a central issue in decision making. In particular, which behavioral strategy, maximizing or matching, is more fundamental to animal's decision behavior has been a matter of debate. Here, we prove that any algorithm to achieve the stationary condition for maximizing the average reward should lead to matching when it ignores the dependence of the expected outcome on subject's past choices. We may term this strategy of partial reward maximization “matching strategy”. Then, this strategy is applied to the case where the subject's decision system updates the information for making a decision. Such information includes subject's past actions or sensory stimuli, and the internal storage of this information is often called “state variables”. We demonstrate that the matching strategy provides an easy way to maximize reward when combined with the exploration of the state variables that correctly represent the crucial information for reward maximization. Our results reveal for the first time how a strategy to achieve matching behavior is beneficial to reward maximization, achieving a novel insight into the relationship between maximizing and matching

Who's been framed? Framing effects are reduced in financial gambles made for others

Background: Decisions made on behalf of other people are sometimes more rational than those made for oneself. In this study we used a monetary gambling task to ask if the framing effect in decision-making is reduced in surrogate decision-making. Methods: Participants made a series of choices between a predetermined sure option and a risky gambling option of winning a proportion of an initial stake. Trials were presented as either a gain or a loss relative to that initial stake. In half of the trials participants made choices to earn money for themselves and in the other half they earned money for another participant. Framing effects were measured as risk seeking in loss frames and risk aversion in gain frames. Results: Significant framing effects were observed both in trials in which participants earned money for themselves and those in which they earned money for another person; however, these framing effects were significantly reduced when making decisions for another person. It appears that the reduced emotional involvement when the decision-maker is not affected by the outcome of the decision thus lessens the framing effect without eradicating it altogether. Conclusions: This suggests that the deviation from rational choices in decision-making can be significantly reduced when the emotional impact on the decision maker is lessened. These results are discussed in relation to Somatic Distortion Theory

Systems Biology: A Therapeutic Target for Tumor Therapy

Tumor-related activities that seem to be operationally induced by the division of function, such as inflammation, neoangiogenesis, Warburg effect, immune response, extracellular matrix remodeling, cell proliferation rate, apoptosis, coagulation effects, present itself from a systems perspective as an enhancement of complexity. We hypothesized, that tumor systems-directed therapies might have the capability to use aggregated action effects, as adjustable sizes to therapeutically modulate the tumor systems’ stability, homeostasis, and robustness. We performed a retrospective analysis of recently published data on 224 patients with advanced and heavily pre-treated (10% to 63%) vascular sarcoma, melanoma, renal clear cell, cholangiocellular, carcinoma, hormone-refractory prostate cancer, and multivisceral Langerhans’ cell histiocytosis enrolled in nine multi-center phase II trials (11 centers). Each patient received a multi-targeted systems-directed therapy that consisted of metronomic low-dose chemotherapy, a COX-2 inhibitor, combined with one or two transcription modulators, pioglitazone +/− dexamethasone or IFN-alpha. These treatment schedules may attenuate the metastatic potential, tumor-associated inflammation, may exert site-specific activities, and induce long-term disease stabilization followed by prolonged objective response (3% to 48%) despite poor monoactivity of the respective drugs. Progression-free survival data are comparable with those of reductionist-designed standard first-line therapies. The differential response patterns indicate the therapies’ systems biological activity. Understanding systems biology as adjustable size may break through the barrier of complex tumor-stroma-interactions in a therapeutically relevant way: Comparatively high efficacy at moderate toxicity. Structured systems-directed therapies in metastatic cancer may get a source for detecting the topology of tumor-associated complex aggregated action effects as adjustable sizes available for targeted biomodulatory therapies

An effect of serotonergic stimulation on learning rates for rewards apparent after long intertrial intervals

Serotonin has widespread, but computationally obscure, modulatory effects on learning and cognition. Here, we studied the impact of optogenetic stimulation of dorsal raphe serotonin neurons in mice performing a non-stationary, reward-driven decision-making task. Animals showed two distinct choice strategies. Choices after short inter-trial-intervals (ITIs) depended only on the last trial outcome and followed a win-stay-lose-switch pattern. In contrast, choices after long ITIs reflected outcome history over multiple trials, as described by reinforcement learning models. We found that optogenetic stimulation during a trial significantly boosted the rate of learning that occurred due to the outcome of that trial, but these effects were only exhibited on choices after long ITIs. This suggests that serotonin neurons modulate reinforcement learning rates, and that this influence is masked by alternate, unaffected, decision mechanisms. These results provide insight into the role of serotonin in treating psychiatric disorders, particularly its modulation of neural plasticity and learning.info:eu-repo/semantics/publishedVersio

The Recognition of N-Glycans by the Lectin ArtinM Mediates Cell Death of a Human Myeloid Leukemia Cell Line

ArtinM, a d-mannose-binding lectin from Artocarpus heterophyllus (jackfruit), interacts with N-glycosylated receptors on the surface of several cells of hematopoietic origin, triggering cell migration, degranulation, and cytokine release. Because malignant transformation is often associated with altered expression of cell surface glycans, we evaluated the interaction of ArtinM with human myelocytic leukemia cells and investigated cellular responses to lectin binding. The intensity of ArtinM binding varied across 3 leukemia cell lines: NB4>K562>U937. The binding, which was directly related to cell growth suppression, was inhibited in the presence of Manα1-3(Manα1-6)Manβ1, and was reverted in underglycosylated NB4 cells. ArtinM interaction with NB4 cells induced cell death (IC50 = 10 µg/mL), as indicated by cell surface exposure of phosphatidylserine and disruption of mitochondrial membrane potential unassociated with caspase activation or DNA fragmentation. Moreover, ArtinM treatment of NB4 cells strongly induced reactive oxygen species generation and autophagy, as indicated by the detection of acidic vesicular organelles in the treated cells. NB4 cell death was attributed to ArtinM recognition of the trimannosyl core of N-glycans containing a ß1,6-GlcNAc branch linked to α1,6-mannose. This modification correlated with higher levels of N-acetylglucosaminyltransferase V transcripts in NB4 cells than in K562 or U937 cells. Our results provide new insights into the potential of N-glycans containing a β1,6-GlcNAc branch linked to α1,6-mannose as a novel target for anti-leukemia treatment

Emotional Engineers: Toward Morally Responsible Design

Engineers are normally seen as the archetype of people who make decisions in a rational and quantitative way. However, technological design is not value neutral. The way a technology is designed determines its possibilities, which can, for better or for worse, have consequences for human wellbeing. This leads various scholars to the claim that engineers should explicitly take into account ethical considerations. They are at the cradle of new technological developments and can thereby influence the possible risks and benefits more directly than anybody else. I have argued elsewhere that emotions are an indispensable source of ethical insight into ethical aspects of risk. In this paper I will argue that this means that engineers should also include emotional reflection into their work. This requires a new understanding of the competencies of engineers: they should not be unemotional calculators; quite the opposite, they should work to cultivate their moral emotions and sensitivity, in order to be engaged in morally responsible engineering

Engineered Toxins “Zymoxins” Are Activated by the HCV NS3 Protease by Removal of an Inhibitory Protein Domain

The synthesis of inactive enzyme precursors, also known as “zymogens,” serves as a mechanism for regulating the execution of selected catalytic activities in a desirable time and/or site. Zymogens are usually activated by proteolytic cleavage. Many viruses encode proteases that execute key proteolytic steps of the viral life cycle. Here, we describe a proof of concept for a therapeutic approach to fighting viral infections through eradication of virally infected cells exclusively, thus limiting virus production and spread. Using the hepatitis C virus (HCV) as a model, we designed two HCV NS3 protease-activated “zymogenized” chimeric toxins (which we denote “zymoxins”). In these recombinant constructs, the bacterial and plant toxins diphtheria toxin A (DTA) and Ricin A chain (RTA), respectively, were fused to rationally designed inhibitor peptides/domains via an HCV NS3 protease-cleavable linker. The above toxins were then fused to the binding and translocation domains of Pseudomonas exotoxin A in order to enable translocation into the mammalian cells cytoplasm. We show that these toxins exhibit NS3 cleavage dependent increase in enzymatic activity upon NS3 protease cleavage in vitro. Moreover, a higher level of cytotoxicity was observed when zymoxins were applied to NS3 expressing cells or to HCV infected cells, demonstrating a potential therapeutic window. The increase in toxin activity correlated with NS3 protease activity in the treated cells, thus the therapeutic window was larger in cells expressing recombinant NS3 than in HCV infected cells. This suggests that the “zymoxin” approach may be most appropriate for application to life-threatening acute infections where much higher levels of the activating protease would be expected