Delay aversion but preference for large and rare rewards in two choice tasks: implications for the measurement of self-control parameters

BACKGROUND: Impulsivity is defined as intolerance/aversion to waiting for reward. In intolerance-to-delay (ID) protocols, animals must choose between small/soon (SS) versus large/late (LL) rewards. In the probabilistic discount (PD) protocols, animals are faced with choice between small/sure (SS) versus large/luck-linked (LLL) rewards. It has been suggested that PD protocols also measure impulsivity, however, a clear dissociation has been reported between delay and probability discounting. RESULTS: Wistar adolescent rats (30- to 46-day-old) were tested using either protocol in drug-free state. In the ID protocol, animals showed a marked shift from LL to SS reward when delay increased, and this despite adverse consequences on the total amount of food obtained. In the PD protocol, animals developed a stable preference for LLL reward, and maintained it even when SS and LLL options were predicted and demonstrated to become indifferent. We demonstrate a clear dissociation between these two protocols. In the ID task, the aversion to delay was anti-economical and reflected impulsivity. In the PD task, preference for large reward was maintained despite its uncertain delivery, suggesting a strong attraction for unitary rewards of great magnitude. CONCLUSION: Uncertain delivery generated no aversion, when compared to delays producing an equivalent level of large-reward rarefaction. The PD task is suggested not to reflect impulsive behavior, and to generate patterns of choice that rather resemble the features of gambling. In summary, present data do indicate the need to interpret choice behavior in ID and PD protocols differently

Cilostazol Inhibits Accumulation of Triglyceride in Aorta and Platelet Aggregation in Cholesterol-Fed Rabbits

Cilostazol is clinically used for the treatment of ischemic symptoms in patients with chronic peripheral arterial obstruction and for the secondary prevention of brain infarction. Recently, it has been reported that cilostazol has preventive effects on atherogenesis and decreased serum triglyceride in rodent models. There are, however, few reports on the evaluation of cilostazol using atherosclerotic rabbits, which have similar lipid metabolism to humans, and are used for investigating the lipid content in aorta and platelet aggregation under conditions of hyperlipidemia. Therefore, we evaluated the effect of cilostazol on the atherosclerosis and platelet aggregation in rabbits fed a normal diet or a cholesterol-containing diet supplemented with or without cilostazol. We evaluated the effects of cilostazol on the atherogenesis by measuring serum and aortic lipid content, and the lesion area after a 10-week treatment and the effect on platelet aggregation after 1- and 10-week treatment. From the lipid analyses, cilostazol significantly reduced the total cholesterol, triglyceride and phospholipids in serum, and moreover, the triglyceride content in the atherosclerotic aorta. Cilostazol significantly reduced the intimal atherosclerotic area. Platelet aggregation was enhanced in cholesterol-fed rabbits. Cilostazol significantly inhibited the platelet aggregation in rabbits fed both a normal diet and a high cholesterol diet. Cilostazol showed anti-atherosclerotic and anti-platelet effects in cholesterol-fed rabbits possibly due to the improvement of lipid metabolism and the attenuation of platelet activation. The results suggest that cilostazol is useful for prevention and treatment of atherothrombotic diseases with the lipid abnormalities

Inhibition of platelet aggregation by carbon monoxide-releasing molecules (CO-RMs): comparison with NO donors

Carbon monoxide (CO) and CO-releasing molecules (CO-RMs) inhibit platelet aggregation in vitro. Herein, we compare the anti-platelet action of CORM-3, which releases CO rapidly (t½ 1 min), and CORM-A1, which slowly releases CO (t½ = 21 min). The anti-platelet effects of NO donors with various kinetics of NO release were studied for comparison. The effects of CO-RMs and NO donors were analyzed in washed human platelets (WP), platelets rich plasma (PRP), or whole blood (WB) using aggregometry technique. CORM-3 and CORM-A1 inhibited platelet aggregation in human PRP, WP, or WB, in a concentration-dependent manner. In all three preparations, CORM-A1 was more potent than CORM-3. Inhibition of platelets aggregation by CORM-A1 was not significantly affected by a guanylate cyclase inhibitor (ODQ) and a phosphodiesterase-5 inhibitor, sildenafil. In contrast, inhibition of platelet aggregation by NO donors was more potent with a fast NO releaser (DEA-NO, t½ = 2 min) than slow NO releasers such as PAPA-NO (t½ = 15 min) or other slow NO donors. Predictably, the anti-platelet effect of DEA-NO and other NO donors was reversed by ODQ while potentiated by sildenafil. In contrast to NO donors which inhibit platelets proportionally to the kinetics of NO released via activation of soluble guanylate cyclase (sGC), the slow CO-releaser CORM-A1 is a superior anti-platelet agent as compared to CORM-3 which releases CO instantly. The anti-platelet action of CO-RMs does not involve sGC activation. Importantly, CORM-A1 or its derivatives representing the class of slow CO releasers display promising pharmacological profile as anti-platelet agents

Temporal-Difference Reinforcement Learning with Distributed Representations

Temporal-difference (TD) algorithms have been proposed as models of reinforcement learning (RL). We examine two issues of distributed representation in these TD algorithms: distributed representations of belief and distributed discounting factors. Distributed representation of belief allows the believed state of the world to distribute across sets of equivalent states. Distributed exponential discounting factors produce hyperbolic discounting in the behavior of the agent itself. We examine these issues in the context of a TD RL model in which state-belief is distributed over a set of exponentially-discounting “micro-Agents”, each of which has a separate discounting factor (γ). Each µAgent maintains an independent hypothesis about the state of the world, and a separate value-estimate of taking actions within that hypothesized state. The overall agent thus instantiates a flexible representation of an evolving world-state. As with other TD models, the value-error (δ) signal within the model matches dopamine signals recorded from animals in standard conditioning reward-paradigms. The distributed representation of belief provides an explanation for the decrease in dopamine at the conditioned stimulus seen in overtrained animals, for the differences between trace and delay conditioning, and for transient bursts of dopamine seen at movement initiation. Because each µAgent also includes its own exponential discounting factor, the overall agent shows hyperbolic discounting, consistent with behavioral experiments

Tilt aftereffect following adaptation to translational Glass patterns

Glass patterns (GPs) consist of randomly distributed dot pairs (dipoles) whose orientations are determined by specific geometric transforms. We assessed whether adaptation to stationary oriented translational GPs suppresses the activity of orientation selective detectors producing a tilt aftereffect (TAE). The results showed that adaptation to GPs produces a TAE similar to that reported in previous studies, though reduced in amplitude. This suggests the involvement of orientation selective mechanisms. We also measured the interocular transfer (IOT) of the GP-induced TAE and found an almost complete IOT, indicating the involvement of orientation selective and binocularly driven units. In additional experiments, we assessed the role of attention in TAE from GPs. The results showed that distraction during adaptation similarly modulates the TAE after adapting to both GPs and gratings. Moreover, in the case of GPs, distraction is likely to interfere with the adaptation process rather than with the spatial summation of local dipoles. We conclude that TAE from GPs possibly relies on visual processing levels in which the global orientation of GPs has been encoded by neurons that are mostly binocularly driven, orientation selective and whose adaptation-related neural activity is strongly modulated by attention

An Animal Model of Emotional Blunting in Schizophrenia

Schizophrenia is often associated with emotional blunting—the diminished ability to respond to emotionally salient stimuli—particularly those stimuli representative of negative emotional states, such as fear. This disturbance may stem from dysfunction of the amygdala, a brain region involved in fear processing. The present article describes a novel animal model of emotional blunting in schizophrenia. This model involves interfering with normal fear processing (classical conditioning) in rats by means of acute ketamine administration. We confirm, in a series of experiments comprised of cFos staining, behavioral analysis and neurochemical determinations, that ketamine interferes with the behavioral expression of fear and with normal fear processing in the amygdala and related brain regions. We further show that the atypical antipsychotic drug clozapine, but not the typical antipsychotic haloperidol nor an experimental glutamate receptor 2/3 agonist, inhibits ketamine's effects and retains normal fear processing in the amygdala at a neurochemical level, despite the observation that fear-related behavior is still inhibited due to ketamine administration. Our results suggest that the relative resistance of emotional blunting to drug treatment may be partially due to an inability of conventional therapies to target the multiple anatomical and functional brain systems involved in emotional processing. A conceptual model reconciling our findings in terms of neurochemistry and behavior is postulated and discussed

Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits

Background Over the last several years, it has become apparent that there are critical problems with the hypothesis that brain dopamine (DA) systems, particularly in the nucleus accumbens, directly mediate the rewarding or primary motivational characteristics of natural stimuli such as food. Hypotheses related to DA function are undergoing a substantial restructuring, such that the classic emphasis on hedonia and primary reward is giving way to diverse lines of research that focus on aspects of instrumental learning, reward prediction, incentive motivation, and behavioral activation. Objective The present review discusses dopaminergic involvement in behavioral activation and, in particular, emphasizes the effort-related functions of nucleus accumbens DA and associated forebrain circuitry. Results The effects of accumbens DA depletions on food-seeking behavior are critically dependent upon the work requirements of the task. Lever pressing schedules that have minimal work requirements are largely unaffected by accumbens DA depletions, whereas reinforcement schedules that have high work (e.g., ratio) requirements are substantially impaired by accumbens DA depletions. Moreover, interference with accumbens DA transmission exerts a powerful influence over effort-related decision making. Rats with accumbens DA depletions reallocate their instrumental behavior away from food-reinforced tasks that have high response requirements, and instead, these rats select a less-effortful type of food-seeking behavior. Conclusions Along with prefrontal cortex and the amygdala, nucleus accumbens is a component of the brain circuitry regulating effort-related functions. Studies of the brain systems regulating effort-based processes may have implications for understanding drug abuse, as well as energy-related disorders such as psychomotor slowing, fatigue, or anergia in depression