Policy Adjustment in a Dynamic Economic Game

Making sequential decisions to harvest rewards is a notoriously difficult problem. One difficulty is that the real world is not stationary and the reward expected from a contemplated action may depend in complex ways on the history of an animal's choices. Previous functional neuroimaging work combined with principled models has detected brain responses that correlate with computations thought to guide simple learning and action choice. Those works generally employed instrumental conditioning tasks with fixed action-reward contingencies. For real-world learning problems, the history of reward-harvesting choices can change the likelihood of rewards collected by the same choices in the near-term future. We used functional MRI to probe brain and behavioral responses in a continuous decision-making task where reward contingency is a function of both a subject's immediate choice and his choice history. In these more complex tasks, we demonstrated that a simple actor-critic model can account for both the subjects' behavioral and brain responses, and identified a reward prediction error signal in ventral striatal structures active during these non-stationary decision tasks. However, a sudden introduction of new reward structures engages more complex control circuitry in the prefrontal cortex (inferior frontal gyrus and anterior insula) and is not captured by a simple actor-critic model. Taken together, these results extend our knowledge of reward-learning signals into more complex, history-dependent choice tasks. They also highlight the important interplay between striatum and prefrontal cortex as decision-makers respond to the strategic demands imposed by non-stationary reward environments more reminiscent of real-world tasks

Suicide mortality trends by sex, age and method in Taiwan, 1971–2005

<p>Abstract</p> <p>Background</p> <p>Method-specific suicide trends varied across countries, and studies of the trends in different countries can contribute to the understanding of the epidemiology of suicide. The purpose of this study was to examine the changes in suicide trends by sex, age and method in the years 1971 to 2005 in Taiwan.</p> <p>Methods</p> <p>Mortality data files of suicide and undetermined deaths for the years 1971–2005 were obtained for analyses. Age-, sex- and method-specific suicide rates were calculated by four age groups (15–24, 25–44, 45–64 and 65 and above) and five suicide methods (solids/liquids poisoning, other gases poisoning, hanging, jumping, and others).</p> <p>Results</p> <p>Both sexes experienced downward trends from 1971 to 1993, and then an upward trend since 1993. People aged 65 years and above had the highest suicide rates throughout the study periods. However, males aged 25–64 years experienced the steepest increasing trends. As to suicide methods, an annual increase, since 1991, of people jumping from heights to commit suicide, and a marked increase, since 1998, of people completing suicide by poisoning with other gases (mainly charcoal-burning) were observed.</p> <p>Conclusion</p> <p>Suicide by means of charcoal-burning and jumping from heights has become a serious public health problem in Taiwan. Preventive measures to curb these increasing trends are urgently needed.</p

Imbalanced functional link between executive control network and reward network explain the online-game seeking behaviors in Internet gaming disorder

Literatures have shown that Internet gaming disorder (IGD) subjects show impaired executive control and enhanced reward sensitivities than healthy controls. However, how these two networks jointly affect the valuation process and drive IGD subjects' online-game-seeking behaviors remains unknown. Thirty-five IGD and 36 healthy controls underwent a resting-states scan in the MRI scanner. Functional connectivity (FC) was examined within control and reward network seeds regions, respectively. Nucleus accumbens (NAcc) was selected as the node to find the interactions between these two networks. IGD subjects show decreased FC in the executive control network and increased FC in the reward network when comparing with the healthy controls. When examining the correlations between the NAcc and the executive control/reward networks, the link between the NAcc - executive control network is negatively related with the link between NAcc - reward network. The changes (decrease/increase) in IGD subjects' brain synchrony in control/reward networks suggest the inefficient/overly processing within neural circuitry underlying these processes. The inverse proportion between control network and reward network in IGD suggest that impairments in executive control lead to inefficient inhibition of enhanced cravings to excessive online game playing. This might shed light on the mechanistic understanding of IGD

Trait determinants of impulsive behavior: a comprehensive analysis of 188 rats

Impulsivity is a naturally occurring behavior that, when accentuated, can be found in a variety of neuropsychiatric disorders. The expression of trait impulsivity has been shown to change with a variety of factors, such as age and sex, but the existing literature does not reflect widespread consensus regarding the influence of modulating effects. We designed the present study to investigate, in a cohort of significant size (188 rats), the impact of four specific parameters, namely sex, age, strain and phase of estrous cycle, using the variable delay-to-signal (VDS) task. This cohort included (i) control animals from previous experiments; (ii) animals specifically raised for this study; and (iii) animals previously used for breeding purposes. Aging was associated with a general decrease in action impulsivity and an increase in delay tolerance. Females generally performed more impulsive actions than males but no differences were observed regarding delay intolerance. In terms of estrous cycle, no differences in impulsive behavior were observed and regarding strain, Wistar Han animals were, in general, more impulsive than Sprague-Dawley. In addition to further confirming, in a substantial study cohort, the decrease in impulsivity with age, we have demonstrated that both the strain and sex influences modulate different aspects of impulsive behavior manifestations.FEDER funds, through the Competitiveness Factors Operational Programme (COMPETE) and the Northern Portugal Regional Operational Programme (NORTE 2020), under the Portugal 2020 Partnership Agreement as well as national funds, through the Foundation for Science and Technology (FCT) [projects POCI-01–0145-FEDER-007038, NORTE-01-0145-FEDER-000013, NORTE-01-0145-FEDER-000023 and PTDC/NEU-SCC/5301/2014]. Researchers were supported by FCT [grant numbers SFRH/BD/52291/2013 to ME and PD/BD/114117/2015 to MRG via Inter-University Doctoral Programme in Ageing and Chronic Disease, PhDOC; PDE/BDE/113601/2015 to PSM via PhD Program in Health Sciences (Applied) and Phd-iHES; SFRH/BD/109111/2015 to AMC; SFRH/BD/51061/2010 to MMC; SFRH/SINTD/60126/2009 to AM; SFRH/BD/98675/2013 to BC; IF/00883/2013 to AJR; IF/00111/2013 to AJS; SFRH/BPD/80118/2011 to HLA]info:eu-repo/semantics/publishedVersio

Treating attention-deficit/hyperactivity disorder beyond symptom control alone in children and adolescents: a review of the potential benefits of long-acting stimulants

Attention-deficit/hyperactivity disorder (ADHD), one of the most common neuropsychiatric conditions of childhood, often has a chronic course and persists into adulthood in many individuals. ADHD may have a clinically important impact on health-related quality of life in children, a significant impact on parents’ emotional health and interfere with family activities/cohesion. To date, the main targets of ADHD treatment have focused on reducing the severity of symptoms during the school day and improving academic performance. However, the treatment of ADHD should reach beyond symptom control to address the issues of social competencies and improvement of health-related quality of life from the perspectives of individuals with ADHD and their families, to support them in reaching their full developmental potential. Methylphenidate (MPH) is recognised as the first-line choice of pharmacotherapy for ADHD in children and adolescents. This paper focuses on the importance and benefits to child development of ADHD symptom control beyond the school day only, i.e. extending into late afternoon and evening and uses the example of an extended-release MPH formulation (OROS® MPH) to demonstrate the potential benefits of active full day coverage (12 h) with a single daily dose. Concerns of long-term stimulant treatment are also discussed

Effectiveness of individualized physiotherapy on pain and functioning compared to a standard exercise protocol in patients presenting with clinical signs of subacromial impingement syndrome. A randomized controlled trial

<p>Abstract</p> <p>Background</p> <p>Shoulder impingement syndrome is a common musculoskeletal complaint leading to significant reduction of health and disability. Physiotherapy is often the first choice of treatment although its effectiveness is still under debate. Systematic reviews in this field highlight the need for more high quality trials to investigate the effectiveness of physiotherapy interventions in patients with subacromial impingement syndrome.</p> <p>Methods/Design</p> <p>This randomized controlled trial will investigate the effectiveness of individualized physiotherapy in patients presenting with clinical signs and symptoms of subacromial impingement, involving 90 participants aged 18-75. Participants are recruited from outpatient physiotherapy clinics, general practitioners, and orthopaedic surgeons in Germany. Eligible participants will be randomly allocated to either individualized physiotherapy or to a standard exercise protocol using central randomization.</p> <p>The control group will perform the standard exercise protocol aiming to restore muscular deficits in strength, mobility, and coordination of the rotator cuff and the shoulder girdle muscles to unload the subacromial space during active movements. Participants of the intervention group will perform the standard exercise protocol as a home program, and will additionally be treated with individualized physiotherapy based on clinical examination results, and guided by a decision tree. After the intervention phase both groups will continue their home program for another 7 weeks.</p> <p>Outcome will be measured at 5 weeks and at 3 and 12 months after inclusion using the shoulder pain and disability index and patients' global impression of change, the generic patient-specific scale, the average weekly pain score, and patient satisfaction with treatment. Additionally, the fear avoidance beliefs questionnaire, the pain catastrophizing scale, and patients' expectancies of treatment effect are assessed. Participants' adherence to the protocol, use of additional treatments for the shoulder, direct and indirect costs, and sick leave due to shoulder complaints will be recorded in a shoulder log-book.</p> <p>Discussion</p> <p>To our knowledge this is the first trial comparing individualized physiotherapy based on a defined decision making process to a standardized exercise protocol. Using high-quality methodologies, this trial will add evidence to the limited body of knowledge about the effect of physiotherapy in patients with SIS.</p> <p>Trial registration</p> <p>Current Controlled Trials ISRCTN86900354</p