Value and prediction error in medial frontal cortex: integrating the single-unit and systems levels of analysis

The role of the anterior cingulate cortex (ACC) in cognition has been extensively investigated with several techniques, including single-unit recordings in rodents and monkeys and EEG and fMRI in humans. This has generated a rich set of data and points of view. Important theoretical functions proposed for ACC are value estimation, error detection, error-likelihood estimation, conflict monitoring, and estimation of reward volatility. A unified view is lacking at this time, however. Here we propose that online value estimation could be the key function underlying these diverse data. This is instantiated in the reward value and prediction model (RVPM). The model contains units coding for the value of cues (stimuli or actions) and units coding for the differences between such values and the actual reward (prediction errors). We exposed the model to typical experimental paradigms from single-unit, EEG, and fMRI research to compare its overall behavior with the data from these studies. The model reproduced the ACC behavior of previous single-unit, EEG, and fMRI studies on reward processing, error processing, conflict monitoring, error-likelihood estimation, and volatility estimation, unifying the interpretations of the role performed by the ACC in some aspects of cognition

The influence of the noradrenergic system on optimal control of neural plasticity

Decision making under uncertainty is challenging for any autonomous agent. The challenge increases when the environment’s stochastic properties change over time, i.e., when the environment is volatile. In order to efficiently adapt to volatile environments, agents must primarily rely on recent outcomes to quickly change their decision strategies; in other words, they need to increase their knowledge plasticity. On the contrary, in stable environments, knowledge stability must be preferred to preserve useful information against noise. Here we propose that in mammalian brain, the locus coeruleus (LC) is one of the nuclei involved in volatility estimation and in the subsequent control of neural plasticity. During a reinforcement learning task, LC activation, measured by means of pupil diameter, coded both for environmental volatility and learning rate. We hypothesize that LC could be responsible, through norepinephrinic modulation, for adaptations to optimize decision making in volatile environments. We also suggest a computational model on the interaction between the anterior cingulate cortex (ACC) and LC for volatility estimation

Adaptive effort investment in cognitive and physical tasks: a neurocomputational model

Despite its importance in everyday life, the computational nature of effort investment remains poorly understood. We propose an effort model obtained from optimality considerations, and a neurocomputational approximation to the optimal model. Both are couched in the framework of reinforcement learning. It is shown that choosing when or when not to exert effort can be adaptively learned, depending on rewards, costs, and task difficulty. In the neurocomputational model, the limbic loop comprising anterior cingulate cortex (ACC) and ventral striatum in the basal ganglia allocates effort to cortical stimulus-action pathways whenever this is valuable. We demonstrate that the model approximates optimality. Next, we consider two hallmark effects from the cognitive control literature, namely proportion congruency and sequential congruency effects. It is shown that the model exerts both proactive and reactive cognitive control. Then, we simulate two physical effort tasks. In line with empirical work, impairing the model's dopaminergic pathway leads to apathetic behavior. Thus, we conceptually unify the exertion of cognitive and physical effort, studied across a variety of literatures (e.g., motivation and cognitive control) and animal species

Overlapping neural systems represent cognitive effort and reward anticipation

Anticipating a potential benefit and how difficult it will be to obtain it are valuable skills in a constantly changing environment. In the human brain, the anticipation of reward is encoded by the Anterior Cingulate Cortex (ACC) and Striatum. Naturally, potential rewards have an incentive quality, resulting in a motivational effect improving performance. Recently it has been proposed that an upcoming task requiring effort induces a similar anticipation mechanism as reward, relying on the same cortico-limbic network. However, this overlapping anticipatory activity for reward and effort has only been investigated in a perceptual task. Whether this generalizes to high-level cognitive tasks remains to be investigated. To this end, an fMRI experiment was designed to investigate anticipation of reward and effort in cognitive tasks. A mental arithmetic task was implemented, manipulating effort (difficulty), reward, and delay in reward delivery to control for temporal confounds. The goal was to test for the motivational effect induced by the expectation of bigger reward and higher effort. The results showed that the activation elicited by an upcoming difficult task overlapped with higher reward prospect in the ACC and in the striatum, thus highlighting a pivotal role of this circuit in sustaining motivated behavior

Procedimento e processo nel consolidato fiscale

I profili procedurali del consolidato fiscale: premesse. Il procedimento nel consolidato fiscale nazionale. Il processo nel consolidato fiscale nazionale. Il procedimento e il processo nel consolidato fiscale mondiale.I profili procedurali del consolidato fiscale: premesse. Il procedimento nel consolidato fiscale nazionale. Il processo nel consolidato fiscale nazionale. Il procedimento e il processo nel consolidato fiscale mondiale.LUISS PhD Thesi

Dorsal anterior cingulate-brainstem ensemble as a reinforcement meta-learner

Published: August 24, 2018Optimal decision-making is based on integrating information from several dimensions of decisional space (e.g., reward expectation, cost estimation, effort exertion). Despite considerable empirical and theoretical efforts, the computational and neural bases of such multidimensional integration have remained largely elusive. Here we propose that the current theoretical stalemate may be broken by considering the computational properties of a cortical-subcortical circuit involving the dorsal anterior cingulate cortex (dACC) and the brainstem neuromodulatory nuclei: ventral tegmental area (VTA) and locus coeruleus (LC). From this perspective, the dACC optimizes decisions about stimuli and actions, and using the same computational machinery, it also modulates cortical functions (meta-learning), via neuromodulatory control (VTA and LC). We implemented this theory in a novel neuro-computational model–the Reinforcement Meta Learner (RML). We outline how the RML captures critical empirical findings from an unprecedented range of theoretical domains, and parsimoniously integrates various previous proposals on dACC functioning.MS was funded from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie Grant Agreement No. 795919. EV was funded from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie Grant Agreement No. 705630. EA was supported by Research Foundation Flanders under contract number 12C4715N. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

3D transvenous radiofrequency ablation of manifest epicardial posterior-septal accessory pathways in children: Can technology innovations improve the outcome?

AbstractIntroduction:The aim of the study was to revise our more recent experience about epicardial posterior-septal accessory pathways radiofrequency transcatheter ablation in children and young patients using a transvenous approach through the coronary sinus, to understand if new mapping and ablation technologies can increase success rate and safety.Methods and results:Twenty children (mean age 13 ± 3 years) with epicardial posterior-septal accessory pathways (14 in coronary sinus and 6 in the middle cardiac vein) underwent radiofrequency transcatheter ablation with CARTO-3® system with help of the CARTO-Univu® module. Acute success rate was 73%. No patient was lost to follow-up (mean time 11.4 ± 9 months). The recurrence rate was 19%. Two patients underwent a successful redo-procedure; the overall long-term success rate was 65%. Navistar® catheter presented the highest acute success rate in the coronary sinus. Navistar SmartTouch® was the only catheter that did not present recurrences after the acute success, and it was successfully used in two patients previously unsuccessfully treated with a Navistar ThermoCool®. Acute success rate was 79% without image integration with angio-CT, while it was 63% after the introduction of CARTO-Merge®.Conclusion:Epicardial posterior-septal accessory pathways can be definitively eliminated by transvenous radiofrequency transcatheter ablation in more than half of the cases in children. Acute success rate does not seem to depend on catheters used, but contact-force catheter seems to be useful in cases with recurrences. Image integration with cardiac-CT does not increase success rate, but it is useful to detect coronary sinus alterations to better guide ablation strategy

A Survey of Telecardiology Projects in Italy.

It is estimated that in Italy there are about three million people affected by chronic heart failure. Cardiology is the health care field currently getting the largest benefits from telemedicine. Transmission, using wireless devices, makes possible to achieve virtual hospitalization: it is possible to anticipate the time of discharging and the patient can be remotely controlled by the central station in the ICU of the department of Medicine. Teleconsulting (i.e. a distance consulting between physicians) is applied in telecardiology, it allows the realization of a consulting between cardiology departments and remote services in the same hospital or among far-away hospitals. In this paper some of the most significant cardiac telemonitoring projects in Italy are described. Also reported, the projects involving the applications of implantable cardiac devices which can be controlled remotely. In conclusion, we sketch out the future prospects of telecardiology research and its applications in Italy