Reinforcement learning or active inference?

This paper questions the need for reinforcement learning or control theory when optimising behaviour. We show that it is fairly simple to teach an agent complicated and adaptive behaviours using a free-energy formulation of perception. In this formulation, agents adjust their internal states and sampling of the environment to minimize their free-energy. Such agents learn causal structure in the environment and sample it in an adaptive and self-supervised fashion. This results in behavioural policies that reproduce those optimised by reinforcement learning and dynamic programming. Critically, we do not need to invoke the notion of reward, value or utility. We illustrate these points by solving a benchmark problem in dynamic programming; namely the mountain-car problem, using active perception or inference under the free-energy principle. The ensuing proof-of-concept may be important because the free-energy formulation furnishes a unified account of both action and perception and may speak to a reappraisal of the role of dopamine in the brain

Active inference, sensory attenuation and illusions.

Active inference provides a simple and neurobiologically plausible account of how action and perception are coupled in producing (Bayes) optimal behaviour. This can be seen most easily as minimising prediction error: we can either change our predictions to explain sensory input through perception. Alternatively, we can actively change sensory input to fulfil our predictions. In active inference, this action is mediated by classical reflex arcs that minimise proprioceptive prediction error created by descending proprioceptive predictions. However, this creates a conflict between action and perception; in that, self-generated movements require predictions to override the sensory evidence that one is not actually moving. However, ignoring sensory evidence means that externally generated sensations will not be perceived. Conversely, attending to (proprioceptive and somatosensory) sensations enables the detection of externally generated events but precludes generation of actions. This conflict can be resolved by attenuating the precision of sensory evidence during movement or, equivalently, attending away from the consequences of self-made acts. We propose that this Bayes optimal withdrawal of precise sensory evidence during movement is the cause of psychophysical sensory attenuation. Furthermore, it explains the force-matching illusion and reproduces empirical results almost exactly. Finally, if attenuation is removed, the force-matching illusion disappears and false (delusional) inferences about agency emerge. This is important, given the negative correlation between sensory attenuation and delusional beliefs in normal subjects--and the reduction in the magnitude of the illusion in schizophrenia. Active inference therefore links the neuromodulatory optimisation of precision to sensory attenuation and illusory phenomena during the attribution of agency in normal subjects. It also provides a functional account of deficits in syndromes characterised by false inference and impaired movement--like schizophrenia and Parkinsonism--syndromes that implicate abnormal modulatory neurotransmission

Magnetic Resonance Imaging in Huntington's Disease.

Magnetic resonance imaging (MRI) is a noninvasive technique used routinely to image the body in both clinical and research settings. Through the manipulation of radio waves and static field gradients, MRI uses the principle of nuclear magnetic resonance to produce images with high spatial resolution, appropriate for the investigation of brain structure and function

Child mental health differences amongst ethnic groups in Britain: a systematic review

BACKGROUND: Inter-ethnic differences have been reported for many mental health outcomes in the UK, but no systematic review on child mental health has been published. The aim of this review is to compare the population-based prevalence of child mental disorders between ethnic groups in Britain, and relate these findings to ethnic differences in mental health service use. METHODS: A systematic search of bibliographic databases for population-based and clinic-based studies of children aged 0-19, including all ethnic groups and the main child mental disorders. We synthesised findings by comparing each minority group to the White British study sample. RESULTS: 31 population-based and 18 clinic-based studies met the inclusion criteria. Children in the main minority groups have similar or better mental health than White British children for common disorders, but may have higher rates for some less common conditions. The causes of these differences are unclear. There may be unmet need for services among Pakistani and Bangladeshi children. CONCLUSION: Inter-ethnic differences exist but are largely unexplained. Future studies should address the challenges of cross-cultural psychiatry and investigate reasons for inter-ethnic differences

Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990-2015: a systematic analysis for the Global Burden of Disease Study 2015

SummaryBackground The Global Burden of Diseases, Injuries, and Risk Factors Study 2015 provides an up-to-date synthesis of the evidence for risk factor exposure and the attributable burden of disease. By providing national and subnational assessments spanning the past 25 years, this study can inform debates on the importance of addressing risks in context. Methods We used the comparative risk assessment framework developed for previous iterations of the Global Burden of Disease Study to estimate attributable deaths, disability-adjusted life-years (DALYs), and trends in exposure by age group, sex, year, and geography for 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks from 1990 to 2015. This study included 388 risk-outcome pairs that met World Cancer Research Fund-defined criteria for convincing or probable evidence. We extracted relative risk and exposure estimates from randomised controlled trials, cohorts, pooled cohorts, household surveys, census data, satellite data, and other sources. We used statistical models to pool data, adjust for bias, and incorporate covariates. We developed a metric that allows comparisons of exposure across risk factors—the summary exposure value. Using the counterfactual scenario of theoretical minimum risk level, we estimated the portion of deaths and DALYs that could be attributed to a given risk. We decomposed trends in attributable burden into contributions from population growth, population age structure, risk exposure, and risk-deleted cause-specific DALY rates. We characterised risk exposure in relation to a Socio-demographic Index (SDI). Findings Between 1990 and 2015, global exposure to unsafe sanitation, household air pollution, childhood underweight, childhood stunting, and smoking each decreased by more than 25%. Global exposure for several occupational risks, high body-mass index (BMI), and drug use increased by more than 25% over the same period. All risks jointly evaluated in 2015 accounted for 57·8% (95% CI 56·6–58·8) of global deaths and 41·2% (39·8–42·8) of DALYs. In 2015, the ten largest contributors to global DALYs among Level 3 risks were high systolic blood pressure (211·8 million [192·7 million to 231·1 million] global DALYs), smoking (148·6 million [134·2 million to 163·1 million]), high fasting plasma glucose (143·1 million [125·1 million to 163·5 million]), high BMI (120·1 million [83·8 million to 158·4 million]), childhood undernutrition (113·3 million [103·9 million to 123·4 million]), ambient particulate matter (103·1 million [90·8 million to 115·1 million]), high total cholesterol (88·7 million [74·6 million to 105·7 million]), household air pollution (85·6 million [66·7 million to 106·1 million]), alcohol use (85·0 million [77·2 million to 93·0 million]), and diets high in sodium (83·0 million [49·3 million to 127·5 million]). From 1990 to 2015, attributable DALYs declined for micronutrient deficiencies, childhood undernutrition, unsafe sanitation and water, and household air pollution; reductions in risk-deleted DALY rates rather than reductions in exposure drove these declines. Rising exposure contributed to notable increases in attributable DALYs from high BMI, high fasting plasma glucose, occupational carcinogens, and drug use. Environmental risks and childhood undernutrition declined steadily with SDI; low physical activity, high BMI, and high fasting plasma glucose increased with SDI. In 119 countries, metabolic risks, such as high BMI and fasting plasma glucose, contributed the most attributable DALYs in 2015. Regionally, smoking still ranked among the leading five risk factors for attributable DALYs in 109 countries; childhood underweight and unsafe sex remained primary drivers of early death and disability in much of sub-Saharan Africa. Interpretation Declines in some key environmental risks have contributed to declines in critical infectious diseases. Some risks appear to be invariant to SDI. Increasing risks, including high BMI, high fasting plasma glucose, drug use, and some occupational exposures, contribute to rising burden from some conditions, but also provide opportunities for intervention. Some highly preventable risks, such as smoking, remain major causes of attributable DALYs, even as exposure is declining. Public policy makers need to pay attention to the risks that are increasingly major contributors to global burden. Funding Bill & Melinda Gates Foundation

Chinese characters reveal impacts of prior experience on very early stages of perception

Visual perception is strongly determined by accumulated experience with the world, which has been shown for shape, color, and position perception, in the field of visuomotor learning, and in neural computation. In addition, visual perception is tuned to statistics of natural scenes. Such prior experience is modulated by neuronal top-down control the temporal properties of which had been subject to recent studies. Here, we deal with these temporal properties and address the question how early in time accumulated past experience can modulate visual perception

Performance of the CMS Cathode Strip Chambers with Cosmic Rays

The Cathode Strip Chambers (CSCs) constitute the primary muon tracking device in the CMS endcaps. Their performance has been evaluated using data taken during a cosmic ray run in fall 2008. Measured noise levels are low, with the number of noisy channels well below 1%. Coordinate resolution was measured for all types of chambers, and fall in the range 47 microns to 243 microns. The efficiencies for local charged track triggers, for hit and for segments reconstruction were measured, and are above 99%. The timing resolution per layer is approximately 5 ns

Acromioclavicular joint dislocation: a comparative biomechanical study of the palmaris-longus tendon graft reconstruction with other augmentative methods in cadaveric models

<p>Abstract</p> <p>Background</p> <p>Acromioclavicular injuries are common in sports medicine. Surgical intervention is generally advocated for chronic instability of Rockwood grade III and more severe injuries. Various methods of coracoclavicular ligament reconstruction and augmentation have been described. The objective of this study is to compare the biomechanical properties of a novel palmaris-longus tendon reconstruction with those of the native AC+CC ligaments, the modified Weaver-Dunn reconstruction, the ACJ capsuloligamentous complex repair, screw and clavicle hook plate augmentation.</p> <p>Hypothesis</p> <p>There is no difference, biomechanically, amongst the various reconstruction and augmentative methods.</p> <p>Study Design</p> <p>Controlled laboratory cadaveric study.</p> <p>Methods</p> <p>54 cadaveric native (acromioclavicular and coracoclavicular) ligaments were tested using the Instron machine. Superior loading was performed in the 6 groups: 1) in the intact states, 2) after modified Weaver-Dunn reconstruction (WD), 3) after modified Weaver-Dunn reconstruction with acromioclavicular joint capsuloligamentous repair (WD.ACJ), 4) after modified Weaver-Dunn reconstruction with clavicular hook plate augmentation (WD.CP) or 5) after modified Weaver-Dunn reconstruction with coracoclavicular screw augmentation (WD.BS) and 6) after modified Weaver-Dunn reconstruction with mersilene tape-palmaris-longus tendon graft reconstruction (WD. PLmt). Posterior-anterior (horizontal) loading was similarly performed in all groups, except groups 4 and 5. The respective failure loads, stiffnesses, displacements at failure and modes of failure were recorded. Data analysis was carried out using a one-way ANOVA, with Student's unpaired t-test for unpaired data (S-PLUS statistical package 2005).</p> <p>Results</p> <p>Native ligaments were the strongest and stiffest when compared to other modes of reconstruction and augmentation except coracoclavicular screw, in both posterior-anterior and superior directions (p < 0.005).</p> <p>WD.ACJ provided additional posterior-anterior (P = 0. 039) but not superior (p = 0.250) stability when compared to WD alone.</p> <p>WD+PLmt, in loads and stiffness at failure superiorly, was similar to WD+CP (p = 0.066). WD+PLmt, in loads and stiffness at failure postero-anteriorly, was similar to WD+ACJ (p = 0.084).</p> <p>Superiorly, WD+CP had similar strength as WD+BS (p = 0.057), but it was less stiff (p < 0.005).</p> <p>Conclusions and Clinical Relevance</p> <p>Modified Weaver-Dunn procedure must always be supplemented with acromioclavicular capsuloligamentous repair to increase posterior-anterior stability. Palmaris-Longus tendon graft provides both additional superior and posterior-anterior stability when used for acromioclavicular capsuloligamentous reconstruction. It is a good alternative to clavicle hook plate in acromioclavicular dislocation.</p