Retrospective model-based inference guides model-free credit assignment

An extensive reinforcement learning literature shows that organisms assign credit efficiently, even under conditions of state uncertainty. However, little is known about credit-assignment when state uncertainty is subsequently resolved. Here, we address this problem within the framework of an interaction between model-free (MF) and model-based (MB) control systems. We present and support experimentally a theory of MB retrospective-inference. Within this framework, a MB system resolves uncertainty that prevailed when actions were taken thus guiding an MF credit-assignment. Using a task in which there was initial uncertainty about the lotteries that were chosen, we found that when participants’ momentary uncertainty about which lottery had generated an outcome was resolved by provision of subsequent information, participants preferentially assigned credit within a MF system to the lottery they retrospectively inferred was responsible for this outcome. These findings extend our knowledge about the range of MB functions and the scope of system interactions

Context-dependent preferences in starlings: linking ecology, foraging and choice

Foraging animals typically encounter opportunities that they either pursue or skip, but occasionally meet several alternatives simultaneously. Behavioural ecologists predict preferences using absolute properties of each option, while decision theorists focus on relative evaluations at the time of choice. We use European starlings (Sturnus vulgaris) to integrate ecological reasoning with decision models, linking and testing hypotheses for value acquisition and choice mechanism. We hypothesise that options' values depend jointly on absolute attributes, learning context, and subject's state. In simultaneous choices, preference could result either from comparing subjective values using deliberation time, or from processing each alternative independently, without relative comparisons. The combination of the value acquisition hypothesis and independent processing at choice time has been called the Sequential Choice Model. We test this model with options equated in absolute properties to exclude the possibility of preference being built at the time of choice. Starlings learned to obtain food by responding to four stimuli in two contexts. In context [AB], they encountered options A5 or B10 in random alternation; in context [CD], they met C10 or D20. Delay to food is denoted, in seconds, by the suffixes. Observed latency to respond (Li) to each option alone (our measure of value) ranked thus: LA≈LC<LB<<LD, consistently with value being sensitive to both delay and learning context. We then introduced simultaneous presentations of A5 vs. C10 and B10 vs. C10, using latencies in no-choice tests to predict sign and strength of preference in pairings. Starlings preferred A5 over C10 and C10 over B10. There was no detectable evaluation time, and preference magnitude was predictable from latency differentials. This implies that value reflects learning rather than choice context, that preferences are not constructed by relative judgements at the time of choice, and that mechanisms adapted for sequential decisions are effective to predict choice behaviour.This work was supported by Biotechnology and Biological Sciences Research Council (BBSRC) Grant BB/G007144/1 to AK www.bbsrc.ac.uk; TM was supported by a Doctoral Grant from the Portuguese Foundation for Science and Technology (FCT) www.fct.pt/index.phtml.en. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript

Maternal and neonatal factors related to prematurity

ABSTRACT OBJECTIVE To identify maternal and neonatal factors associated with prematurity in the municipality of Porto Alegre. METHOD This was a population-based case-control study. The cases were newborns under 37 weeks of gestation and the controls were newborns over 37 weeks. The data came from the records of 19,457 births in the city of Porto Alegre in the year 2012 from the Information System on Live Births of the Municipal Health Department. The analysis was carried outand adjusted by a Logistic Regression according to a hierarchical model. The variables studied were allocated into three hierarchy levels: sociodemographic variables; reproductive history; and gestational and birth factors. RESULTS There were 767 cases allocated and 1,534 controls in a design of a case for two controls (1:2) by simple randomization. In the final model, a statistically significant association was found for prematurity for the following variables: mother's age under 19 years old (OR=1.32; CI 95%: 1.02-1.71) or over 34 years old (OR=1.39; CI 95%: 1.12-1.72); inadequate maternal schooling for age (OR=2.11; CI 95%: 1.22-3.65); multiple pregnancies (OR=1.14; CI 95%: 1.01-1.29); C-section (OR=1.15; CI 95%: 1.03-1.29); birth weights under 2,500g (OR=4.04; CI 95%: 3.64-4.49); Apgar score at five minutes between zero and three (OR=1.47; CI 95%: 1.12-1.91); and inadequate prenatal care (OR=1.18; CI 95%: 1.02-1.36). CONCLUSION The present study showed the most immediate consequence of prematurity for newborns by evidencing its association with worse Apgar scores and low birth weight. The following factors were also shown as possible more distal determinants of prematurity: mother's age; inadequate maternal education; multiple gestation; inadequate prenatal care; and C-section

Phytochemicals as antibiotic alternatives to promote growth and enhance host health

There are heightened concerns globally on emerging drug-resistant superbugs and the lack of new antibiotics for treating human and animal diseases. For the agricultural industry, there is an urgent need to develop strategies to replace antibiotics for food-producing animals, especially poultry and livestock. The 2nd International Symposium on Alternatives to Antibiotics was held at the World Organization for Animal Health in Paris, France, December 12-15, 2016 to discuss recent scientific developments on strategic antibiotic-free management plans, to evaluate regional differences in policies regarding the reduction of antibiotics in animal agriculture and to develop antibiotic alternatives to combat the global increase in antibiotic resistance. More than 270 participants from academia, government research institutions, regulatory agencies, and private animal industries from >25 different countries came together to discuss recent research and promising novel technologies that could provide alternatives to antibiotics for use in animal health and production; assess challenges associated with their commercialization; and devise actionable strategies to facilitate the development of alternatives to antibiotic growth promoters (AGPs) without hampering animal production. The 3-day meeting consisted of four scientific sessions including vaccines, microbial products, phytochemicals, immune-related products, and innovative drugs, chemicals and enzymes, followed by the last session on regulation and funding. Each session was followed by an expert panel discussion that included industry representatives and session speakers. The session on phytochemicals included talks describing recent research achievements, with examples of successful agricultural use of various phytochemicals as antibiotic alternatives and their mode of action in major agricultural animals (poultry, swine and ruminants). Scientists from industry and academia and government research institutes shared their experience in developing and applying potential antibiotic-alternative phytochemicals commercially to reduce AGPs and to develop a sustainable animal production system in the absence of antibiotics.Fil: Lillehoj, Hyun. United States Department of Agriculture. Agricultural Research Service; ArgentinaFil: Liu, Yanhong. University of California; Estados UnidosFil: Calsamiglia, Sergio. Universitat Autònoma de Barcelona; EspañaFil: Fernandez Miyakawa, Mariano Enrique. Consejo Nacional de Investigaciones Científicas y Técnicas; Argentina. Instituto Nacional de Tecnología Agropecuaria. Centro de Investigación en Ciencias Veterinarias y Agronómicas. Instituto de Patobiología; ArgentinaFil: Chi, Fang. Amlan International; Estados UnidosFil: Cravens, Ron L.. Amlan International; Estados UnidosFil: Oh, Sungtaek. United States Department of Agriculture. Agricultural Research Service; ArgentinaFil: Gay, Cyril G.. United States Department of Agriculture. Agricultural Research Service; Argentin

Clinical experience in T cell deficient patients

T cell disorders have been poorly understood until recently. Lack of knowledge of underlying molecular mechanisms together with incomplete data on long term outcome have made it difficult to assess prognosis and give the most effective treatment. Rapid progress in defining molecular defects, improved supportive care and much improved results from hematopoietic stem cell transplantation (HSCT) now mean that curative treatment is possible for many patients. However, this depends on prompt recognition, accurate diagnosis and careful treatment planning

Fishers' behaviour in response to the implementation of a marine protected area

Marine Protected Areas (MPAs) have been widely proposed as a fisheries management tool in addition to their conservation purposes. Despite this, few studies have satisfactorily assessed the dynamics of fishers' adaptations to the loss of fishing grounds. Here we used data from before, during and after the implementation of the management plan of a temperate Atlantic multiple-use MPA to examine the factors affecting the spatial and temporal distribution of different gears used by the artisanal fishing fleet. The position of vessels and gear types were obtained by visual surveys and related to spatial features of the marine park. A hotspot analysis was conducted to identify heavily utilized patches for each fishing gear and time period. The contribution of individual vessels to each significant cluster was assessed to better understand fishers' choices. Different fisheries responded differently to the implementation of protection measures, with preferred habitats of target species driving much of the fishers' choices. Within each fishery, individual fishers showed distinct strategies with some operating in a broader area whereas others kept preferred territories. Our findings are based on reliable methods that can easily be applied in coastal multipurpose MPAs to monitor and assess fisheries and fishers responses to different management rules and protection levels. This paper is the first in-depth empirical study where fishers' choices from artisanal fisheries were analysed before, during and after the implementation of a MPA, thereby allowing a clearer understanding of the dynamics of local fisheries and providing significant lessons for marine conservation and management of coastal systems

Speech Graphs Provide a Quantitative Measure of Thought Disorder in Psychosis

Background: Psychosis has various causes, including mania and schizophrenia. Since the differential diagnosis of psychosis is exclusively based on subjective assessments of oral interviews with patients, an objective quantification of the speech disturbances that characterize mania and schizophrenia is in order. In principle, such quantification could be achieved by the analysis of speech graphs. A graph represents a network with nodes connected by edges; in speech graphs, nodes correspond to words and edges correspond to semantic and grammatical relationships. Methodology/Principal Findings: To quantify speech differences related to psychosis, interviews with schizophrenics, manics and normal subjects were recorded and represented as graphs. Manics scored significantly higher than schizophrenics in ten graph measures. Psychopathological symptoms such as logorrhea, poor speech, and flight of thoughts were grasped by the analysis even when verbosity differences were discounted. Binary classifiers based on speech graph measures sorted schizophrenics from manics with up to 93.8% of sensitivity and 93.7% of specificity. In contrast, sorting based on the scores of two standard psychiatric scales (BPRS and PANSS) reached only 62.5% of sensitivity and specificity. Conclusions/Significance: The results demonstrate that alterations of the thought process manifested in the speech of psychotic patients can be objectively measured using graph-theoretical tools, developed to capture specific features of the normal and dysfunctional flow of thought, such as divergence and recurrence. The quantitative analysis of speech graphs is not redundant with standard psychometric scales but rather complementary, as it yields a very accurate sorting of schizophrenics and manics. Overall, the results point to automated psychiatric diagnosis based not on what is said, but on how it is said.FINEP [01.06.1092.00]FINEPCNPq Universal [481506/2007-1]CNPq UniversalCNPqCNPqCapesCAPESad Associacao Alberto Santos Dumont para Apoio a Pesquisa (AASDAP)a'd Associacao Alberto Santos Dumont para Apoio a Pesquisa (AASDAP

A Herbivorous Mite Down-Regulates Plant Defence and Produces Web to Exclude Competitors

Herbivores may interact with each other through resource competition, but also through their impact on plant defence. We recently found that the spider mite Tetranychus evansi down-regulates plant defences in tomato plants, resulting in higher rates of oviposition and population growth on previously attacked than on unattacked leaves. The danger of such down-regulation is that attacked plants could become a more profitable resource for heterospecific competitors, such as the two-spotted spider mite Tetranychus urticae. Indeed, T. urticae had an almost 2-fold higher rate of oviposition on leaf discs on which T. evansi had fed previously. In contrast, induction of direct plant defences by T. urticae resulted in decreased oviposition by T. evansi. Hence, both herbivores affect each other through induced plant responses. However, when populations of T. evansi and T. urticae competed on the same plants, populations of the latter invariably went extinct, whereas T. evansi was not significantly affected by the presence of its competitor. This suggests that T. evansi can somehow prevent its competitor from benefiting from the down-regulated plant defence, perhaps by covering it with a profuse web. Indeed, we found that T. urticae had difficulties reaching the leaf surface to feed when the leaf was covered with web produced by T. evansi. Furthermore, T. evansi produced more web when exposed to damage or other cues associated with T. urticae. We suggest that the silken web produced by T. evansi serves to prevent competitors from profiting from down-regulated plant defences