Reinforcement Learning in Non-Markovian Environments

Following the novel paradigm developed by Van Roy and coauthors for reinforcement learning in arbitrary non-Markovian environments, we propose a related formulation inspired by classical stochastic control that reduces the problem to recursive computation of approximate sufficient statistics.Comment: 15 pages, submitted to Systems and Control Letter

Fungicide resistance management in Australian grain crops

Fungicide resistance is a serious and increasing problem in cropping systems worldwide. Fungicides are an important component of integrated disease management strategies for the protection of crops from the impacts of fungal diseases. However, as their use has increased, the effectiveness of some fungicides has been reduced by the development of fungicide resistant pathogen populations. Without intervention, more fungicides are likely to become ineffective

Ethnic Variations in the Prevalence of Diabetic Retinopathy in People with Diabetes Attending Screening in the United Kingdom (DRIVE UK)

AIMS: To compare the prevalence of diabetic retinopathy (DR) in people of various ethnic groups with diabetes in the United Kingdom (UK). METHODS: The Diabetic Retinopathy In Various Ethnic groups in UK (DRIVE UK) Study is a cross-sectional study on the ethnic variations of the prevalence of DR and visual impairment in two multi-racial cohorts in the UK. People on the diabetes register in West Yorkshire and South East London who were screened, treated or monitored between April 2008 to July 2009 (London) or August 2009 (West Yorkshire) were included in the study. Data included age, sex, ethnic group, type of diabetes, presenting visual acuity and the results of grading of diabetic retinopathy. Prevalence estimates for the ethnic groups were age-standardised to the white European population for comparison purposes. RESULTS: Out of 57,144 people on the two diabetic registers, data were available on 50,285 individuals (88.0%), of these 3,323 had type 1 and 46,962 had type 2 diabetes. In type 2 diabetes, the prevalence of any DR was 38.0% (95% confidence interval (CI) 37.4% to 38.5%) in white Europeans compared to 52.4% (51.2% to 53.6%) in African/Afro-Caribbeans and 42.3% (40.3% to 44.2%) in South Asians. Similarly, sight threatening DR was also significantly more prevalent in Afro-Caribbeans (11.5%, 95% CI 10.7% to 12.3%) and South Asians (10.3%, 9.0% to 11.5%) compared to white Europeans (5.5%, 5.3% to 5.8%). Differences observed in Type 1 diabetes did not achieve conventional levels of statistical significance, but there were lower numbers for these analyses. CONCLUSIONS: Minority ethnic communities with type 2 diabetes in the UK are more prone to diabetic retinopathy, including sight-threatening retinopathy and maculopathy compared to white Europeans

Ethnic Variation in the Prevalence of Visual Impairment in People Attending Diabetic Retinopathy Screening in the United Kingdom (DRIVE UK)

PURPOSE: To provide estimates of visual impairment in people with diabetes attending screening in a multi-ethnic population in England (United Kingdom). METHODS: The Diabetic Retinopathy In Various Ethnic groups in UK (DRIVE UK) Study is a cross-sectional study on the ethnic variations of the prevalence of DR and visual impairment in two multi-racial cohorts in the UK. People on the diabetes register in West Yorkshire and South East London who were screened, treated or monitored between April 2008 to July 2009 (London) or August 2009 (West Yorkshire) were included in the study. Data on age, gender, ethnic group, visual acuity and diabetic retinopathy were collected. Ethnic group was defined according to the 2011 census classification. The two main ethnic minority groups represented here are Blacks ("Black/African/Caribbean/Black British") and South Asians ("Asians originating from the Indian subcontinent"). We examined the prevalence of visual impairment in the better eye using three cut-off points (a) loss of vision sufficient for driving (approximately <6/9) (b) visual impairment (<6/12) and (c) severe visual impairment (<6/60), standardising the prevalence of visual impairment in the minority ethnic groups to the age-structure of the white population. RESULTS: Data on visual acuity and were available on 50,331 individuals 3.4% of people diagnosed with diabetes and attending screening were visually impaired (95% confidence intervals (CI) 3.2% to 3.5%) and 0.39% severely visually impaired (0.33% to 0.44%). Blacks and South Asians had a higher prevalence of visual impairment (directly age standardised prevalence 4.6%, 95% CI 4.0% to 5.1% and 6.9%, 95% CI 5.8% to 8.0% respectively) compared to white people (3.3%, 95% CI 3.1% to 3.5%). Visual loss was also more prevalent with increasing age, type 1 diabetes and in people living in Yorkshire. CONCLUSIONS: Visual impairment remains an important public health problem in people with diabetes, and is more prevalent in the minority ethnic groups in the UK

Modulation of the silica sol-gel composition for the promotion of direct electron transfer to encapsulated cytochrome

The direct electron transfer between indium-tin oxide electrodes (ITO) and cytochrome c encapsulated in different sol-gel silica networks was studied. Cyt c@silica modified electrodes were synthesized by a two-step encapsulation method mixing a phosphate buffer solution with dissolved cytochrome c and a silica sol prepared by the alcohol-free sol-gel route. These modified electrodes were characterized by cyclic voltammetry, UV-vis spectroscopy, and in situ UV-vis spectroelectrochemistry. The electrochemical response of encapsulated protein is influenced by the terminal groups of the silica pores. Cyt c does not present electrochemical response in conventional silica (hydroxyl terminated) or phenyl terminated silica. Direct electron transfer to encapsulated cytochrome c and ITO electrodes only takes place when the protein is encapsulated in methyl modified silica networks.We gratefully acknowledge Jesus Yanez and Prof. Jose Miguel Martin-Martinez from the Laboratory of Adhesion and Adhesives (University of Alicante) for their assistance in the measurements of contact angle. We also acknowledge the Financial support from the Spanish Ministerio de Economia y Competitividad and FEDER y Ciencia (MAT2010-15273), Generalitat Valenciana (PROMETEO2013/038), and the Fundacion Ramon Areces (CIVP16A1821). Alonso Gamero-Quijano is grateful to Generalitat Valenciana (Santiago Grisolia Program) for the funding of his research fellowship.Gamero-Quijano, A.; Huerta, F.; Morallón, E.; Montilla, F. (2014). Modulation of the silica sol-gel composition for the promotion of direct electron transfer to encapsulated cytochrome. Langmuir. 30(34):10531-10538. https://doi.org/10.1021/la5023517S1053110538303

Produção de memórias falsas com listas de associados : análise do efeito do nível de processamento e da natureza da prova de memória

As memórias falsas têm sido amplamente estudadas com base num procedimento experimental designado paradigma DRM (Deese/Roediger/McDermott). Esse paradigma promove a criação de ilusões de memória a partir da apresentação de listas de palavras associadas a um item que não consta da lista. Uma das linhas de investigação com o paradigma DRM visa identificar o momento da criação das falsas memórias e explicar os mecanismos que estão na sua origem. Neste artigo, pretendemos fazer uma revisão da investigação sobre o efeito do nível de processamento e da natureza da tarefa de memória na facilitação ou inibição da produção de memórias falsas com listas de associados semânticos.False memories have been widely studied using an experimental procedure called DRM paradigm (Deese/Roediger/McDermott). This paradigm produces memory illusions due to the presentation of lists of words associated to a critical nonpresented word. One line of research on this topic aims at identifying the moment when the false memories are created and the explanation of the mechanisms underling false memories. In this paper we present a review about the effect of level-of-processing and the nature of memory task for the boost or inhibition of false memories created by means of lists of semantic associates.Le paradigme DRM (Deese/Roediger/McDermott) est un des plus connus et plus robustes parmi les études des faux mémoires dans le contexte du laboratoire. Ce paradigme permet la création d illusions de mémoire à partir des mots sémantiquement associés à un item qui n a pas été présenté. Au milieu des investigations basées sur le paradigme DRM il y a des études dont l objectif est d identifier e d´expliquer les mécanismes qui sont à l origine de la production des faux mémoires. Plus spécifiquement, on a pour but de faire une révision de la recherche sur l effet du niveau de codification et de la nature des tâches de mémoire sur la facilitation ou l´inhibition de la production de faux mémoires à partir des mots sémantiquement associés.Los falsos recuerdos han sido muy estudiados mediante la aplicación del paradigma DRM (Deese/Roediger/McDermott). El paradigma permite producir ilusiones de memoria tras la presentación de listas de palabras asociadas a una palabra que no se incluye en la lista. Una de las líneas de investigación que utilizan el paradigma DRM busca identificar el preciso momento de la creación de falsos recuerdos y explicar los mecanismos que originan ese efecto. El objetivo de este artículo es hacer una revisión de la investigación sobre el efecto de los niveles de procesamiento y la naturaleza de la tarea de memoria en la facilitación y inhibición de la producción de falsos recuerdos con listas de asociados semánticos.Fundação para a Ciência e a Tecnologia (FCT)Centro de Investigação em Psicologia da Universidade do Minho (CIPsi

Comprehensive annotation of the Parastagonospora nodorum reference genome using next-generation genomics, transcriptomics and proteogenomics

Parastagonospora nodorum, the causal agent of Septoria nodorum blotch (SNB), is an economically important pathogen of wheat (Triticum spp.), and a model for the study of necrotrophic pathology and genome evolution. The reference P. nodorum strain SN15 was the first Dothideomycete with a published genome sequence, and has been used as the basis for comparison within and between species. Here we present an updated reference genome assembly with corrections of SNP and indel errors in the underlying genome assembly from deep resequencing data as well as extensive manual annotation of gene models using transcriptomic and proteomic sources of evidence (https://github.com/robsyme/Parastagonospora_nodorum_SN15). The updated assembly and annotation includes 8,366 genes with modified protein sequence and 866 new genes. This study shows the benefits of using a wide variety of experimental methods allied to expert curation to generate a reliable set of gene models

Enhanced invitation methods to increase uptake of NHS health checks: study protocol for a randomized controlled trial

Background: NHS Health Checks is a new program for primary prevention of heart disease, stroke, diabetes, chronic kidney disease, and vascular dementia in adults aged 40 to 74 years in England. Individuals without existing cardiovascular disease or diabetes are invited for a Health Check every 5 years. Uptake among those invited is lower than anticipated. Method: The project is a three-arm randomized controlled trial to test the hypothesis that enhanced invitation methods, using the Question-Behaviour Effect (QBE), will increase uptake of NHS Health Checks compared with a standard invitation. Participants comprise individuals eligible for an NHS Health Check registered in two London boroughs. Participants are randomized into one of three arms. Group A receives the standard NHS Health Check invitation letter, information sheet, and reminder letter at 12 weeks for nonattenders. Group B receives a QBE questionnaire 1 week before receiving the standard invitation, information sheet, and reminder letter where appropriate. Group C is the same as Group B, but participants are offered a £5 retail voucher if they return the questionnaire. Participants are randomized in equal proportions, stratified by general practice. The primary outcome is uptake of NHS Health Checks 6 months after invitation from electronic health records. We will estimate the incremental health service cost per additional completed Health Check for trial groups B and C versus trial arm A, as well as evaluating the impact of the QBE questionnaire, and questionnaire plus voucher, on the socioeconomic inequality in uptake of Health Checks. The trial includes a nested comparison of two methods for implementing allocation, one implemented manually at general practices and the other implemented automatically through the information systems used to generate invitations for the Health Check. Discussion: The research will provide evidence on whether asking individuals to complete a preliminary questionnaire, by using the QBE, is effective in increasing uptake of Health Checks and whether an incentive alters questionnaire return rates as well as uptake of Health Checks. The trial interventions can be readily translated into routine service delivery if they are shown to be cost-effective

Quantifying the burden of disease due to premature mortality in Hong Kong using standard expected years of life lost

Plaß D, Chau PY, Thach T, et al. Quantifying the burden of disease due to premature mortality in Hong Kong using standard expected years of life lost. BMC Public Health. 2013;13(1): 863.Background To complement available information on mortality in a population Standard Expected Years of Life Lost (SEYLL), an indicator of premature mortality, is increasingly used to calculate the mortality-associated disease burden. SEYLL consider the age at death and therefore allow a more accurate view on mortality patterns as compared to routinely used measures (e.g. death counts). This study provides a comprehensive assessment of disease and injury SEYLL for Hong Kong in 2010. Methods To estimate the SEYLL, life-expectancy at birth was set according to the 2004 Global Burden of Disease study at 82.5 and 80 years for females and males, respectively. Cause of death data for 2010 were corrected for misclassification of cardiovascular and cancer causes. In addition to the baseline estimates, scenario analyses were performed using alternative assumptions on life-expectancy (Hong Kong standard life-expectancy), time-discounting and age-weighting. To estimate a trend of premature mortality a time-series analysis from 2001 to 2010 was conducted. Results In 2010 524,706.5 years were lost due to premature death in Hong Kong with 58.3% of the SEYLL attributable to male deaths. The three overall leading single causes of SEYLL were “trachea, bronchus and lung cancers”, “ischaemic heart disease” and “lower respiratory infections” together accounting for about 29% of the overall SEYLL. Further, self-inflicted injuries (5.6%; ranked 5) and liver cancer (4.9%; ranked 7) were identified as important causes not adequately captured by classical mortality measures. Scenario analyses highlighted that by using a 3% time-discount rate and non-uniform age-weights the SEYLL dropped by 51.6%. Using Hong Kong’s standard life-expectancy values resulted in an overall increase of SEYLL by 10.8% as compared to the baseline SEYLL. Time-series analysis indicates an overall increase of SEYLL by 6.4%. In particular, group I (communicable, maternal, perinatal and nutritional) conditions showed highest increases with SEYLL-rates per 100,000 in 2010 being 1.4 times higher than 2001. Conclusions The study stresses the mortality impact of diseases and injuries that occur in earlier stages of life and thus presents the SEYLL measure as a more sensitive indicator compared to classical mortality indicators. SEYLL provide useful additional information and supplement available death statistics

Enhanced Invitations Using the Question-Behavior Effect and Financial Incentives to Promote Health Check Uptake in Primary Care

Background: Uptake of health checks for cardiovascular risk assessment in primary care in England is lower than anticipated. The question-behavior effect (QBE) may offer a simple, scalable intervention to increase health check uptake. Purpose: The present study aimed to evaluate the effectiveness of enhanced invitation methods employing the QBE, with or without a financial incentive to return the questionnaire, at increasing uptake of health checks. Methods: We conducted a three-arm randomized trial including all patients at 18 general practices in two London boroughs, who were invited for health checks from July 2013 to December 2014. Participants were randomized to three trial arms: (i) Standard health check invitation letter only; (ii) QBE questionnaire followed by standard invitation letter; or (iii) QBE questionnaire with offer of a financial incentive to return the questionnaire, followed by standard invitation letter. In intention to treat analysis, the primary outcome of completion of health check within 6 months of invitation, was evaluated using a p value of .0167 for significance. Results: 12,459 participants were randomized. Health check uptake was evaluated for 12,052 (97%) with outcome data collected. Health check uptake within 6 months of invitation was: standard invitation, 590 / 4,095 (14.41%); QBE questionnaire, 630 / 3,988 (15.80%); QBE questionnaire and financial incentive, 629 / 3,969 (15.85%). Difference following QBE questionnaire, 1.43% (95% confidence interval −0.12 to 2.97%, p = .070); following QBE questionnaire and financial incentive, 1.52% (−0.03 to 3.07%, p = .054). Conclusions: Uptake of health checks following a standard invitation was low and not significantly increased through enhanced invitation methods using the QBE