Pseudorehearsal in value function approximation

Catastrophic forgetting is of special importance in reinforcement learning, as the data distribution is generally non-stationary over time. We study and compare several pseudorehearsal approaches for Q-learning with function approximation in a pole balancing task. We have found that pseudorehearsal seems to assist learning even in such very simple problems, given proper initialization of the rehearsal parameters

A review of plant-flow interactions on salt marshes: the importance of vegetation structure and plant mechanical characteristics

Observations of plant-flow interactions on salt marshes have revealed a highly complex process dominated by the tightly coupled effects of plant characteristics and hydrodynamic conditions. This paper highlights the importance of vegetation structures such as plant density and height, as well as their spatial variability and mechanical properties including flexibility, upon energy dissipation and flow modification. Many field, laboratory and modelling studies which attempt to predict flow dissipation or improve our understanding of plant-flow interactions use simplified structural measures of salt marsh vegetation or artificial representations. These simplifications neglect important plant and canopy elements and are unlikely to be truly representative of their natural counterparts. Such approaches limit our understanding of plant-flow interactions and potentially compromise the predictive accuracy and application of numerical flow models. It is important therefore that improved techniques to measure vegetation structure are adopted in order to better define the key relationships between measurable plant characteristics and drag-relevant plant properties.This is the author accepted manuscript. The final version is available from Wiley via http://dx.doi.org/10.1002/wat2.110

Epithelium-off corneal cross-linking surgery compared with standard care in 10- to 16-year-olds with progressive keratoconus: the KERALINK RCT

Background: Keratoconus is a disease of the cornea affecting vision that is usually first diagnosed in the first three decades. The abnormality of corneal shape and thickness tends to progress until the patient reaches approximately 30 years of age. Epithelium-off corneal cross-linking is a procedure that has been demonstrated to be effective in randomised trials in adults and observational studies in young patients. // Objectives: The KERALINK trial examined the efficacy and safety of epithelium-off corneal cross-linking, compared with standard care by spectacle or contact lens correction, for stabilisation of progressive keratoconus. // Design: In this observer-masked, randomised, controlled, parallel-group superiority trial, 60 participants aged 10–16 years with progressive keratoconus were randomised; 58 participants completed the study. Progression was defined as a 1.5 D increase in corneal power measured by maximum or mean power (K2) in the steepest corneal meridian in the study eye, measured by corneal tomography. // Setting: Referral clinics in four UK hospitals. // Interventions: Participants were randomised to corneal cross-linking plus standard care or standard care alone, with spectacle or contact lens correction as necessary for vision, and were monitored for 18 months. // Main outcome measures: The primary outcome was K2 in the study eye as a measure of the steepness of the cornea at 18 months post randomisation. Secondary outcomes included keratoconus progression, visual acuity, keratoconus apex corneal thickness and quality of life. // Results: Of 60 participants, 30 were randomised to the corneal cross-linking and standard-care groups. Of these, 30 patients in the corneal cross-linking group and 28 patients in the standard-care group were analysed. The mean (standard deviation) K2 in the study eye at 18 months post randomisation was 49.7 D (3.8 D) in the corneal cross-linking group and 53.4 D (5.8 D) in the standard-care group. The adjusted mean difference in K2 in the study eye was –3.0 D (95% confidence interval –4.93 D to –1.08 D; p = 0.002), favouring corneal cross-linking. Uncorrected and corrected differences in logMAR vision at 18 months were better in eyes receiving corneal cross-linking: –0.31 (95% confidence interval –0.50 to –0.11; p = 0.002) and –0.30 (95% confidence interval –0.48 to –0.11; p = 0.002). Keratoconus progression in the study eye occurred in two patients (7%) randomised to corneal cross-linking compared with 12 (43%) patients randomised to standard care. The unadjusted odds ratio suggests that, on average, patients in the corneal cross-linking group had 90% (odds ratio 0.1, 95% confidence interval 0.02 to 0.48; p = 0.004) lower odds of experiencing progression than those receiving standard care. Quality-of-life outcomes were similar in both groups. No adverse events were attributable to corneal cross-linking. // Limitations: Measurements of K2 in those eyes with the most significant progression were in some cases indicated as suspect by corneal topography device software. // Conclusions: Corneal cross-linking arrests progression of keratoconus in the great majority of young patients. These data support a consideration of a change in practice, such that corneal cross-linking could be considered as first-line treatment in progressive disease. If the arrest of keratoconus progression induced by corneal cross-linking is sustained in longer follow-up, there may be particular benefit in avoiding the later requirement for contact lens wear or corneal transplantation. However, keratoconus does not continue to progress in all patients receiving standard care. For future work, the most important questions to be answered are whether or not (1) the arrest of keratoconus progression induced by corneal cross-linking is maintained in the long term and (2) the proportion of those receiving standard care who show significant progression increases with time

Effective Feedback to Improve Primary Care Prescribing Safety (EFIPPS) a pragmatic three-arm cluster randomised trial:designing the intervention (ClinicalTrials.gov registration NCT01602705)

Peer reviewedPublisher PD

Repetitive arm functional tasks after stroke (RAFTAS): a pilot randomised controlled trial

Background Repetitive functional task practise (RFTP) is a promising treatment to improve upper limb recovery following stroke. We report the findings of a study to determine the feasibility of a multi-centre randomised controlled trial to evaluate this intervention. Methods A pilot randomised controlled trial was conducted. Patients with new reduced upper limb function were recruited within 14 days of acute stroke from three stroke units in North East England. Participants were randomised to receive a four week upper limb RFTP therapy programme consisting of goal setting, independent activity practise, and twice weekly therapy reviews in addition to usual post stroke rehabilitation, or usual post stroke rehabilitation. The recruitment rate; adherence to the RFTP therapy programme; usual post stroke rehabilitation received; attrition rate; data quality; success of outcome assessor blinding; adverse events; and the views of study participants and therapists about the intervention were recorded. Results Fifty five eligible patients were identified, 4-6% of patients screened at each site. Twenty four patients participated in the pilot study. Two of the three study sites met the recruitment target of 1-2 participants per month. The median number of face to face therapy sessions received was 6 [IQR 3-8]. The median number of daily repetitions of activities recorded was 80 [IQR 39-80]. Data about usual post stroke rehabilitation were available for 18/24 (75%). Outcome data were available for 22/24 (92%) at one month and 20/24 (83%) at three months. Outcome assessors were unblinded to participant group allocation for 11/22 (50%) at one month and 6/20 (30%) at three months. Four adverse events were considered serious as they resulted in hospitalisation. None were related to study treatment. Feedback from patients and local NHS therapists about the RFTP programme was mainly positive. Conclusions A multi-centre randomised controlled trial to evaluate an upper limb RFTP therapy programme provided early after stroke is feasible and acceptable to patients and therapists, but there are issues which needed to be addressed when designing a Phase III study. A Phase III study will need to monitor and report not only recruitment and attrition but also adherence to the intervention, usual post stroke rehabilitation received, and outcome assessor blinding

Data-as-a-Service Platform for Delivering Healthy Lifestyle and Preventive Medicine: Concept and Structure of the DAPHNE Project

Background: Overweight and obesity is related to many health problems and diseases. The current obesity epidemic, which is a major health problem, is closely related to a lack of physical activity, high levels of sedentary behavior, and increased energy intake; with evidence to show increasing incidence of these issues in the younger population. Tackling obesity and its comorbid conditions requires a holistic approach encompassing attention on physical activity, healthy diet, and behavioral activation in order to enable and maintain meaningful and long-term weight loss and weight maintenance. Objective: The objective of the Data-as-a-Service Platform for Healthy Lifestyle and Preventive Medicine (DAPHNE) project is to develop a breakthrough information communications technology (ICT) platform for tracking health, weight, physical activity, diet, lifestyle, and psychological components within health care systems, whereby the platform and clinical support is linked. Methods: The DAPHNE platform aims to deliver personalized guidance services for lifestyle management to the citizen/patient by means of (1) advanced sensors and mobile phone apps to acquire and store continuous/real-time data on lifestyle aspects, behavior, and surrounding environment; (2) individual models to monitor their health and fitness status; (3) intelligent data processing for the recognition of behavioral trends; and (4) specific services for personalized guidance on healthy lifestyle and disease prevention. It is well known that weight loss and maintenance of weight loss are particularly difficult. This tool will address some of the issues found with conventional treatment/advice in that it will collect data in real time, thereby reducing reliability issues known with recalling events once they have passed and will also allow adjustment of behavior through timely support and recommendations sent through the platform without the necessity of formal one-to-one visits between patient and clinician. Patient motivation/compliance is a particular issue with conventional weight loss regimes; DAPHNE aims to increase the individuals’ awareness of their own behavior and fosters their accountability. Results: The project has been funded and the research work has started. Results for the validation of the different components is due imminently. Conclusions: In contrast with previous existing solutions, the DAPHNE project tackles the obesity problem from a clinical point of view, designing the different interfaces for its use by patients (adults and children), physicians, and caregivers. A specific design for children and adolescent patients treated for obesity has been followed, guided by pediatric physicians at hospitals in Europe. The final clinical validation of the DAPHNE platform will be carried out in different European hospitals, testing the platform in both adolescents and adults

The Effectiveness of Alcohol Screening and Brief Intervention in Emergency Departments: A Multicentre Pragmatic Cluster Randomized Controlled Trial

BACKGROUND: Alcohol misuse is common in people attending emergency departments (EDs) and there is some evidence of efficacy of alcohol screening and brief interventions (SBI). This study investigated the effectiveness of SBI approaches of different intensities delivered by ED staff in nine typical EDs in England: the SIPS ED trial. METHODS AND FINDINGS: Pragmatic multicentre cluster randomized controlled trial of SBI for hazardous and harmful drinkers presenting to ED. Nine EDs were randomized to three conditions: a patient information leaflet (PIL), 5 minutes of brief advice (BA), and referral to an alcohol health worker who provided 20 minutes of brief lifestyle counseling (BLC). The primary outcome measure was the Alcohol Use Disorders Identification Test (AUDIT) status at 6 months. Of 5899 patients aged 18 or more presenting to EDs, 3737 (63·3%) were eligible to participate and 1497 (40·1%) screened positive for hazardous or harmful drinking, of whom 1204 (80·4%) gave consent to participate in the trial. Follow up rates were 72% (n?=?863) at six, and 67% (n?=?810) at 12 months. There was no evidence of any differences between intervention conditions for AUDIT status or any other outcome measures at months 6 or 12 in an intention to treat analysis. At month 6, compared to the PIL group, the odds ratio of being AUDIT negative for brief advice was 1·103 (95% CI 0·328 to 3·715). The odds ratio comparing BLC to PIL was 1·247 (95% CI 0·315 to 4·939). A per protocol analysis confirmed these findings. CONCLUSIONS: SBI is difficult to implement in typical EDs. The results do not support widespread implementation of alcohol SBI in ED beyond screening followed by simple clinical feedback and alcohol information, which is likely to be easier and less expensive to implement than more complex interventions

Sensitivity and Specificity of Multiple Kato-Katz Thick Smears and a Circulating Cathodic Antigen Test for Schistosoma mansoni Diagnosis Pre- and Post-repeated-Praziquantel Treatment

Two Kato-Katz thick smears (Kato-Katzs) from a single stool are currently recommended for diagnosing Schistosoma mansoni infections to map areas for intervention. This ‘gold standard’ has low sensitivity at low infection intensities. The urine point-of-care circulating cathodic antigen test (POC-CCA) is potentially more sensitive but how accurately they detect S. mansoni after repeated praziquantel treatments, their suitability for measuring drug efficacy and their correlation with egg counts remain to be fully understood. We compared the accuracies of one to six Kato-Katzs and one POC-CCA for the diagnosis of S. mansoni in primary-school children who have received zero to ten praziquantel treatments. We determined the impact each diagnostic approach may have on monitoring and evaluation (M&E) and drug-efficacy findings

Surviving Sepsis Campaign: International Guidelines for Management of Sepsis and Septic Shock: 2016.

OBJECTIVE: To provide an update to "Surviving Sepsis Campaign Guidelines for Management of Sepsis and Septic Shock: 2012." DESIGN: A consensus committee of 55 international experts representing 25 international organizations was convened. Nominal groups were assembled at key international meetings (for those committee members attending the conference). A formal conflict-of-interest (COI) policy was developed at the onset of the process and enforced throughout. A stand-alone meeting was held for all panel members in December 2015. Teleconferences and electronic-based discussion among subgroups and among the entire committee served as an integral part of the development. METHODS: The panel consisted of five sections: hemodynamics, infection, adjunctive therapies, metabolic, and ventilation. Population, intervention, comparison, and outcomes (PICO) questions were reviewed and updated as needed, and evidence profiles were generated. Each subgroup generated a list of questions, searched for best available evidence, and then followed the principles of the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) system to assess the quality of evidence from high to very low, and to formulate recommendations as strong or weak, or best practice statement when applicable. RESULTS: The Surviving Sepsis Guideline panel provided 93 statements on early management and resuscitation of patients with sepsis or septic shock. Overall, 32 were strong recommendations, 39 were weak recommendations, and 18 were best-practice statements. No recommendation was provided for four questions. CONCLUSIONS: Substantial agreement exists among a large cohort of international experts regarding many strong recommendations for the best care of patients with sepsis. Although a significant number of aspects of care have relatively weak support, evidence-based recommendations regarding the acute management of sepsis and septic shock are the foundation of improved outcomes for these critically ill patients with high mortality