The Validation and Assessment of Machine Learning: A Game of Prediction from High-Dimensional Data

In applied statistics, tools from machine learning are popular for analyzing complex and high-dimensional data. However, few theoretical results are available that could guide to the appropriate machine learning tool in a new application. Initial development of an overall strategy thus often implies that multiple methods are tested and compared on the same set of data. This is particularly difficult in situations that are prone to over-fitting where the number of subjects is low compared to the number of potential predictors. The article presents a game which provides some grounds for conducting a fair model comparison. Each player selects a modeling strategy for predicting individual response from potential predictors. A strictly proper scoring rule, bootstrap cross-validation, and a set of rules are used to make the results obtained with different strategies comparable. To illustrate the ideas, the game is applied to data from the Nugenob Study where the aim is to predict the fat oxidation capacity based on conventional factors and high-dimensional metabolomics data. Three players have chosen to use support vector machines, LASSO, and random forests, respectively

Adaptation to Different Human Populations by HIV-1 Revealed by Codon-Based Analyses

Several codon-based methods are available for detecting adaptive evolution in protein-coding sequences, but to date none specifically identify sites that are selected differentially in two populations, although such comparisons between populations have been historically useful in identifying the action of natural selection. We have developed two fixed effects maximum likelihood methods: one for identifying codon positions showing selection patterns that persist in a population and another for detecting whether selection is operating differentially on individual codons of a gene sampled from two different populations. Applying these methods to two HIV populations infecting genetically distinct human hosts, we have found that few of the positively selected amino acid sites persist in the population; the other changes are detected only at the tips of the phylogenetic tree and appear deleterious in the long term. Additionally, we have identified seven amino acid sites in protease and reverse transcriptase that are selected differentially in the two samples, demonstrating specific population-level adaptation of HIV to human populations

Lactobacilli and bifidobacteria in the prevention of antibiotic-associated diarrhoea and Clostridium difficile diarrhoea in older inpatients (PLACIDE): a randomised, double-blind, placebo-controlled, multicentre trial

BACKGROUND: Antibiotic-associated diarrhoea (AAD) occurs most frequently in older (≥65 years) inpatients exposed to broad-spectrum antibiotics. When caused by Clostridium difficile, AAD can result in life-threatening illness. Although underlying disease mechanisms are not well understood, microbial preparations have been assessed in the prevention of AAD. However, studies have been mostly small single-centre trials with varying quality, providing insufficient data to reliably assess effectiveness. We aimed to do a pragmatic efficacy trial in older inpatients who would be representative of those admitted to National Health Service (NHS) and similar secondary care institutions and to recruit a sufficient number of patients to generate a definitive result. METHODS: We did a multicentre, randomised, double-blind, placebo-controlled, pragmatic, efficacy trial of inpatients aged 65 years and older and exposed to one or more oral or parenteral antibiotics. A computer-generated randomisation scheme was used to allocate participants (in a 1:1 ratio) to receive either a multistrain preparation of lactobacilli and bifidobacteria, with a total of 6 × 10(10) organisms, one per day for 21 days, or an identical placebo. Patients, study staff, and specimen and data analysts were masked to assignment. The primary outcomes were occurrence of AAD within 8 weeks and C difficile diarrhoea (CDD) within 12 weeks of recruitment. Analysis was by modified intention-to-treat. This trial is registered, number ISRCTN70017204. FINDINGS: Of 17,420 patients screened, 1493 were randomly assigned to the microbial preparation group and 1488 to the placebo group. 1470 and 1471, respectively, were included in the analyses of the primary endpoints. AAD (including CDD) occurred in 159 (10·8%) participants in the microbial preparation group and 153 (10·4%) participants in the placebo group (relative risk [RR] 1·04; 95% CI 0·84-1·28; p=0·71). CDD was an uncommon cause of AAD and occurred in 12 (0·8%) participants in the microbial preparation group and 17 (1·2%) participants in the placebo group (RR 0·71; 95% CI 0·34-1·47; p=0·35). 578 (19·7%) participants had one or more serious adverse event; the frequency of serious adverse events was much the same in the two study groups and none was attributed to participation in the trial. INTERPRETATION: We identified no evidence that a multistrain preparation of lactobacilli and bifidobacteria was effective in prevention of AAD or CDD. An improved understanding of the pathophysiology of AAD is needed to guide future studies. FUNDING: Health Technology Assessment programme; National Institute for Health Research, UK

Parental factors associated with walking to school and participation in organised activities at age 5: Analysis of the Millennium Cohort Study

BACKGROUND: Physical activity is associated with better health. Two sources of activity for children are walking to school and taking part in organised sports and activities. This study uses a large national cohort to examine factors associated with participation in these activities. METHODS: The Millennium Cohort study contains 5 year follow-up of 17,561 singleton children recruited between 2000-2002 in the UK. All participants were interviewed in their own homes at 9 months, 3 years and 5 years follow-up and all measures were self reports. Logistic regression and likelihood ratio tests were used. RESULTS: Children are less likely to walk to school as income and parental education increase [Adjusted odds: 0.7 (95%CI: 0.6-0.8) for higher income/education compared to low income/no qualifications]. However, if the parent plays with the child in high income families the child is more likely to walk to school [Adjusted odds: 1.67 (95%CI: 1.3-2.1)]. Children taking part in organised activities are from higher income, higher education families, with a car, in a "good" area with non-working mothers. However, in low socio-economic families where the parent plays with the child the child is more likely to take part in organised activities [Adjusted odds: 2.0 (95% CI: 1.5-2.7)]. CONCLUSIONS: Income is an important determinant of the type of activity available to children. Families that report good health behaviours (non-smoking, low TV viewing) and play with their children show higher levels of physical activity. Thus, parenting practice appears to have a strong impact on their child's physical activity

COVID-19 mitigation measures in primary schools and association with infection and school staff wellbeing: An observational survey linked with routine data in Wales, UK

IntroductionSchool-based COVID-19 mitigation strategies have greatly impacted the primary school day (children aged 3–11) including: wearing face coverings, two metre distancing, no mixing of children, and no breakfast clubs or extra-curricular activities. This study examines these mitigation measures and association with COVID-19 infection, respiratory infection, and school staff wellbeing between October to December 2020 in Wales, UK.MethodsA school staff survey captured self-reported COVID-19 mitigation measures in the school, participant anxiety and depression, and open-text responses regarding experiences of teaching and implementing measures. These survey responses were linked to national-scale COVID-19 test results data to examine association of measures in the school and the likelihood of a positive (staff or pupil) COVID-19 case in the school (clustered by school, adjusted for school size and free school meals using logistic regression). Linkage was conducted through the SAIL (Secure Anonymised Information Linkage) Databank.ResultsResponses were obtained from 353 participants from 59 primary schools within 15 of 22 local authorities. Having more direct non-household contacts was associated with a higher likelihood of COVID-19 positive case in the school (1–5 contacts compared to none, OR 2.89 (1.01, 8.31)) and a trend to more self-reported cold symptoms. Staff face covering was not associated with a lower odds of school COVID-19 cases (mask vs. no covering OR 2.82 (1.11, 7.14)) and was associated with higher self-reported cold symptoms. School staff reported the impacts of wearing face coverings on teaching, including having to stand closer to pupils and raise their voices to be heard. 67.1% were not able to implement two metre social distancing from pupils. We did not find evidence that maintaining a two metre distance was associated with lower rates of COVID-19 in the school.ConclusionsImplementing, adhering to and evaluating COVID-19 mitigation guidelines is challenging in primary school settings. Our findings suggest that reducing non-household direct contacts lowers infection rates. There was no evidence that face coverings, two metre social distancing or stopping children mixing was associated with lower odds of COVID-19 or cold infection rates in the school. Primary school staff found teaching challenging during COVID-19 restrictions, especially for younger learners and those with additional learning needs

Quantifying the Risk of Localised Animal Movement Bans for Foot-and-Mouth Disease

The maintenance of disease-free status from Foot-and-Mouth Disease is of significant socio-economic importance to countries such as the UK. The imposition of bans on the movement of susceptible livestock following the discovery of an outbreak is deemed necessary to prevent the spread of what is a highly contagious disease, but has a significant economic impact on the agricultural community in itself. Here we consider the risk of applying movement restrictions only in localised zones around outbreaks in order to help evaluate how quickly nation-wide restrictions could be lifted after notification. We show, with reference to the 2001 and 2007 UK outbreaks, that it would be practical to implement such a policy provided the basic reproduction ratio of known infected premises can be estimated. It is ultimately up to policy makers and stakeholders to determine the acceptable level of risk, involving a cost benefit analysis of the potential outcomes, but quantifying the risk of spread from different sized zones is a prerequisite for this. The approach outlined is relevant to the determination of control zones and vaccination policies and has the potential to be applied to future outbreaks of other diseases

Population based absolute and relative survival to 1 year of people with diabetes following a myocardial infarction: A cohort study using hospital admissions data

<p>Abstract</p> <p>Background</p> <p>People with diabetes who experience an acute myocardial infarction (AMI) have a higher risk of death and recurrence of AMI. This study was commissioned by the Department for Transport to develop survival tables for people with diabetes following an AMI in order to inform vehicle licensing.</p> <p>Methods</p> <p>A cohort study using data obtained from national hospital admission datasets for England and Wales was carried out selecting all patients attending hospital with an MI for 2003-2006 (inclusion criteria: aged 30+ years, hospital admission for MI (defined using ICD 10 code I21-I22). STATA was used to create survival tables and factors associated with survival were examined using Cox regression.</p> <p>Results</p> <p>Of 157,142 people with an MI in England and Wales between 2003-2006, the relative risk of death or recurrence of MI for those with diabetes (n = 30,407) in the first 90 days was 1.3 (95%CI: 1.26-1.33) crude rates and 1.16 (95%CI: 1.1-1.2) when controlling for age, gender, heart failure and surgery for MI) compared with those without diabetes (n = 129,960). At 91-365 days post AMI the risk was 1.7 (95% CI 1.6-1.8) crude and 1.50 (95%CI: 1.4-1.6) adjusted. The relative risk of death or re-infarction was higher at younger ages for those with diabetes and directly after the AMI (Relative risk; RR: 62.1 for those with diabetes and 28.2 for those without diabetes aged 40-49 [compared with population risk]).</p> <p>Conclusions</p> <p>This is the first study to provide population based tables of age stratified risk of re-infarction or death for people with diabetes compared with those without diabetes. These tables can be used for giving advice to patients, developing a baseline to compare intervention studies or developing license or health insurance guidelines.</p

Acute Human Self-Poisoning with Imidacloprid Compound: A Neonicotinoid Insecticide

Background: Deliberate self-poisoning with older pesticides such as organophosphorus compounds are commonly fatal and a serious public health problem in the developing world. The clinical consequences of self-poisoning with newer pesticides are not well described. Such information may help to improve clinical management and inform pesticide regulators of their relative toxicity. This study reports the clinical outcomes and toxicokinetics of the neonicotinoid insecticide imidacloprid following acute self-poisoning in humans. Methodology/Principal Findings: Demographic and clinical data were prospectively recorded in patients with imidacloprid exposure in three hospitals in Sri Lanka. Blood samples were collected when possible for quantification of imidacloprid concentration. There were 68 patients (61 self-ingestions and 7 dermal exposures) with exposure to imidacloprid. Of the self-poisoning patients, the median time to presentation was 4 hours (IQR 2.3–6.0) and median amount ingested was 15 mL (IQR 10–50 mL). Most patients only developed mild symptoms such as nausea, vomiting, headache and diarrhoea. One patient developed respiratory failure needing mechanical ventilation while another was admitted to intensive care due to prolonged sedation. There were no deaths. Median admission imidacloprid concentration was 10.58 ng/L; IQR: 3.84–15.58 ng/L, Range: 0.02–51.25 ng/L. Changes in the concentration of imidacloprid in serial blood samples were consistent with prolonged absorption and/or saturable elimination. Conclusions: Imidacloprid generally demonstrates low human lethality even in large ingestions. Respiratory failure and reduced level of consciousness were the most serious complications, but these were uncommon. Substitution of imidacloprid for organophosphorus compounds in areas where the incidence of self-poisoning is high may help reduce deaths from self-poisoning