Increased risk of type I errors in cluster randomised trials with small or medium numbers of clusters: a review, reanalysis,and simulation study

Background: Cluster randomised trials (CRTs) are commonly analysed using mixed-effects models or generalised estimating equations (GEEs). However, these analyses do not always perform well with the small number of clusters typical of most CRTs. They can lead to increased risk of a type I error (finding a statistically significant treatment effect when it does not exist) if appropriate corrections are not used. Methods: We conducted a small simulation study to evaluate the impact of using small-sample corrections for mixed-effects models or GEEs in CRTs with a small number of clusters. We then reanalysed data from TRIGGER, a CRT with six clusters, to determine the effect of using an inappropriate analysis method in practice. Finally, we reviewed 100 CRTs previously identified by a search on PubMed in order to assess whether trials were using appropriate methods of analysis. Trials were classified as at risk of an increased type I error rate if they did not report using an analysis method which accounted for clustering, or if they had fewer than 40 clusters and performed an individual-level analysis without reporting the use of an appropriate small-sample correction. Results: Our simulation study found that using mixed-effects models or GEEs without an appropriate correction led to inflated type I error rates, even for as many as 70 clusters. Conversely, using small-sample corrections provided correct type I error rates across all scenarios. Reanalysis of the TRIGGER trial found that inappropriate methods of analysis gave much smaller P values (P ≤ 0.01) than appropriate methods (P = 0.04–0.15). In our review, of the 99 trials that reported the number of clusters, 64 (65 %) were at risk of an increased type I error rate; 14 trials did not report using an analysis method which accounted for clustering, and 50 trials with fewer than 40 clusters performed an individual-level analysis without reporting the use of an appropriate correction. Conclusions: CRTs with a small or medium number of clusters are at risk of an inflated type I error rate unless appropriate analysis methods are used. Investigators should consider using small-sample corrections with mixed-effects models or GEEs to ensure valid results. Abbreviations: CRT, Cluster randomised trial; CI, Confidence interval; GEE, Generalised estimating equations; TRIGGER, Trial in Gastrointestinal Transfusio

Prevention of haematoma progression by tranexamic acid in intracerebral haemorrhage patients with and without spot sign on admission scan: a statistical analysis plan of a pre-specified sub-study of the TICH-2 trial

Objective We present the statistical analysis plan of a prespecified Tranexamic Acid for Hyperacute Primary Intracerebral Haemorrhage (TICH)-2 sub-study aiming to investigate, if tranexamic acid has a different effect in intracerebral haemorrhage patients with the spot sign on admission compared to spot sign negative patients. The TICH-2 trial recruited above 2000 participants with intracerebral haemorrhage arriving in hospital within 8 h after symptom onset. They were included irrespective of radiological signs of on-going haematoma expansion. Participants were randomised to tranexamic acid versus matching placebo. In this subgroup analysis, we will include all participants in TICH-2 with a computed tomography angiography on admission allowing adjudication of the participants’ spot sign status. Results Primary outcome will be the ability of tranexamic acid to limit absolute haematoma volume on computed tomography at 24 h (± 12 h) after randomisation among spot sign positive and spot sign negative participants, respectively. Within all outcome measures, the effect of tranexamic acid in spot sign positive/negative participants will be compared using tests of interaction. This sub-study will investigate the important clinical hypothesis that spot sign positive patients might benefit more from administration of tranexamic acid compared to spot sign negative patients

Guidelines on uncomplicated urinary tract infections are difficult to follow: perceived barriers and suggested interventions

Contains fulltext : 88451.pdf (publisher's version ) (Open Access)BACKGROUND: Urinary tract infections (UTI) are among the most common health problems seen in general practice. Evidence-based guidelines on UTI are available, but adherence to these guidelines varies widely among practitioners for reasons not well understood. The aim of this study was to identify the barriers to the implementation of a guideline on UTI perceived by Dutch general practitioners (GPs) and to explore interventions to overcome these barriers. METHODS: A focus group study, including 13 GPs working in general practices in the Netherlands, was conducted. Key recommendations on diagnosis and treatment of uncomplicated UTI were selected from the guideline. Barriers to guideline adherence and possible interventions to address these barriers were discussed. The focus group session was audio-taped and transcribed verbatim. Barriers were classified according to an existing framework. RESULTS: Lack of agreement with the recommendations, unavailable and inconvenient materials (i.e. dipslides), and organisational constraints were perceived as barriers for the diagnostic recommendations. Barriers to implementing the treatment recommendations were lack of applicability and organisational constraints related to the availability of drugs in pharmacies. Suggested interventions were to provide small group education to GPs and practice staff members, to improve organisation and coordination of care in out of hour services, to improve the availability of preferred dosages of drugs, and to pilot-test guidelines regionally. CONCLUSIONS: Despite sufficient knowledge of the recommendations on UTI, attitudinal and external barriers made it difficult to follow them in practice. The care concerning UTI could be optimized if these barriers are adequately addressed in implementation strategies. The feasibility and success of these strategies could be improved by involving the target group of the guideline in selecting useful interventions to address the barriers to implementation

Supporting good practice in the provision of services to people with comorbid mental health and alcohol and other drug problems in Australia: describing key elements of good service models

<p>Abstract</p> <p>Background</p> <p>The co-occurrence of mental illness and substance use problems (referred to as "comorbidity" in this paper) is common, and is often reported by service providers as the expectation rather than the exception. Despite this, many different treatment service models are being used in the alcohol and other drugs (AOD) and mental health (MH) sectors to treat this complex client group. While there is abundant literature in the area of comorbidity treatment, no agreed overarching framework to describe the range of service delivery models is apparent internationally or at the national level. The aims of the current research were to identify and describe elements of good practice in current service models of treatment of comorbidity in Australia. The focus of the research was on models of service delivery. The research did not aim to measure the client outcomes achieved by individual treatment services, but sought to identify elements of good practice in services.</p> <p>Methods</p> <p>Australian treatment services were identified to take part in the study through a process of expert consultation. The intent was to look for similarities in the delivery models being implemented across a diverse set of services that were perceived to be providing good quality treatment for people with comorbidity problems.</p> <p>Results</p> <p>A survey was designed based on a concept map of service delivery devised from a literature review. Seventeen Australian treatment services participated in the survey, which explored the context in which services operate, inputs such as organisational philosophy and service structure, policies and procedures that guide the way in which treatment is delivered by the service, practices that reflect the way treatment is provided to clients, and client impacts.</p> <p>Conclusions</p> <p>The treatment of people with comorbidity of mental health and substance use disorders presents complex problems that require strong but flexible service models. While the treatment services included in this study reflected the diversity of settings and approaches described in the literature, the research found that they shared a range of common characteristics. These referred to: service linkages; workforce; policies, procedures and practices; and treatment.</p

Using and Reporting the Delphi Method for Selecting Healthcare Quality Indicators: A Systematic Review

OBJECTIVE: Delphi technique is a structured process commonly used to developed healthcare quality indicators, but there is a little recommendation for researchers who wish to use it. This study aimed 1) to describe reporting of the Delphi method to develop quality indicators, 2) to discuss specific methodological skills for quality indicators selection 3) to give guidance about this practice. METHODOLOGY AND MAIN FINDING: Three electronic data bases were searched over a 30 years period (1978-2009). All articles that used the Delphi method to select quality indicators were identified. A standardized data extraction form was developed. Four domains (questionnaire preparation, expert panel, progress of the survey and Delphi results) were assessed. Of 80 included studies, quality of reporting varied significantly between items (9% for year's number of experience of the experts to 98% for the type of Delphi used). Reporting of methodological aspects needed to evaluate the reliability of the survey was insufficient: only 39% (31/80) of studies reported response rates for all rounds, 60% (48/80) that feedback was given between rounds, 77% (62/80) the method used to achieve consensus and 57% (48/80) listed quality indicators selected at the end of the survey. A modified Delphi procedure was used in 49/78 (63%) with a physical meeting of the panel members, usually between Delphi rounds. Median number of panel members was 17(Q1:11; Q3:31). In 40/70 (57%) studies, the panel included multiple stakeholders, who were healthcare professionals in 95% (38/40) of cases. Among 75 studies describing criteria to select quality indicators, 28 (37%) used validity and 17(23%) feasibility. CONCLUSION: The use and reporting of the Delphi method for quality indicators selection need to be improved. We provide some guidance to the investigators to improve the using and reporting of the method in future surveys

Avoiding Treatment Interruptions: What Role Do Australian Community Pharmacists Play?

OBJECTIVE: To explore the reported practice of Australian community pharmacists when dealing with medication supply requests in absence of a valid prescription. METHODS: Self-administered questionnaire was posted to 1490 randomly selected community pharmacies across all Australian states and territories. This sample was estimated to be a 20% of all Australian community pharmacies. RESULTS: Three hundred eighty five pharmacists participated in the study (response rate achieved was 27.9% (there were 111 undelivered questionnaires). Respondents indicated that they were more likely to provide medications to regular customers without a valid prescription compared to non-regular customers (p&lt;0.0001). However, supply was also influenced by the type of prescription and the medication requested. In the case of type of prescription (Standard, Authority or Private) this relates to the complexity/probability of obtaining a valid prescription from the prescriber at a later date (i.e. supply with an anticipated prescription). Decisions to supply and/or not supply related to medication type were more complex. For some cases, including medication with potential for abuse, the practice and/or the method of supply varied significantly according to age and gender of the pharmacist, and pharmacy location (p&lt;0.05). CONCLUSIONS: Although being a regular customer does not guarantee a supply, results of this study reinforce the importance for patients having a regular pharmacy, where pharmacists were more likely to continue medication supply in cases of patients presenting without a valid prescription. We would suggest, more flexible legislation should be implemented to allow pharmacists to continue supplying of medication when obtaining a prescription is not practical

Acromegaly caused by growth hormone-releasing hormone-producing tumors: long-term observational studies in three patients

We report on three newly diagnosed patients with extracranial ectopic GHRH-associated acromegaly with long-term follow-up after surgery of the primary tumor. One patient with a pancreatic tumor and two parathyroid adenomas was the index case of a large kindred of MEN-I syndrome. The other two patients had a large bronchial carcinoid. The first patient is still in remission now almost 22 years after surgery. In the two other patients GHRH did not normalize completely after surgery and they are now treated with slow-release octreotide. IGF-I normalized in all patients. During medical treatment basal GH secretion remained (slightly) elevated and secretory regularity was decreased in 24 h blood sampling studies. We did not observe development of tachyphylaxis towards the drug or radiological evidence of (growing) metastases. We propose life-long suppressive therapy with somatostatin analogs in cases with persisting elevated serum GHRH concentrations after removal of the primary tumor. Independent parameters of residual disease are elevated basal (nonpulsatile) GH secretion and decreased GH secretory regularity

Structure of a Murine Norovirus NS6 Protease-Product Complex Revealed by Adventitious Crystallisation

Murine noroviruses have emerged as a valuable tool for investigating the molecular basis of infection and pathogenesis of the closely related human noroviruses, which are the major cause of non-bacterial gastroenteritis. The replication of noroviruses relies on the proteolytic processing of a large polyprotein precursor into six non-structural proteins (NS1–2, NS3, NS4, NS5, NS6pro, NS7pol) by the virally-encoded NS6 protease. We report here the crystal structure of MNV NS6pro, which has been determined to a resolution of 1.6 Å. Adventitiously, the crystal contacts are mediated in part by the binding of the C-terminus of NS6pro within the peptide-binding cleft of a neighbouring molecule. This insertion occurs for both molecules in the asymmetric unit of the crystal in a manner that is consistent with physiologically-relevant binding, thereby providing two independent views of a protease-peptide complex. Since the NS6pro C-terminus is formed in vivo by NS6pro processing, these crystal contacts replicate the protease-product complex that is formed immediately following cleavage of the peptide bond at the NS6-NS7 junction. The observed mode of binding of the C-terminal product peptide yields new insights into the structural basis of NS6pro specificity

Appeals to evidence for the resolution of wicked problems: the origins and mechanisms of evidentiary bias

Wicked policy problems are often said to be characterized by their ‘intractability’, whereby appeals to evidence are unable to provide policy resolution. Advocates for ‘Evidence Based Policy’ (EBP) often lament these situations as representing the misuse of evidence for strategic ends, while critical policy studies authors counter that policy decisions are fundamentally about competing values, with the (blind) embrace of technical evidence depoliticizing political decisions. This paper aims to help resolve these conflicts and, in doing so, consider how to address this particular feature of problem wickedness. Specifically the paper delineates two forms of evidentiary bias that drive intractability, each of which is reflected by contrasting positions in the EBP debates: ‘technical bias’ - referring to invalid uses of evidence; and ‘issue bias’ - referring to how pieces of evidence direct policy agendas to particular concerns. Drawing on the fields of policy studies and cognitive psychology, the paper explores the ways in which competing interests and values manifest in these forms of bias, and shape evidence utilization through different mechanisms. The paper presents a conceptual framework reflecting on how the nature of policy problems in terms of their complexity, contestation, and polarization can help identify the potential origins and mechanisms of evidentiary bias leading to intractability in some wicked policy debates. The discussion reflects on whether being better informed about such mechanisms permit future work that may lead to strategies to mitigate or overcome such intractability in the future