The challenges faced in the design, conduct and analysis of surgical randomised controlled trials

Randomised evaluations of surgical interventions are rare; some interventions have been widely adopted without rigorous evaluation. Unlike other medical areas, the randomised controlled trial (RCT) design has not become the default study design for the evaluation of surgical interventions. Surgical trials are difficult to successfully undertake and pose particular practical and methodological challenges. However, RCTs have played a role in the assessment of surgical innovations and there is scope and need for greater use. This article will consider the design, conduct and analysis of an RCT of a surgical intervention. The issues will be reviewed under three headings: the timing of the evaluation, defining the research question and trial design issues. Recommendations on the conduct of future surgical RCTs are made. Collaboration between research and surgical communities is needed to address the distinct issues raised by the assessmentof surgical interventions and enable the conduct of appropriate and well-designed trials.The Health Services Research Unit is funded by the Scottish Government Health DirectoratesPeer reviewedPublisher PD

Obstetric anal sphincter injury: a systematic review of information available on the internet.

OBJECTIVE: There is no systematic evaluation of online health information pertaining to obstetric anal sphincter injury. Therefore, we evaluated the accuracy, credibility, reliability, and readability of online information concerning obstetric anal sphincter injury. MATERIALS AND METHODS: Multiple search engines were searched. The first 30 webpages were identified for each keyword and considered eligible if they provided information regarding obstetric anal sphincter injury. Eligible webpages were assessed by two independent researchers for accuracy (prioritised criteria based upon the RCOG Third and Fourth Degree Tear guideline); credibility; reliability; and readability. RESULTS: Fifty-eight webpages were included. Seventeen webpages (30%) had obtained Health On the Net certification, or Information Standard approval and performed better than those without such approvals (p = 0.039). The best overall performing website was http://www.pat.nhs.uk (score of 146.7). A single webpage (1%) fulfilled the entire criteria for accuracy with a score of 18: www.tamesidehospital.nhs.uk . Twenty-nine webpages (50%) were assessed as credible (scores ≥7). A single webpage achieved a maximum credibility score of 10: www.meht.nhs.uk . Over a third (21 out of 58) were rated as poor or very poor. The highest scoring webpage was http://www.royalsurrey.nhs.uk (score 62). No webpage met the recommended Flesch Reading Ease Score above 70. The intra-class coefficient between researchers was 0.98 (95% CI 0.96-0.99) and 0.94 (95% CI 0.89-0.96) for accuracy and reliability assessments. CONCLUSION: Online information concerning obstetric anal sphincter injury often uses language that is inappropriate for a lay audience and lacks sufficient accuracy, credibility, and reliability

How do we create, and improve, the evidence base?

Providing best clinical care involves using the best available evidence of effectiveness to inform treatment decisions. Producing this evidence begins with trials and continues through synthesis of their findings towards evidence incorporation within comprehensible, usable guidelines, for clinicians and patients at the point of care. However, there is enormous wastage in this evidence production process, with less than 50% of the published biomedical literature considered sufficient in conduct and reporting to be fit for purpose. Over the last 30 years, independent collaborative initiatives have evolved to optimise the evidence to improve patient care. These collaborations each recommend how to improve research quality in a small way at many different stages of the evidence production and distillation process. When we consider these minimal improvements at each stage from an 'aggregation of marginal gains' perspective, the accumulation of small enhancements aggregates, thereby greatly improving the final product of 'best available evidence'. The myriad of tools to reduce research quality leakage and evidence loss should be routinely used by all those with responsibility for ensuring that research benefits patients, that is, those who pay for research (funders), produce it (researchers), take part in it (patients/participants) and use it (clinicians, policy makers and service commissioners)

Publication bias in gastroenterological research – a retrospective cohort study based on abstracts submitted to a scientific meeting

BACKGROUND: The aim of this study was to examine the determinants of publication and whether publication bias occurred in gastroenterological research. METHODS: A random sample of abstracts submitted to DDW, the major GI meeting (1992–1995) was evaluated. The publication status was determined by database searches, complemented by a mailed survey to abstract authors. Determinants of publication were examined by Cox proportional hazards model and multiple logistic regression. RESULTS: The sample included abstracts on 326 controlled clinical trials (CCT), 336 other clinical research reports (OCR), and 174 basic science studies (BSS). 392 abstracts (47%) were published as full papers. Acceptance for presentation at the meeting was a strong predictor of subsequent publication for all research types (overall, 54% vs. 34%, OR 2.3, 95% CI 1.7 to 3.1). In the multivariate analysis, multi-center status was found to predict publication (OR 2.8, 95% CI 1.6–4.9). There was no significant association between direction of study results and subsequent publication. Studies were less likely to be published in high impact journals if the results were not statistically significant (OR 0.5, 95 CI 95% 0.3–0.6). The author survey identified lack of time or interest as the main reason for failure to publish. CONCLUSIONS: Abstracts which were selected for presentation at the DDW are more likely to be followed by full publications. The statistical significance of the study results was not found to be a predictor of publication but influences the chances for high impact publication

Three-point correlators for giant magnons

Three-point correlation functions in the strong-coupling regime of the AdS/CFT correspondence can be analyzed within a semiclassical approximation when two of the vertex operators correspond to heavy string states having large quantum numbers while the third vertex corresponds to a light state with fixed charges. We consider the case where the heavy string states are chosen to be giant magnon solitons with either a single or two different angular momenta, for various different choices of light string states.Comment: 15 pages. Latex. v2: Misprints corrected. Published versio

Meta-analysis: Neither quick nor easy

BACKGROUND: Meta-analysis is often considered to be a simple way to summarize the existing literature. In this paper we describe how a meta-analysis resembles a conventional study, requiring a written protocol with design elements that parallel those of a record review. METHODS: The paper provides a structure for creating a meta-analysis protocol. Some guidelines for measurement of the quality of papers are given. A brief overview of statistical considerations is included. Four papers are reviewed as examples. The examples generally followed the guidelines we specify in reporting the studies and results, but in some of the papers there was insufficient information on the meta-analysis process. CONCLUSIONS: Meta-analysis can be a very useful method to summarize data across many studies, but it requires careful thought, planning and implementation