A Systematic Evaluation of the Impact of STRICTA and CONSORT Recommendations on Quality of Reporting for Acupuncture Trials

Background: We investigated whether there had been an improvement in quality of reporting for randomised controlled trials of acupuncture since the publication of the STRICTA and CONSORT statements. We conducted a before-and-after study, comparing ratings for quality of reporting following the publication of both STRICTA and CONSORT recommendations. Methodology and Principal Findings: Ninety peer reviewed journal articles reporting the results of acupuncture trials were selected at random from a wider sample frame of 266 papers. Papers published in three distinct time periods (1994–1995, 1999–2000 and 2004–2005) were compared. Assessment criteria were developed directly from CONSORT and STRICTA checklists. Papers were independently assessed for quality of reporting by two assessors, one of whom was blind to information which could have introduced systematic bias (e.g. date of publication). We detected a statistically significant increase in the reporting of CONSORT items for papers published in each time period measured. We did not, however, find a difference between the number of STRICTA items reported in journal articles published before and 3 to 4 years following the introduction of STRICTA recommendations. Conclusions and Significance: The results of this study suggest that general standards of reporting for acupuncture trials have significantly improved since the introduction of the CONSORT statement in 1996, but that quality in reporting detail

Quality of reporting of randomized controlled trials in polycystic ovary syndrome

Background: Inadequate reporting of randomized controlled trials (RCTs) is associated with biased estimates of treatment effects. The reporting quality of RCTs involving patients with polycystic ovary syndrome (PCOS) is unknown. The purpose of this study was to assess the reporting quality of RCTs involving patients with PCOS using a standardized tool based on the Consolidated Standards of Reporting Trials (CONSORT) statement. Methods: We searched PubMed database for English-language RCTs involving patients with PCOS. Quality of reporting was assessed using a 24-item questionnaire based on the revised CONSORT checklist. Reporting was evaluated overall, and for pre- and post-CONSORT periods. RCTs on PCOS associated with fertility and non-fertility disturbances were also evaluated separately. Results: Nine of the 24 items were reported in less than 50% of the studies, while a significant improvement (P < 0.05) was detected in 12 of 24 items (50%) over the two CONSORT periods. The RCTs on PCOS with reference to fertility seem to have adhered better to CONSORT statement than RCTs not associated to fertility. Conclusion: There is empirical evidence of suboptimal reporting quality of RCTs in PCOS. Endorsement of the CONSORT statement may optimize the reporting quality and enhance the validity of research

Reporting randomised clinical trials of analgesics after traumatic or orthopaedic surgery is inadequate: a systematic review

Background Several randomised clinical trials (RCTs) of analgesics in postoperative pain after traumatic or orthopaedic surgery (TOS) have been published, but no studies have assessed the quality of these reports. We aimed to examine the quality of reporting RCTs on analgesics for postoperative pain after TOS. Methods Reports of RCTs assessing analgesics in postoperative pain after TOS were systematically searched from electronic databases. The quality of reports was assessed using the CONSORT checklist (scoring range from 0 to 22). The quality was considered poor when scoring was 12 or lesser. The publication year and the impact factor of journals were recorded. Results A total of 92 reports of RCTs were identified and 69 (75%) scored 12 or lesser in CONSORT checklist (range 5-17). The mean (SD) CONSORT score of all reports was 10.6 (2.7). Missing CONSORT items included primary and secondary outcome measures (11%), the specific objectives and hypothesis definition (12%), the sample size calculation (12%), the dates defining the periods of recruitment (12%), the discussion of external validity of findings (14%), the allocation sequence generation (24%), and the interpretation of potential bias or imprecision of results (25%). There was a little improvement in CONSORT scores over time (r = 0.62; p < 0.001) and with impact factor of journals (r = 0.30; p < 0.001). Conclusion Quality of reporting RCTs on analgesics after TOS is poor. Reporting of those RCTs should be improved according to methodological standard checklists in the next years

Public health triangulation: approach and application to synthesizing data to understand national and local HIV epidemics

<p>Abstract</p> <p>Background</p> <p>Public health triangulation is a process for reviewing, synthesising and interpreting secondary data from multiple sources that bear on the same question to make public health decisions. It can be used to understand the dynamics of HIV transmission and to measure the impact of public health programs. While traditional intervention research and metaanalysis would be ideal sources of information for public health decision making, they are infrequently available, and often decisions can be based only on surveillance and survey data.</p> <p>Methods</p> <p>The process involves examination of a wide variety of data sources and both biological, behavioral and program data and seeks input from stakeholders to formulate meaningful public health questions. Finally and most importantly, it uses the results to inform public health decision-making. There are 12 discrete steps in the triangulation process, which included identification and assessment of key questions, identification of data sources, refining questions, gathering data and reports, assessing the quality of those data and reports, formulating hypotheses to explain trends in the data, corroborating or refining working hypotheses, drawing conclusions, communicating results and recommendations and taking public health action.</p> <p>Results</p> <p>Triangulation can be limited by the quality of the original data, the potentials for ecological fallacy and "data dredging" and reproducibility of results.</p> <p>Conclusions</p> <p>Nonetheless, we believe that public health triangulation allows for the interpretation of data sets that cannot be analyzed using meta-analysis and can be a helpful adjunct to surveillance, to formal public health intervention research and to monitoring and evaluation, which in turn lead to improved national strategic planning and resource allocation.</p

Review of Online Evidence-based Practice Point-of-Care Information Summary Providers: Authors’ Reply to the Response by the Publisher of DynaMed

We are pleased that the publisher of DynaMed clarified his evidence-based methodology in response to our review. We stress again how good reporting is a prerequisite for transparency. This lesson comes from the reporting of research findings but its extension to the development of information sources should be considered

Homeopathy for mental fatigue: lessons from a randomized, triple blind, placebo-controlled cross-over clinical trial

<p>Abstract</p> <p>Background</p> <p>Difficulty in controlling attention can lead to mental fatigue in the healthy population. We identified one trial reporting a benefit in patients’ attention using a homeopathic formula preparation. One component of the preparation was potassium phosphate, widely available off the shelf as <it>Kali phos</it> 6x for cognitive problems. The aim of this exploratory trial was to assess the effectiveness of <it>Kali phos</it> 6x for attention problems associated with mental fatigue.</p> <p>Methods</p> <p>We recruited student and staff volunteers (University of York) with self-reported mental fatigue, excluding any using homeopathy or prescribed stimulants, or with a diagnosis of chronic fatigue syndrome. In a triple blind, cross-over, placebo-controlled clinical trial, 86 volunteers were randomized to receive <it>Kali phos</it> 6x or identical placebo 10 minutes before taking a psychological test of attention (Stroop Colour-Word Test). One week later they were crossed over and took the other preparation before repeating the test.</p> <p>Results</p> <p>We found no evidence of a treatment effect in a comparison of <it>Kali phos</it> 6x with placebo (<it>Kali phos</it> minus placebo = −1.1 (95% CI −3.0 to 0.9, P = 0.3) Stroop score units, Cohen effect size = −0.17) even when allowing for a weak period effect with accuracy scores in the second period being higher than those in the first (P = 0.05). We observed a ceiling effect in the Stroop test which undermined our ability to interpret this result.</p> <p>Conclusions</p> <p><it>Kali phos</it> 6x was not found to be effective in reducing mental fatigue. A ceiling effect in our primary outcome measure meant that we could not rule out a type II error. Thorough piloting of an adequate outcome measure could have led to an unequivocal result.</p> <p>Current Controlled Trials</p> <p>ISRCTN16521161</p