Chapter 5: Assessing Risk of Bias as a Domain of Quality in Medical Test Studies

Assessing methodological quality is a necessary activity for any systematic review, including those evaluating the evidence for studies of medical test performance. Judging the overall quality of an individual study involves examining the size of the study, the direction and degree of findings, the relevance of the study, and the risk of bias in the form of systematic error, internal validity, and other study limitations. In this chapter of the Methods Guide for Medical Test Reviews, we focus on the evaluation of risk of bias in the form of systematic error in an individual study as a distinctly important component of quality in studies of medical test performance, specifically in the context of estimating test performance (sensitivity and specificity). We make the following recommendations to systematic reviewers: 1) When assessing study limitations that are relevant to the test under evaluation, reviewers should select validated criteria that examine the risk of systematic error, 2) categorizing the risk of bias for individual studies as “low,” “medium,” or “high” is a useful way to proceed, and 3) methods for determining an overall categorization for the study limitations should be established a priori and documented clearly

A protocol for a pragmatic randomized controlled trial using the Health Teams Advancing Patient Experience: Strengthening Quality (Health TAPESTRY) platform approach to promote person-focused primary healthcare for older adults

Detailed description of the intervention [57, 84–89]. (DOC 63 kb

Patient-reported outcome measures used for neck disorders: An overview of systematic reviews

Copyright © 2018 Journal of Orthopaedic & Sports Physical Therapy®. BACKGROUND: The evaluation of patient-reported outcome measures for the neck from multiple systematic reviews will provide a broader view of, and may identify potential conflicting or consistent results for, their psychometric properties. OBJECTIVES: The purpose of this study was to conduct an overview of systematic reviews and synthesize evidence to establish the current state of knowledge on psychometric properties of patient-reported outcome measures for patients with neck disorders. METHODS: In this overview of systematic reviews, an electronic search of 6 databases (MED-LINE, Embase, CINAHL, ILC, the Cochrane Central Register of Controlled Trials, and LILACS) was conducted to identify reviews that addressed at least one measurement property of outcome measures for people with neck pain. Only systematic reviews with patient-reported outcome measures were included in the analysis. Risk of bias was assessed with A MeaSurement Tool to Assess systematic Reviews (AMSTAR). Data on measurement properties were extracted from each systematic review. RESULTS: From 13 systematic reviews, 8 patient-reported outcome measures were evaluated in 2 or more reviews. Risk-of-bias scores ranged from moderate (5-7) to high (4 and lower). Findings on internal consistency, test-retest reliability, construct validity, responsiveness to change, and content and structural validity were synthesized for the Neck Disability Index (NDI) in 11 systematic reviews; the Northwick Park Neck Pain Questionnaire and Neck Pain and Disability scale (NPDS) in 6 systematic reviews; the Copenhagen Neck Functional Disability Scale in 5 systematic reviews; the Neck Bournemouth Questionnaire in 4 systematic reviews; the Core Neck Pain Questionnaire and Patient-Specific Functional Scale in 3 systematic reviews, and the Whiplash Disability Questionnaire in 2 systematic reviews. CONCLUSION: High-quality evidence was found of good to excellent internal consistency and moderate to excellent test-retest reliability for the NDI. Moderate-quality evidence was found of good to excellent internal consistency and good test-retest reliability for the Northwick Park Neck Pain Questionnaire. High-quality evidence was found of excellent test-retest reliability and good to strong construct validity with pain scales for the Copenhagen Neck Functional Disability Scale. Moderate-quality evidence was found of unclear to excellent internal consistency and moderate to strong concurrent associations with the NDI and global assessment of change for the Neck Pain and Disability scale. Moderate-quality evidence was found of excellent internal consistency for the Whiplash Disability Questionnaire and of high test-retest reliability for the Patient-Specific Functional Scale

Pharmacological, psychological, and patient education interventions for patients with neck pain: Results of an international survey

© 2015 - IOS Press and the authors. All rights reserved. BACKGROUND: Examination of practice patterns compared to existing evidence identifies knowledge to practice gaps. OBJECTIVES: To describe the utilization of pharmacological, patient education, primary psychological interventions and relaxation therapies in patients with neck pain by clinicians. METHODS: An international cross-sectional survey was conducted to determine the use of these interventions amongst 326 clinicians treating patients with neck pain. RESULTS: Nineteen countries participated. Results were analyzed by usage amongst physical therapists (39%) and chiropractors (35%), as they were the predominant respondents. Patient education (95%) and relaxation therapies (59%) were the most utilized interventions. Tests of subgroup differences determined that physical therapists used patient education significantly more than chiropractors. Use of medications and primary psychological interventions were reported by most to be outside of scope of practice. The high rate of patient education is consistent with supporting evidence. However, usage of relaxation therapies is contrary to evidence suggesting no benefit for improved pain or function for chronic neck pain. CONCLUSION: This survey indicates that patient education and relaxation therapies are common treatments provided by chiropractors and physical therapists for patients with neck pain. Future research should address gaps associated with variable practice patterns and knowledge translation to reduce usage of interventions shown to be ineffective

Psychological care, patient education, orthotics, ergonomics and prevention for neck pain: a systematic overview update as part of the ICON Project

OBJECTIVES: To conduct an overview on psychological interventions, orthoses, patient education, ergonomics, and 1⁰/2⁰ neck pain prevention for adults with acute-chronic neck pain. SEARCH STRATEGY: Computerized databases and grey literature were searched (2006-2012). SELECTION CRITERIA: Systematic reviews of randomized controlled trials (RCTs) on pain, function/disability, global perceived effect, quality-of-life and patient satisfaction were retrieved. DATA COLLECTION & ANALYSIS: Two independent authors selected articles, assessed risk of bias using AMSTAR tool and extracted data. The GRADE tool was used to evaluate the body of evidence and an external panel to provide critical review. MAIN RESULTS: We retrieved 30 reviews (5-9 AMSTAR score) reporting on 75 RCTs with the following moderate GRADE evidence. For acute whiplash associated disorder (WAD), an education video in emergency rooms (1RCT, 405participants] favoured pain reduction at long-term follow-up thus helping 1 in 23 people [Standard Mean Difference: -0.44(95%CI: -0.66 to -0.23)). Use of a soft collar (2RCTs, 1278participants) was not beneficial in the long-term. For chronic neck pain, a mind-body intervention (2RCTs, 1 meta-analysis, 191participants) improved short-term pain/function in 1 of 4 or 6 participants. In workers, 2-minutes of daily scapula-thoracic endurance training (1RCT, 127participants) over 10 weeks was beneficial in 1 of 4 participants. A number of psychosocial interventions, workplace interventions, collar use and self-management educational strategies were not beneficial. REVIEWERS' CONCLUSIONS: Moderate evidence exists for quantifying beneficial and non-beneficial effects of a limited number of interventions for acute WAD and chronic neck pain. Larger trials with more rigorous controls need to target promising intervention