Effect of response format for clinical vignettes on reporting quality of physician practice

<p>Abstract</p> <p>Background</p> <p>Clinical vignettes have been used widely to compare quality of clinical care and to assess variation in practice, but the effect of different response formats has not been extensively evaluated. Our objective was to compare three clinical vignette-based survey response formats – open-ended questionnaire (A), closed-ended (multiple-choice) questionnaire with deceptive response items mixed with correct items (B), and closed-ended questionnaire with only correct items (C) – in rheumatologists' pre-treatment assessment for tumor-necrosis-factor (TNF) blocker therapy.</p> <p>Methods</p> <p><b><it>Study design</it></b>: Prospective randomized study. <b><it>Setting</it></b>: Rheumatologists attending the 2004 French Society of Rheumatology meeting. Physicians were given a vignette describing the history of a fictitious woman with active rheumatoid arthritis, who was a candidate for therapy with TNF blocking agents, and then were randomized to receive questionnaire A, B, or C, each containing the same four questions but with different response formats, that asked about their pretreatment assessment. <b><it>Measurements</it></b>: Long (recommended items) and short (mandatory items) checklists were developed for pretreatment assessment for TNF-blocker therapy, and scores were expressed on the basis of responses to questionnaires A, B, and C as the percentage of respondents correctly choosing explicit items on these checklists. <b><it>Statistical analysis</it></b>: Comparison of the selected items using pairwise Chi-square tests with Bonferonni correction for variables with statistically significant differences.</p> <p>Results</p> <p>Data for all surveys distributed (114 As, 118 Bs, and 118 Cs) were complete and available for analysis. The percentage of questionnaire A, B, and C respondents for whom data was correctly complete for the short checklist was 50.4%, 84.0% and 95.0%, respectively, and was 0%, 5.0% and 5.9%, respectively, for the long version. As an example, 65.8%, 85.7% and 95.8% of the respondents of A, B, and C questionnaires, respectively, correctly identified the need for tuberculin skin test (p < 0.0001).</p> <p>Conclusion</p> <p>In evaluating clinical practice with use of a clinical vignette, a multiple-choice format rather than an open-ended format overestimates physician performance. The insertion of deceptive response items mixed with correct items in closed-ended (multiple-choice) questionnaire failed to avoid this overestimation.</p

Outcome and serum ion determination up to 11 years after implantation of a cemented metal-on-metal hip prosthesis

Background and purpose Little is known about the long-term outcome of cemented metal-on-metal hip arthroplasties. We evaluated a consecutive series of metal-on-metal polyethylene-backed cemented hip arthroplasties implanted in patients under 60 years of age

Antiretroviral-naive and -treated HIV-1 patients can harbour more resistant viruses in CSF than in plasma

Objectives The neurological disorders in HIV-1-infected patients remain prevalent. The HIV-1 resistance in plasma and CSF was compared in patients with neurological disorders in a multicentre study. Methods Blood and CSF samples were collected at time of neurological disorders for 244 patients. The viral loads were >50 copies/mL in both compartments and bulk genotypic tests were realized. Results On 244 patients, 89 and 155 were antiretroviral (ARV) naive and ARV treated, respectively. In ARV-naive patients, detection of mutations in CSF and not in plasma were reported for the reverse transcriptase (RT) gene in 2/89 patients (2.2%) and for the protease gene in 1/89 patients (1.1%). In ARV-treated patients, 19/152 (12.5%) patients had HIV-1 mutations only in the CSF for the RT gene and 30/151 (19.8%) for the protease gene. Two mutations appeared statistically more prevalent in the CSF than in plasma: M41L (P = 0.0455) and T215Y (P = 0.0455). Conclusions In most cases, resistance mutations were present and similar in both studied compartments. However, in 3.4% of ARV-naive and 8.8% of ARV-treated patients, the virus was more resistant in CSF than in plasma. These results support the need for genotypic resistance testing when lumbar puncture is performe

Value of ultrasonography as a marker of early response to abatacept in patients with rheumatoid arthritis and an inadequate response to methotrexate: results from the APPRAISE study

Objectives: To study the responsiveness of a combined power Doppler and greyscale ultrasound (PDUS) score for assessing synovitis in biologic-naïve patients with rheumatoid arthritis (RA) starting abatacept plus methotrexate (MTX). Methods: In this open-label, multicentre, single-arm study, patients with RA (MTX inadequate responders) received intravenous abatacept (∼10 mg/kg) plus MTX for 24 weeks. A composite PDUS synovitis score, developed by the Outcome Measures in Rheumatology–European League Against Rheumatism (OMERACT–EULAR)-Ultrasound Task Force, was used to evaluate individual joints. The maximal score of each joint was added into a Global OMERACT–EULAR Synovitis Score (GLOESS) for bilateral metacarpophalangeal joints (MCPs) 2–5 (primary objective). The value of GLOESS containing other joint sets was explored, along with clinical efficacy. Results: Eighty-nine patients completed the 24-week treatment period. The earliest PDUS sign of improvement in synovitis was at week 1 (mean change in GLOESS (MCPs 2–5): −0.7 (95% CIs −1.2 to −0.1)), with continuous improvement to week 24. Early improvement was observed in the component scores (power Doppler signal at week 1, synovial hyperplasia at week 2, joint effusion at week 4). Comparable changes were observed for 22 paired joints and minimal joint subsets. Mean Disease Activity Score 28 (C reactive protein) was significantly reduced from weeks 1 to 24, reaching clinical meaningful improvement (change ≥1.2) at week 8. Conclusions: In this first international prospective study, the composite PDUS score is responsive to abatacept. GLOESS demonstrated the rapid onset of action of abatacept, regardless of the number of joints examined. Ultrasound is an objective tool to monitor patients with RA under treatment. Trial registration number: NCT00767325

Assessing complex emergency management with clinical case-vignettes: A validation study

International audienceObjective: To evaluate whether responses to dynamic case-vignettes accurately reflect actual practices in complex emergency situations. We hypothesized that when obstetricians were faced with vignette of emergency situation identical to one they previously managed, they would report the management strategy they actually used. On the other hand, there is no reason to suppose that their response to a vignette based on a source case managed by another obstetrician would be the same as the actual management. Methods: A multicenter vignette-based study was used in 7 French maternity units.We chose the example of severe postpartum hemorrhage (PPH) to study the use of case-vignettes for assessing the management of complex situations. We developed dynamic case-vignettes describing incidents of PPH in several steps, using documentation in patient files. Vignettes described the postpartum course and included multiple-choice questions detailing proposed clinical care. Each participating obstetrician was asked to evaluate 4 case-vignettes: 2 directly derived from cases they previously managed and 2 derived from other obstetricians' cases. We compared the final treatment decision in vignette responses to those documented in the source-case by the overall agreement and the Kappa coefficient, both for the cases the obstetricians previously managed and the cases of others. Results: Thirty obstetricians participated. Overall agreement between final treatment decisions in case-vignettes and documented care for cases obstetricians previously managed was 82% (Kappa coefficient: 0.75, 95% CI [0.62-0.88]). Overall agreement between final treatment decisions in case-vignettes and documented care in vignettes derived from other obstetricians' cases was only 48% (Kappa coefficient: 0.30, 95% CI [0.12-0.48]). Final agreement with documented care was significantly better for cases based on their own previous cases than for others (p<0.001). Conclusions: Dynamic case-vignettes accurately reflect actual practices in complex emergency situations. Therefore, they can be used to assess the quality of management in these situations

Variation in severe postpartum hemorrhage management: A national vignette-based study

Objectives To assess variations in management of severe postpartum hemorrhage: 1) between obstetricians in the same situation 2) by the same obstetrician in different situations. Study design A link to a vignette-based survey was emailed to obstetricians of 215 maternity units; the questionnaire asked them to report how they would manage the PPH described in 2 previously validated case-vignettes of different scenarios of severe PPH. Vignette 1 described a typical immediate, severe PPH, and vignette 2 a less typical case of severe but gradual PPH. They were constructed in 3 successive steps and included multiple-choice questions proposing several types of clinical practice options at each step. Variations in PPH were assessed in a descriptive analysis; agreement about management and its timing between vignette 1 and vignette 2 was assessed with the Kappa coefficient. Results Analysis of complete responses from 119 (43.4%) obstetricians from 53 (24.6%) maternity units showed delayed or inadequate management in both vignettes. While 82.3% and 83.2% of obstetricians (in vignettes 1 and 2, respectively) would administer oxytocin 15 minutes after PPH diagnosis, only 52.9% and 29.4% would alert other team members. Management by obstetricians of the two vignette situations was inconsistent in terms of choice of treatment and timing of almost all treatments. Conclusion Case vignettes demonstrated inadequate management as well as variations in management between obstetricians and in different PPH situations. Protocols or procedures are necessary in all maternity units to reduce the variations in practices that May explain a part of the delay in management that leads to PPH-related maternal mortality and morbidity

Variations in postpartum hemorrhage management among midwives: A national vignette-based study

International audienceObjective: To assess variations in adherence to guidelines for management of postpartum hemorrhage (PPH) among midwives. Methods: A multicentre vignette-based study was e-mailed to a random sample of midwives from 145 maternity units in France. They were asked to describe how they would manage the PPH described in 2 case-vignettes. These previously validated case-vignettes described 2 different scenarios for severe PPH. Vignette 1 described a typical immediate, severe PPH and vignette 2 a less typical case of severe but gradual PPH. They were constructed in 3 successive steps and included multiple-choice questions proposing several types of clinical practice options at each step. An expert consensus defined 14 criteria for assessing adherence to guidelines issued by the French College of Obstetricians and Gynecologists in 2004 in the midwives' responses. We analyzed the number of errors among the 14 criteria to quantify the level of adherence. Results: We obtained 450 complete responses from midwives from 87 maternity units. The rate of complete adherence (no error for any of the 14 criteria) was low: 25.1% in vignette 1 and 4.2% in vignette 2. The error rate was higher for pharmacological management, especially oxytocin use, than for non-pharmacological management and communication-monitoringinvestigation. Adherence to guidelines varied substantially between and within maternity units, as well as between the vignettes for the same midwives. Conclusion: Reponses to case-vignettes demonstrated substantial variations in PPH management and especially individual variations in adherence to guidelines. Midwives should participate in continuous and individualized traini