Effect of response format for clinical vignettes on reporting quality of physician practice

<p>Abstract</p> <p>Background</p> <p>Clinical vignettes have been used widely to compare quality of clinical care and to assess variation in practice, but the effect of different response formats has not been extensively evaluated. Our objective was to compare three clinical vignette-based survey response formats – open-ended questionnaire (A), closed-ended (multiple-choice) questionnaire with deceptive response items mixed with correct items (B), and closed-ended questionnaire with only correct items (C) – in rheumatologists' pre-treatment assessment for tumor-necrosis-factor (TNF) blocker therapy.</p> <p>Methods</p> <p><b><it>Study design</it></b>: Prospective randomized study. <b><it>Setting</it></b>: Rheumatologists attending the 2004 French Society of Rheumatology meeting. Physicians were given a vignette describing the history of a fictitious woman with active rheumatoid arthritis, who was a candidate for therapy with TNF blocking agents, and then were randomized to receive questionnaire A, B, or C, each containing the same four questions but with different response formats, that asked about their pretreatment assessment. <b><it>Measurements</it></b>: Long (recommended items) and short (mandatory items) checklists were developed for pretreatment assessment for TNF-blocker therapy, and scores were expressed on the basis of responses to questionnaires A, B, and C as the percentage of respondents correctly choosing explicit items on these checklists. <b><it>Statistical analysis</it></b>: Comparison of the selected items using pairwise Chi-square tests with Bonferonni correction for variables with statistically significant differences.</p> <p>Results</p> <p>Data for all surveys distributed (114 As, 118 Bs, and 118 Cs) were complete and available for analysis. The percentage of questionnaire A, B, and C respondents for whom data was correctly complete for the short checklist was 50.4%, 84.0% and 95.0%, respectively, and was 0%, 5.0% and 5.9%, respectively, for the long version. As an example, 65.8%, 85.7% and 95.8% of the respondents of A, B, and C questionnaires, respectively, correctly identified the need for tuberculin skin test (p < 0.0001).</p> <p>Conclusion</p> <p>In evaluating clinical practice with use of a clinical vignette, a multiple-choice format rather than an open-ended format overestimates physician performance. The insertion of deceptive response items mixed with correct items in closed-ended (multiple-choice) questionnaire failed to avoid this overestimation.</p

Are there valid proxy measures of clinical behaviour?

Background: Accurate measures of health professionals' clinical practice are critically important to guide health policy decisions, as well as for professional self-evaluation and for research-based investigation of clinical practice and process of care. It is often not feasible or ethical to measure behaviour through direct observation, and rigorous behavioural measures are difficult and costly to use. The aim of this review was to identify the current evidence relating to the relationships between proxy measures and direct measures of clinical behaviour. In particular, the accuracy of medical record review, clinician self-reported and patient-reported behaviour was assessed relative to directly observed behaviour. Methods: We searched: PsycINFO; MEDLINE; EMBASE; CINAHL; Cochrane Central Register of Controlled Trials; science/social science citation index; Current contents (social & behavioural med/clinical med); ISI conference proceedings; and Index to Theses. Inclusion criteria: empirical, quantitative studies; and examining clinical behaviours. An independent, direct measure of behaviour (by standardised patient, other trained observer or by video/audio recording) was considered the 'gold standard' for comparison. Proxy measures of behaviour included: retrospective self-report; patient-report; or chart-review. All titles, abstracts, and full text articles retrieved by electronic searching were screened for inclusion and abstracted independently by two reviewers. Disagreements were resolved by discussion with a third reviewer where necessary. Results: Fifteen reports originating from 11 studies met the inclusion criteria. The method of direct measurement was by standardised patient in six reports, trained observer in three reports, and audio/video recording in six reports. Multiple proxy measures of behaviour were compared in five of 15 reports. Only four of 15 reports used appropriate statistical methods to compare measures. Some direct measures failed to meet our validity criteria. The accuracy of patient report and chart review as proxy measures varied considerably across a wide range of clinical actions. The evidence for clinician self-report was inconclusive. Conclusion: Valid measures of clinical behaviour are of fundamental importance to accurately identify gaps in care delivery, improve quality of care, and ultimately to improve patient care. However, the evidence base for three commonly used proxy measures of clinicians' behaviour is very limited. Further research is needed to better establish the methods of development, application, and analysis for a range of both direct and proxy measures of behaviour

Current LISA Spacecraft Design

The Laser Interferometer Space Antenna (LISA) mission. a space based gravitational wave detector. uses laser metrology to measure distance fluctuations between proof masses aboard three spacecraft. LISA is unique from a mission design perspective in that the three spacecraft and their associated operations form one distributed science instrument. unlike more conventional missions where an instrument is a component of an individual spacecraft. The design of the LISA spacecraft is also tightly coupled to the design and requirements of the scientific payload; for this reason it is often referred to as a "sciencecraft." Here we describe some of the unique features of the LISA spacecraft design that help create the quiet environment necessary for gravitational wave observations

Increases in sampling support the southern Gondwanan hypothesis for the origin of dinosaurs

Dinosaurs were ubiquitous in terrestrial ecosystems through most of the Mesozoic and are still diversely represented in the modern fauna in the form of birds. Recent efforts to better understand the origins of the group have resulted in the discovery of many new species of early dinosaurs and their closest relatives (dinosauromorphs). In addition, recent re-examinations of early dinosaur phylogeny have highlighted uncertainties regarding the interrelationships of the main dinosaur lineages (Sauropodomorpha, Theropoda and Ornithischia), and questioned the traditional hypothesis that the group originated in South Gondwana and gradually dispersed over Pangaea. Here, we use a historical approach to examine the impact of new fossil discoveries and changing phylogenetic hypotheses on biogeographic scenarios for dinosaur origins over 20 years of research time, and analyse the results in the light of different fossil record sampling regimes. Our results consistently optimize South Gondwana as the ancestral area for Dinosauria, as well as for more inclusive clades including Dinosauromorpha, and show that this hypothesis is robust to increased taxonomic and geographic sampling and divergent phylogenetic results. Our results do not find any support for the recently proposed Laurasian origin of dinosaurs and suggest that a southern Gondwanan origin is by far the most plausible given our current knowledge of the diversity of early dinosaurs and non-dinosaurian dinosauromorphs

Impact of optical coherence tomography on diagnostic decision-making by UK community optometrists: a clinical vignette study.

PURPOSE: In recent years, there has been widespread investment in imaging technologies by community optometrists in the UK, most notably optical coherence tomography (OCT). The aim of the current study was to determine the value of OCT in the diagnosis of posterior segment diseases in a representative sample of community optometrists using a clinical vignette methodology. METHODS: A group of community optometrists (n = 50) initially completed a standardised training package on OCT interpretation followed by a computer-based assessment featuring 52 clinical vignettes, containing images of healthy (n = 8) or glaucomatous (n = 18) discs or healthy (n = 8) or diseased (n = 18) fundi. Each vignette featured either a single fundus/disc photographic image, or a combination of a fundus/disc image with the corresponding OCT scan. An expert panel confirmed that the fundus images presented alone and those in combination with OCT data were of a similar level of difficulty and that the cases were typical of those seen in primary care. For each case, the optometrist selected their diagnosis from a pull-down list and reported their confidence in their decision using a 10-point Likert scale. Pairwise comparisons of the fundus image alone and fundus image/OCT combination were made for both diagnostic performance and confidence. RESULTS: The mean percentage of correct diagnoses using fundus imaging alone was 62% (95% CI 59-64%) and for the combination of fundus image/OCT was 80% (95% CI 77-82%). The mean false negative rate with fundus alone was 27% reducing to 13% with the OCT combination. Median confidence scores for fundus imaging alone was 8.0 (IQR 7.0-8.0) and 8.3 (IQR 8.0-9.0) for the combination. Improvements in performance and confidence were statistically significant (p < 0.001). CONCLUSION: The results from this vignette study suggests that OCT improves optometrists' diagnostic performance compared to fundus observation alone. These initial results suggest that OCT provides valuable additional data that could augment case-finding for glaucoma and retinal disease; however, further research is needed to assess its diagnostic performance in a routine clinical practice setting

Radical Surgery in the Treatment of Localized Carcinoma of the Prostate

New methods of early detection combined with recent advances in surgical techniques have resulted in more patients undergoing radical surgery for treatment of localized carcinoma of the prostate. Over 350 radical prostatectomies have been performed by our group since January 1987. We review the role of radical prostatectomy in the treatment of prostate cancer and our experience with 100 patients undergoing radical retropubic prostatectomy since the advent of nerve-sparing techniques to preserve potency

BMQ

BMQ: Boston Medical Quarterly was published from 1950-1966 by the Boston University School of Medicine and the Massachusetts Memorial Hospitals

The targeted delivery of multicomponent cargos to cancer cells by nanoporous particle-supported lipid bilayers.

Encapsulation of drugs within nanocarriers that selectively target malignant cells promises to mitigate side effects of conventional chemotherapy and to enable delivery of the unique drug combinations needed for personalized medicine. To realize this potential, however, targeted nanocarriers must simultaneously overcome multiple challenges, including specificity, stability and a high capacity for disparate cargos. Here we report porous nanoparticle-supported lipid bilayers (protocells) that synergistically combine properties of liposomes and nanoporous particles. Protocells modified with a targeting peptide that binds to human hepatocellular carcinoma exhibit a 10,000-fold greater affinity for human hepatocellular carcinoma than for hepatocytes, endothelial cells or immune cells. Furthermore, protocells can be loaded with combinations of therapeutic (drugs, small interfering RNA and toxins) and diagnostic (quantum dots) agents and modified to promote endosomal escape and nuclear accumulation of selected cargos. The enormous capacity of the high-surface-area nanoporous core combined with the enhanced targeting efficacy enabled by the fluid supported lipid bilayer enable a single protocell loaded with a drug cocktail to kill a drug-resistant human hepatocellular carcinoma cell, representing a 10(6)-fold improvement over comparable liposomes

Performance-based financing as a health system reform : mapping the key dimensions for monitoring and evaluation

Peer reviewedPublisher PD