Are there valid proxy measures of clinical behaviour?

Background: Accurate measures of health professionals' clinical practice are critically important to guide health policy decisions, as well as for professional self-evaluation and for research-based investigation of clinical practice and process of care. It is often not feasible or ethical to measure behaviour through direct observation, and rigorous behavioural measures are difficult and costly to use. The aim of this review was to identify the current evidence relating to the relationships between proxy measures and direct measures of clinical behaviour. In particular, the accuracy of medical record review, clinician self-reported and patient-reported behaviour was assessed relative to directly observed behaviour. Methods: We searched: PsycINFO; MEDLINE; EMBASE; CINAHL; Cochrane Central Register of Controlled Trials; science/social science citation index; Current contents (social & behavioural med/clinical med); ISI conference proceedings; and Index to Theses. Inclusion criteria: empirical, quantitative studies; and examining clinical behaviours. An independent, direct measure of behaviour (by standardised patient, other trained observer or by video/audio recording) was considered the 'gold standard' for comparison. Proxy measures of behaviour included: retrospective self-report; patient-report; or chart-review. All titles, abstracts, and full text articles retrieved by electronic searching were screened for inclusion and abstracted independently by two reviewers. Disagreements were resolved by discussion with a third reviewer where necessary. Results: Fifteen reports originating from 11 studies met the inclusion criteria. The method of direct measurement was by standardised patient in six reports, trained observer in three reports, and audio/video recording in six reports. Multiple proxy measures of behaviour were compared in five of 15 reports. Only four of 15 reports used appropriate statistical methods to compare measures. Some direct measures failed to meet our validity criteria. The accuracy of patient report and chart review as proxy measures varied considerably across a wide range of clinical actions. The evidence for clinician self-report was inconclusive. Conclusion: Valid measures of clinical behaviour are of fundamental importance to accurately identify gaps in care delivery, improve quality of care, and ultimately to improve patient care. However, the evidence base for three commonly used proxy measures of clinicians' behaviour is very limited. Further research is needed to better establish the methods of development, application, and analysis for a range of both direct and proxy measures of behaviour

Perceived difficulty and appropriateness of decision making by General Practitioners: a systematic review of scenario studies

Background: Health-care quality in primary care depends largely on the appropriateness of General Practitioners’ (GPs; Primary Care or Family Physicians) decisions, which may be influenced by how difficult they perceive decisions to be. Patient scenarios (clinical or case vignettes) are widely used to investigate GPs’ decision making. This review aimed to identify the extent to which perceived decision difficulty, decision appropriateness, and their relationship have been assessed in scenario studies of GPs’ decision making; identify possible determinants of difficulty and appropriateness; and investigate the relationship between difficulty and appropriateness. Methods: MEDLINE, EMBASE, PsycINFO, the Cochrane Library and Web of Science were searched for scenario studies of GPs’ decision making. One author completed article screening. Ten percent of titles and abstracts were checked by an independent volunteer, resulting in 91% agreement. Data on decision difficulty and appropriateness were extracted by one author and descriptively synthesised. Chi-squared tests were used to explore associations between decision appropriateness, decision type and decision appropriateness assessment method. Results: Of 152 included studies, 66 assessed decision appropriateness and five assessed perceived difficulty. While no studies assessed the relationship between perceived difficulty and appropriateness, one study objectively varied the difficulty of the scenarios and assessed the relationship between a measure of objective difficulty and appropriateness. Across 38 studies where calculations were possible, 62% of the decisions were appropriate as defined by the appropriateness standard used. Chi-squared tests identified statistically significant associations between decision appropriateness, decision type and decision appropriateness assessment method. Findings suggested a negative relationship between decision difficulty and appropriateness, while interventions may have the potential to reduce perceived difficulty. Conclusions: Scenario-based research into GPs’ decisions rarely considers the relationship between perceived decision difficulty and decision appropriateness. The links between these decisional components require further investigation

Healthcare professionals' intentions to use wiki-based reminders to promote best practices in trauma care: a survey protocol

<p>Abstract</p> <p>Background</p> <p>Healthcare professionals are increasingly using wikis as collaborative tools to create, synthesize, share, and disseminate knowledge in healthcare. Because wikis depend on collaborators to keep content up-to-date, healthcare professionals who use wikis must adopt behaviors that foster this collaboration. This protocol describes the methods we will use to develop and test the metrological qualities of a questionnaire that will assess healthcare professionals' intentions and the determinants of those intentions to use wiki-based reminders that promote best practices in trauma care.</p> <p>Methods</p> <p>Using the Theory of Planned Behavior, we will conduct semi-structured interviews of healthcare professionals to identify salient beliefs that may affect their future use of wikis. These beliefs will inform our questionnaire on intended behavior. A test-retest of the survey will verify the questionnaire's stability over time. We will interview 50 healthcare professionals (25 physicians and 25 allied health professionals) working in the emergency departments of three trauma centers in Quebec, Canada. We will analyze the content of the interviews and construct and pilot a questionnaire. We will then test the revised questionnaire with 30 healthcare professionals (15 physicians and 15 allied health professionals) and retest it two weeks later. We will assess the internal consistency of the questionnaire constructs using Cronbach's alpha coefficients and determine their stability with the intra-class correlation (ICC).</p> <p>Discussion</p> <p>To our knowledge, this study will be the first to develop and test a theory-based survey that measures healthcare professionals' intentions to use a wiki-based intervention. This study will identify professionals' salient beliefs qualitatively and will quantify the psychometric capacities of the questionnaire based on those beliefs.</p

Evaluation of a Theory-Informed Implementation Intervention for the Management of Acute Low Back Pain in General Medical Practice: The IMPLEMENT Cluster Randomised Trial

Introduction: This cluster randomised trial evaluated an intervention to decrease x-ray referrals and increase giving advice to stay active for people with acute low back pain (LBP) in general practice. Methods: General practices were randomised to either access to a guideline for acute LBP (control) or facilitated interactive workshops (intervention). We measured behavioural predictors (e.g. knowledge, attitudes and intentions) and fear avoidance beliefs. We were unable to recruit sufficient patients to measure our original primary outcomes so we introduced other outcomes measured at the general practitioner (GP) level: behavioural simulation (clinical decision about vignettes) and rates of x-ray and CT-scan (medical administrative data). All those not involved in the delivery of the intervention were blinded to allocation. Results: 47 practices (53 GPs) were randomised to the control and 45 practices (59 GPs) to the intervention. The number of GPs available for analysis at 12 months varied by outcome due to missing confounder information; a minimum of 38 GPs were available from the intervention group, and a minimum of 40 GPs from the control group. For the behavioural constructs, although effect estimates were small, the intervention group GPs had greater intention of practising consistent with the guideline for the clinical behaviour of x-ray referral. For behavioural simulation, intervention group GPs were more likely to adhere to guideline recommendations about x-ray (OR 1.76, 95%CI 1.01, 3.05) and more likely to give advice to stay active (OR 4.49, 95%CI 1.90 to 10.60). Imaging referral was not statistically significantly different between groups and the potential importance of effects was unclear; rate ratio 0.87 (95%CI 0.68, 1.10) for x-ray or CT-scan. Conclusions: The intervention led to small changes in GP intention to practice in a manner that is consistent with an evidence-based guideline, but it did not result in statistically significant changes in actual behaviour. Trial Registration: Australian New Zealand Clinical Trials Registry ACTRN01260600009853

The Philosophy of Theism.

n/