Statistical considerations in a systematic review of proxy measures of clinical behaviour

Peer reviewedPublisher PD

Team climate and quality of care in primary health care: a review of studies using the Team Climate Inventory in the United Kingdom

<p>Abstract</p> <p>Background</p> <p>Attributes of teams could affect the quality of care delivered in primary care. The aim of this study was to systematically review studies conducted within the UK NHS primary care that have measured team climate using the Team Climate Inventory (TCI), and to describe, if reported, the relationship between the TCI and measures of quality of care.</p> <p>Findings</p> <p>The databases MEDLINE, EMBASE, and CINAHL were searched. The reference lists of included article were checked and one relevant journal was hand-searched. Eight papers were included. Three studies used a random sample; the remaining five used convenience or purposive samples. Six studies were cross sectional surveys, whilst two were before and after studies. Four studies examined the relationship between team climate and quality of care. Only one study found a positive association between team climate and higher quality care in patients with diabetes, positive patient satisfaction and self-reported effectiveness.</p> <p>Conclusion</p> <p>While the TCI has been used to measure team attributes in primary care settings in the UK it is difficult to generalise from these data. A small number of studies reported higher TCI scores being associated with only certain aspects of quality of care; reasons for the pattern of association are unclear. There are a number of methodological challenges to conducting such studies in routine service settings. Further research is needed in order to understand how to measure team functioning in relation to quality of care.</p

Can the collective intentions of individual professionals within healthcare teams predict the team's performance : developing methods and theory

Background: Within implementation research, using theory-based approaches to understanding the behaviours of healthcare professionals and the quality of care that they reflect and designing interventions to change them is being promoted. However, such approaches lead to a new range of methodological and theoretical challenges pre-eminent among which are how to appropriately relate predictors of individual's behaviour to measures of the behaviour of healthcare professionals .The aim of this study was to explore the relationship between the theory of planned behaviour proximal predictors of behaviour (intention and perceived behavioural control, or PBC) and practice level behaviour. This was done in the context of two clinical behaviours – statin prescription and foot examination – in the management of patients with diabetes mellitus in primary care. Scores for the predictor variables were aggregated over healthcare professionals using four methods: simple mean of all primary care team members' intention scores; highest intention score combined with PBC of the highest intender in the team; highest intention score combined with the highest PBC score in the team; the scores (on both constructs) of the team member identified as having primary responsibility for the clinical behaviour. Methods: Scores on theory-based cognitive variables were collected by postal questionnaire survey from a sample of primary care doctors and nurses from northeast England and the Netherlands. Data on two clinical behaviours were patient reported, and collected by postal questionnaire survey. Planned analyses explored the predictive value of various aggregations of intention and PBC in explaining variance in the behavioural data. Results: Across the two countries and two behaviours, responses were received from 37 to 78% of healthcare professionals in 57 to 93% practices; 51% (UK) and 69% (Netherlands) of patients surveyed responded. None of the aggregations of cognitions predicted statin prescription. The highest intention in the team (irrespective of PBC) was a significant predictor of foot examination Conclusion: These approaches to aggregating individually-administered measures may be a methodological advance of theoretical importance. Using simple means of individual-level measures to explain team-level behaviours is neither theoretically plausible nor empirically supported; the highest intention was both predictive and plausible. In studies aiming to understand the behaviours of teams of healthcare professionals in managing chronic diseases, some sort of aggregation of measures from individuals is necessary. This is not simply a methodological point, but a necessary step in advancing the theoretical and practical understanding of the processes that lead to implementation of clinical behaviours within healthcare teams

Factors predicting team climate, and its relationship with quality of care in general practice

<p>Abstract</p> <p>Background</p> <p>Quality of care in general practice may be affected by the team climate perceived by its health and non-health professionals. Better team working is thought to lead to higher effectiveness and quality of care. However, there is limited evidence available on what affects team functioning and its relationship with quality of care in general practice. This study aimed to explore individual and practice factors that were associated with team climate, and to explore the relationship between team climate and quality of care.</p> <p>Methods</p> <p>Cross sectional survey of a convenience sample of 14 general practices and their staff in South Tyneside in the northeast of England. Team climate was measured using the short version of Team Climate Inventory (TCI) questionnaire. Practice characteristics were collected during a structured interview with practice managers. Quality was measured using the practice Quality and Outcome Framework (QOF) scores.</p> <p>Results</p> <p>General Practitioners (GP) had a higher team climate scores compared to other professionals. Individual's gender and tenure, and number of GPs in the practice were significantly predictors of a higher team climate. There was no significant correlation between mean practice team climate scores (or subscales) with QOF scores.</p> <p>Conclusion</p> <p>The absence of a relationship between a measure of team climate and quality of care in this exploratory study may be due to a number of methodological problems. Further research is required to explore how to best measure team functioning and its relationship with quality of care.</p

Requirements for ethics committee review for studies submitted to Implementation Science

The requirement for ethics review of studies submitted to Implementation Science has been unclear. Therefore, in this editorial, we set out our requirements for ethics committee review of experimental and non-experimental studies. For any study that meets the criteria of human subject research (which includes research on healthcare providers), irrespective of study design, we will require proof of either satisfactory ethics committee review or of the granting of an official exemption or waiver

Explaining the effects of an intervention designed to promote evidence-based diabetes care : a theory-based process evaluation of a pragmatic cluster randomised controlled trial

Background The results of randomised controlled trials can be usefully illuminated by studies of the processes by which they achieve their effects. The Theory of Planned Behaviour (TPB) offers a framework for conducting such studies. This study used TPB to explore the observed effects in a pragmatic cluster randomised controlled trial of a structured recall and prompting intervention to increase evidence-based diabetes care that was conducted in three Primary Care Trusts in England. Methods All general practitioners and nurses in practices involved in the trial were sent a postal questionnaire at the end of the intervention period, based on the TPB (predictor variables: attitude; subjective norm; perceived behavioural control, or PBC). It focussed on three clinical behaviours recommended in diabetes care: measuring blood pressure; inspecting feet; and prescribing statins. Multivariate analyses of variance and multiple regression analyses were used to explore changes in cognitions and thereby better understand trial effects. Results Fifty-nine general medical practitioners and 53 practice nurses (intervention: n = 55, 41.98% of trial participants; control: n = 57, 38.26% of trial participants) completed the questionnaire. There were no differences between groups in mean scores for attitudes, subjective norms, PBC or intentions. Control group clinicians had 'normatively-driven' intentions (i.e., related to subjective norm scores), whereas intervention group clinicians had 'attitudinally-driven' intentions (i.e., related to attitude scores) for foot inspection and statin prescription. After controlling for effects of the three predictor variables, this group difference was significant for foot inspection behaviour (trial group × attitude interaction, beta = 0.72, p < 0.05; trial group × subjective norm interaction, beta = -0.65, p < 0.05). Conclusion Attitudinally-driven intentions are proposed to be more consistently translated into action than normatively-driven intentions. This proposition was supported by the findings, thus offering an interpretation of the trial effects. This analytic approach demonstrates the potential of the TPB to explain trial effects in terms of different relationships between variables rather than differences in mean scores. This study illustrates the use of theory-based process evaluation to uncover processes underlying change in implementation trials.European Union ReBEQI projec

Improving professional practice in the disclosure of a diagnosis of dementia : a modeling experiment to evaluate a theory-based intervention

The original publication is available at www.springerlink.com.Peer reviewedPostprin

Applying psychological theory to evidence-based clinical practice : identifying factors predictive of managing upper respiratory tract infections without antibiotics

Background: Psychological models can be used to understand and predict behaviour in a wide range of settings. However, they have not been consistently applied to health professional behaviours, and the contribution of differing theories is not clear. The aim of this study was to explore the usefulness of a range of psychological theories to predict health professional behaviour relating to management of upper respiratory tract infections (URTIs) without antibiotics. Methods: Psychological measures were collected by postal questionnaire survey from a random sample of general practitioners (GPs) in Scotland. The outcome measures were clinical behaviour (using antibiotic prescription rates as a proxy indicator), behavioural simulation (scenario-based decisions to managing URTI with or without antibiotics) and behavioural intention (general intention to managing URTI without antibiotics). Explanatory variables were the constructs within the following theories: Theory of Planned Behaviour (TPB), Social Cognitive Theory (SCT), Common Sense Self-Regulation Model (CS-SRM), Operant Learning Theory (OLT), Implementation Intention (II), Stage Model (SM), and knowledge (a non-theoretical construct). For each outcome measure, multiple regression analysis was used to examine the predictive value of each theoretical model individually. Following this 'theory level' analysis, a 'cross theory' analysis was conducted to investigate the combined predictive value of all significant individual constructs across theories. Results: All theories were tested, but only significant results are presented. When predicting behaviour, at the theory level, OLT explained 6% of the variance and, in a cross theory analysis, OLT 'evidence of habitual behaviour' also explained 6%. When predicting behavioural simulation, at the theory level, the proportion of variance explained was: TPB, 31%; SCT, 26%; II, 6%; OLT, 24%. GPs who reported having already decided to change their management to try to avoid the use of antibiotics made significantly fewer scenario-based decisions to prescribe. In the cross theory analysis, perceived behavioural control (TPB), evidence of habitual behaviour (OLT), CS-SRM cause (chance/bad luck), and intention entered the equation, together explaining 36% of the variance. When predicting intention, at the theory level, the proportion of variance explained was: TPB, 30%; SCT, 29%; CS-SRM 27%; OLT, 43%. GPs who reported that they had already decided to change their management to try to avoid the use of antibiotics had a significantly higher intention to manage URTIs without prescribing antibiotics. In the cross theory analysis, OLT evidence of habitual behaviour, TPB attitudes, risk perception, CS-SRM control by doctor, TPB perceived behavioural control and CS-SRM control by treatment entered the equation, together explaining 49% of the variance in intention. Cnclusion: The study provides evidence that psychological models can be useful in understanding and predicting clinical behaviour. Taking a theory-based approach enables the reation of a replicable methodology for identifying factors that predict clinical behaviour. Hwever, a number of conceptual and methodological challenges remain

Developing clinical practice guidelines: types of evidence and outcomes; values and economics, synthesis, grading, and presentation and deriving recommendations

Clinical practice guidelines are one of the foundations of efforts to improve healthcare. In 1999, we authored a paper about methods to develop guidelines. Since it was published, the methods of guideline development have progressed both in terms of methods and necessary procedures and the context for guideline development has changed with the emergence of guideline clearinghouses and large scale guideline production organisations (such as the UK National Institute for Health and Clinical Excellence). It therefore seems timely to, in a series of three articles, update and extend our earlier paper. In this second paper, we discuss issues of identifying and synthesizing evidence: deciding what type of evidence and outcomes to include in guidelines; integrating values into a guideline; incorporating economic considerations; synthesis, grading, and presentation of evidence; and moving from evidence to recommendations

The development of a theory-based intervention to promote appropriate disclosure of a diagnosis of dementia

Background: The development and description of interventions to change professional practice are often limited by the lack of an explicit theoretical and empirical basis. We set out to develop an intervention to promote appropriate disclosure of a diagnosis of dementia based on theoretical and empirical work. Methods: We identified three key disclosure behaviours: finding out what the patient already knows or suspects about their diagnosis; using the actual words 'dementia' or 'Alzheimer's disease' when talking to the patient; and exploring what the diagnosis means to the patient. We conducted a questionnaire survey of older peoples' mental health teams (MHTs) based upon theoretical constructs from the Theory of Planned Behaviour (TPB) and Social Cognitive Theory (SCT) and used the findings to identify factors that predicted mental health professionals' intentions to perform each behaviour. We selected behaviour change techniques likely to alter these factors. Results: The change techniques selected were: persuasive communication to target subjective norm; behavioural modelling and graded tasks to target self-efficacy; persuasive communication to target attitude towards the use of explicit terminology when talking to the patient; and behavioural modelling by MHTs to target perceived behavioural control for finding out what the patient already knows or suspects and exploring what the diagnosis means to the patient. We operationalised these behaviour change techniques using an interactive 'pen and paper' intervention designed to increase intentions to perform the three target behaviours. Conclusion : It is feasible to develop an intervention to change professional behaviour based upon theoretical models, empirical data and evidence based behaviour change techniques. The next step is to evaluate the effect of such an intervention on behavioural intention. We argue that this approach to development and reporting of interventions will contribute to the science of implementation by providing replicable interventions that illuminate the principles and processes underlying change.This project is funded by UK Medical Research Council, Grant reference number G0300999. Jeremy Grimshaw holds a Canada Research Chair in Health Knowledge Transfer and Uptake. Jill Francis is funded by the Chief Scientist Office of the Scottish Government Health Directorate. The views expressed in this study are those of the authors