Lessons from the evaluation of the UK's NHS R&D Implementation Methods Programme

Background: Concern about the effective use of research was a major factor behind the creation of the NHS R&D Programme in 1991. In 1994, an advisory group was established to identify research priorities in research implementation. The Implementation Methods Programme (IMP) flowed from this, and its commissioning group funded 36 projects. In 2000 responsibility for the programme passed to the National Co-ordinating Centre for NHS Service Delivery and Organisation R&D, which asked the Health Economics Research Group (HERG), Brunel University, to conduct an evaluation in 2002. By then most projects had been completed. This evaluation was intended to cover: the quality of outputs, lessons to be learnt about the communication strategy and the commissioning process, and the benefits from the projects. Methods: We adopted a wide range of quantitative and qualitative methods. They included: documentary analysis, interviews with key actors, questionnaires to the funded lead researchers, questionnaires to potential users, and desk analysis. Results: Quantitative assessment of outputs and dissemination revealed that the IMP funded useful research projects, some of which had considerable impact against the various categories in the HERG payback model, such as publications, further research, research training, impact on health policy, and clinical practice. Qualitative findings from interviews with advisory and commissioning group members indicated that when the IMP was established, implementation research was a relatively unexplored field. This was reflected in the understanding brought to their roles by members of the advisory and commissioning groups, in the way priorities for research were chosen and developed, and in how the research projects were commissioned. The ideological and methodological debates associated with these decisions have continued among those working in this field. The need for an effective communication strategy for the programme as a whole was particularly important. However, such a strategy was never developed, making it difficult to establish the general influence of the IMP as a programme. Conclusion: Our findings about the impact of the work funded, and the difficulties faced by those developing the IMP, have implications for the development of strategic programmes of research in general, as well as for the development of more effective research in this field

Illness Mapping: A time and cost effective method to estimate healthcare data needed to establish community-based health insurance

Background: Most healthcare spending in developing countries is private out-of-pocket. One explanation for low penetration of health insurance is that poorer individuals doubt their ability to enforce insurance contracts. Community-based health insurance schemes (CBHI) are a solution, but launching CBHI requires obtaining accurate local data on morbidity, healthcare utilization and other details to inform package design and pricing. We developed the "Illness Mapping" method (IM) for data collection (faster and cheaper than household surveys). Methods. IM is a modification of two non-interactive consensus group methods (Delphi and Nominal Group Technique) to operate as interactive methods. We elicited estimates from "Experts" in the target community on morbidity and healthcare utilization. Interaction between facilitator and experts became essential to bridge literacy constraints and to reach consensus.The study was conducted in Gaya District, Bihar (India) during April-June 2010. The intervention included the IM and a household survey (HHS). IM included 18 women's and 17 men's groups. The HHS was conducted in 50 villages with1,000 randomly selected households (6,656 individuals). Results: We found good agreement between the two methods on overall prevalence of illness (IM: 25.9% ±3.6; HHS: 31.4%) and on prevalence of acute (IM: 76.9%; HHS: 69.2%) and chronic illnesses (IM: 20.1%; HHS: 16.6%). We also found good agreement on incidence of deliveries (IM: 3.9% ±0.4; HHS: 3.9%), and on hospital deliveries (IM: 61.0%. ± 5.4; HHS: 51.4%). For hospitalizations, we obtained a lower estimate from the IM (1.1%) than from the HHS (2.6%). The IM required less time and less person-power than a household survey, which translate into reduced costs. Conclusions: We have shown that our Illness Mapping method can be carried out at lower financial and human cost for sourcing essential local data, at acceptably accurate levels. In view of the good fit of results obtained, we assume that the method could work elsewhere as well

A922 Sequential measurement of 1 hour creatinine clearance (1-CRCL) in critically ill patients at risk of acute kidney injury (AKI)

Meeting abstrac

Hospital competition, resource allocation and quality of care

BACKGROUND: A variety of approaches have been used to contain escalating hospital costs. One approach is intensifying price competition. The increase in price based competition, which changes the incentives hospitals face, coupled with the fact that consumers can more easily evaluate the quality of hotel services compared with the quality of clinical care, may lead hospitals to allocate more resources into hotel rather than clinical services. METHODS: To test this hypothesis we studied hospitals in California in 1982 and 1989, comparing resource allocations prior to and following selective contracting, a period during which the focus of competition changed from quality to price. We estimated the relationship between clinical outcomes, measured as risk-adjusted-mortality rates, and resources. RESULTS: In 1989, higher competition was associated with lower clinical expenditures levels compared with 1982. The trend was stronger for non-profit hospitals. Lower clinical resource use was associated with worse risk adjusted mortality outcomes. CONCLUSIONS: This study raises concerns that cost reductions may be associated with increased mortality

An Investigation of Nurses' Knowledge, Attitudes, and Practices Regarding Disinfection Procedures in Italy

<p>Abstract</p> <p>Background</p> <p>This study assessed the level of knowledge, attitudes, and practice regarding disinfection procedures among nurses in Italian hospitals.</p> <p>Methods</p> <p>A face-to-face interview gathered the following information: demographic and practice characteristics; knowledge about the healthcare-associated infections (HAIs) and the disinfection practices; attitudes towards the utility of guidelines/protocols and perception of the risks of acquiring/transmitting HAIs; compliance with antisepsis/disinfection procedures; and sources of information.</p> <p>Results</p> <p>Only 29% acknowledged that urinary and respiratory tract infections were the two most common HAIs and this knowledge was significantly higher in those with a higher level of education. Attitudes towards the utility of guidelines/protocols for disinfection procedures showed a mean score of 9.1. The results of the linear regression model indicated a more positive attitude in female nurses, in those with a lower number of years of activity, and in those needing additional information about disinfection procedures. Nurses with higher educational level and with a higher perception of risk of transmitting an infectious disease while working were more likely to perform appropriate antisepsis of the surgical wound and handwashing before and after medication.</p> <p>Conclusions</p> <p>Plan of successful prevention activities about HAIs and provide pointers to help optimize disinfection procedures and infection prophylaxis and management are needed.</p

Measuring physiotherapy performance in patients with osteoarthritis of the knee: A prospective study

<p>Abstract</p> <p>Background</p> <p>Patients with knee osteoarthritis [OA] are commonly treated by physiotherapists in primary care. Measuring physiotherapy performance is important before developing strategies to improve quality. The purpose of this study was to measure physiotherapy performance in patients with knee OA by comparing clinical practice to evidence from systematic reviews.</p> <p>Methods</p> <p>We developed a data-collection form and invited all private practitioners in Norway [n = 2798] to prospectively collect data on the management of one patient with knee OA through 12 treatment session. Actual practice was compared to findings from an overview of systematic reviews summarising the effect of physiotherapy interventions for knee OA.</p> <p>Results</p> <p>A total of 297 physiotherapists reported their management for patients with knee OA. Exercise was the most common treatment used, provided by 98% of the physiotherapists. There is evidence of high quality that exercise reduces pain and improves function in patients with knee OA. Thirty-five percent of physiotherapists used acupuncture, low-level laser therapy or transcutaneous electrical nerve stimulation. There is evidence of moderate quality that these treatments reduce pain in knee OA. Patient education, supported by moderate quality evidence for improving psychological outcomes, was provided by 68%. Physiotherapists used a median of four different treatment modalities for each patient. They offered many treatment modalities based on evidence of low quality or without evidence from systematic reviews, e.g. traction and mobilisation, massage and stretching.</p> <p>Conclusion</p> <p>Exercise was used in almost all treatment sessions in the management of knee OA. This practice is desirable since it is supported by high quality evidence. Physiotherapists also provide several other treatment modalities based on evidence of moderate or low quality, or no evidence from systematic reviews. Ways to promote high quality evidence into physiotherapy practice should be identified and evaluated.</p

QUERI and implementation research: Emerging from adolescence into adulthood: QUERI Series

The Quality Enhancement Research Initiative (QUERI) program and implementation research have both come of age in the 10 years since QUERI was established. Looking forward, if QUERI and the field of implementation science are to mature successfully, we will need to address a series of challenges. First, we need to more clearly demonstrate how applying principles of implementation science leads to more effective implementation and communicate those lessons to our partners and funders. Second, we will need to engage in the ongoing debate over methodological standards in quality improvement and implementation research. Third, a program like QUERI needs to become more relevant to the daily decisions of key stakeholders. Fourth, if we hope to sustain interest in implementation science, we will need to demonstrate the business case for more effective implementation. Fifth, we need to think creatively about how to nurture the next generations of implementation researchers and front-line "connectors," who are critical for accelerating implementation. Finally, we need to strengthen the connections between implementation research and the other operational and research activities that influence change in healthcare systems

SUPPORT Tools for Evidence-informed Policymaking in health 6: Using research evidence to address how an option will be implemented

This article is part of a series written for people responsible for making decisions about health policies and programmes and for those who support these decision makers

Prioritization strategies in clinical practice guidelines development: a pilot study

Objective: Few methodological studies address the prioritization of clinical topics for the development of Clinical Practice Guidelines (CPGs). The aim of this study was to validate a methodology for Priority Determination of Topics (PDT) of CPGs. Methods and results: Firstly, we developed an instrument for PDT with 41 criteria that were grouped under 10 domains, based on a comprehensive systematic search. Secondly, we performed a survey of stakeholders involved in CPGs development, and end users of guidelines, using the instrument. Thirdly, a pilot testing of the PDT procedure was performed in order to choose 10 guideline topics among 34 proposed projects; using a multicriteria analysis approach, we validated a mechanism that followed five stages: determination of the composition of groups, item/domain scoring, weights determination, quality of the information used to support judgments, and finally, topic selection. Participants first scored the importance of each domain, after which four different weighting procedures were calculated (including the survey results). The process of weighting was determined by correlating the data between them. We also reported the quality of evidence used for PDT. Finally, we provided a qualitative analysis of the process. The main domains used to support judgement, having higher quality scores and weightings, were feasibility, disease burden, implementation and information needs. Other important domains suc