Decision‐making by the NICE Interventional Procedures Advisory Committee

Background This study explored the evidence base for recommendations by the National Institute of Health and Care Excellence (NICE) Interventional Procedures Advisory Committee, the only NICE committee not to consider cost. The four potential recommendations are: Standard Arrangements (can be performed as routine practice in the NHS); Special Arrangements (can be done under certain conditions); Research Only; and Do Not Do. Methods Quantitative content analysis of data extracted from all published Interventional Procedure Guidance (IPG) for 2003–2018 (n = 496) was undertaken. All data were extracted independently by two researchers; disagreements were clarified by consensus. Data were tabulated, descriptive statistics produced, and regression analyses performed. Results The proportion of IPGs by recommendation was: 50·0 per cent Standard Arrangements; 37·2 per cent Special Arrangements; 11·1 per cent Research Only; and 1·6 per cent Do Not Do. There was a clear trend over time: the proportion of recommendations for Standard Arrangements decreased, whereas the evidence threshold increased. Adjusted mean numbers of patients in the evidence base by recommendation type were: Standard, 4867; Special, 709; Research Only, 386. Regression analyses confirmed that the year of recommendation, numbers of patients and levels of evidence all affected the likely recommendation. Conclusion This study suggests that the likelihood of achieving the most positive recommendation (Standard Arrangements) is decreasing, and that this is most likely due to evidential requirements becoming more demanding. These findings are distinct from those reported for other NICE committees, for which the cost and statistical superiority of new therapies are among the drivers of recommendations

Prioritization strategies in clinical practice guidelines development: a pilot study

Objective: Few methodological studies address the prioritization of clinical topics for the development of Clinical Practice Guidelines (CPGs). The aim of this study was to validate a methodology for Priority Determination of Topics (PDT) of CPGs. Methods and results: Firstly, we developed an instrument for PDT with 41 criteria that were grouped under 10 domains, based on a comprehensive systematic search. Secondly, we performed a survey of stakeholders involved in CPGs development, and end users of guidelines, using the instrument. Thirdly, a pilot testing of the PDT procedure was performed in order to choose 10 guideline topics among 34 proposed projects; using a multicriteria analysis approach, we validated a mechanism that followed five stages: determination of the composition of groups, item/domain scoring, weights determination, quality of the information used to support judgments, and finally, topic selection. Participants first scored the importance of each domain, after which four different weighting procedures were calculated (including the survey results). The process of weighting was determined by correlating the data between them. We also reported the quality of evidence used for PDT. Finally, we provided a qualitative analysis of the process. The main domains used to support judgement, having higher quality scores and weightings, were feasibility, disease burden, implementation and information needs. Other important domains suc

The RESPECT Study for consensus on global bereavement care after stillbirth.

OBJECTIVE: To develop global consensus on a set of evidence-based core principles for bereavement care after stillbirth. METHODS: A modified policy-Delphi methodology was used to consult international stakeholders and healthcare workers with experience in stillbirth between September 2017 and October 2018. Five sequential rounds involved two expert stakeholder meetings and three internet-based surveys, including a global internet-based survey targeted at healthcare workers in a wide range of settings. RESULTS: Initially, 23 expert stakeholders considered 43 evidence-based themes derived from systematic reviews, identifying 10 core principles. The global survey received 236 responses from participants in 26 countries, after which nine principles met a priori criteria for inclusion. The final stakeholder meeting and internet-based survey of all participants confirmed consensus on eight core principles. Highest quality bereavement care should be enabled through training of healthcare staff to reduce stigma and establish respectful care, including acknowledgement and support for grief responses, and provision for physical and psychologic needs. Women and families should be supported to make informed choices, including those concerning their future reproductive health. CONCLUSION: Consensus was established for eight principles for stillbirth bereavement care. Further work should explore implementation and involve the voices of women and families globally

Building capacity for evidence informed decision making in public health: a case study of organizational change

<p>Abstract</p> <p>Background</p> <p>Core competencies for public health in Canada require proficiency in evidence informed decision making (EIDM). However, decision makers often lack access to information, many workers lack knowledge and skills to conduct systematic literature reviews, and public health settings typically lack infrastructure to support EIDM activities. This research was conducted to explore and describe critical factors and dynamics in the early implementation of one public health unit's strategic initiative to develop capacity to make EIDM standard practice.</p> <p>Methods</p> <p>This qualitative case study was conducted in one public health unit in Ontario, Canada between 2008 and 2010. In-depth information was gathered from two sets of semi-structured interviews and focus groups (n = 27) with 70 members of the health unit, and through a review of 137 documents. Thematic analysis was used to code the key informant and document data.</p> <p>Results</p> <p>The critical factors and dynamics for building EIDM capacity at an organizational level included: clear vision and strong leadership, workforce and skills development, ability to access research (library services), fiscal investments, acquisition and development of technological resources, a knowledge management strategy, effective communication, a receptive organizational culture, and a focus on change management.</p> <p>Conclusion</p> <p>With leadership, planning, commitment and substantial investments, a public health department has made significant progress, within the first two years of a 10-year initiative, towards achieving its goal of becoming an evidence informed decision making organization.</p

Critical pathways for the management of preeclampsia and severe preeclampsia in institutionalised health care settings

BACKGROUND: Preeclampsia is a complex disease in which several providers should interact continuously and in a coordinated manner to provide proper health care. However, standardizing criteria to treat patients with preeclampsia is problematical and severe flaws have been observed in the management of the disease. This paper describes a set of critical pathways (CPs) designed to provide uniform criteria for clinical decision-making at different levels of care of pregnant patients with preeclampsia or severe preeclampsia. METHODS: Clinicians and researchers from different countries participated in the construction of the CPs. The CPs were developed using the following steps: a) Definition of the conceptual framework; b) Identification of potential users: primary care physicians and maternal and child health nurses in ambulatory settings; ob/gyn and intensive care physicians in secondary and tertiary care levels. c) Structural development. RESULTS: The CPs address the following care processes: 1. Screening for preeclampsia, risk assessment and classification according to the level of risk. 2. Management of preeclampsia at primary care clinics. 3. Evaluation and management of preeclampsia at secondary and tertiary care hospitals: 4. Criteria for clinical decision-making between conservative management and expedited delivery of patients with severe preeclampsia. CONCLUSION: Since preeclampsia continues to be one of the primary causes of maternal deaths and morbidity worldwide, the expected impact of these CPs is the contribution to improving health care quality in both developed and developing countries. The CPs are designed to be applied in a complex health care system, where different physicians and health providers at different levels of care should interact continuously and in a coordinated manner to provide care to all preeclamptic women. Although the CPs were developed using evidence-based criteria, they could require careful evaluation and remodelling according to each system's demands. Additionally, the CPs need to be tested in large-scale, multi-level studies in order to thoroughly examine and evaluate their efficacy and effectiveness

Is computer aided detection (CAD) cost effective in screening mammography? A model based on the CADET II study

BACKGROUND: Single reading with computer aided detection (CAD) is an alternative to double reading for detecting cancer in screening mammograms. The aim of this study is to investigate whether the use of a single reader with CAD is more cost-effective than double reading. METHODS: Based on data from the CADET II study, the cost-effectiveness of single reading with CAD versus double reading was measured in terms of cost per cancer detected. Cost (Pound (£), year 2007/08) of single reading with CAD versus double reading was estimated assuming a health and social service perspective and a 7 year time horizon. As the equipment cost varies according to the unit size a separate analysis was conducted for high, average and low volume screening units. One-way sensitivity analyses were performed by varying the reading time, equipment and assessment cost, recall rate and reader qualification. RESULTS: CAD is cost increasing for all sizes of screening unit. The introduction of CAD is cost-increasing compared to double reading because the cost of CAD equipment, staff training and the higher assessment cost associated with CAD are greater than the saving in reading costs. The introduction of single reading with CAD, in place of double reading, would produce an additional cost of £227 and £253 per 1,000 women screened in high and average volume units respectively. In low volume screening units, the high cost of purchasing the equipment will results in an additional cost of £590 per 1,000 women screened.One-way sensitivity analysis showed that the factors having the greatest effect on the cost-effectiveness of CAD with single reading compared with double reading were the reading time and the reader's professional qualification (radiologist versus advanced practitioner). CONCLUSIONS: Without improvements in CAD effectiveness (e.g. a decrease in the recall rate) CAD is unlikely to be a cost effective alternative to double reading for mammography screening in UK. This study provides updated estimates of CAD costs in a full-field digital system and assessment cost for women who are re-called after initial screening. However, the model is highly sensitive to various parameters e.g. reading time, reader qualification, and equipment cost

Evidence for models of diagnostic service provision in the community: literature mapping exercise and focused rapid reviews

Background Current NHS policy favours the expansion of diagnostic testing services in community and primary care settings. Objectives Our objectives were to identify current models of community diagnostic services in the UK and internationally and to assess the evidence for quality, safety and clinical effectiveness of such services. We were also interested in whether or not there is any evidence to support a broader range of diagnostic tests being provided in the community. Review methods We performed an initial broad literature mapping exercise to assess the quantity and nature of the published research evidence. The results were used to inform selection of three areas for investigation in more detail. We chose to perform focused reviews on logistics of diagnostic modalities in primary care (because the relevant issues differ widely between different types of test); diagnostic ultrasound (a key diagnostic technology affected by developments in equipment); and a diagnostic pathway (assessment of breathlessness) typically delivered wholly or partly in primary care/community settings. Databases and other sources searched, and search dates, were decided individually for each review. Quantitative and qualitative systematic reviews and primary studies of any design were eligible for inclusion. Results We identified seven main models of service that are delivered in primary care/community settings and in most cases with the possible involvement of community/primary care staff. Not all of these models are relevant to all types of diagnostic test. Overall, the evidence base for community- and primary care-based diagnostic services was limited, with very few controlled studies comparing different models of service. We found evidence from different settings that these services can reduce referrals to secondary care and allow more patients to be managed in primary care, but the quality of the research was generally poor. Evidence on the quality (including diagnostic accuracy and appropriateness of test ordering) and safety of such services was mixed. Conclusions In the absence of clear evidence of superior clinical effectiveness and cost-effectiveness, the expansion of community-based services appears to be driven by other factors. These include policies to encourage moving services out of hospitals; the promise of reduced waiting times for diagnosis; the availability of a wider range of suitable tests and/or cheaper, more user-friendly equipment; and the ability of commercial providers to bid for NHS contracts. However, service development also faces a number of barriers, including issues related to staffing, training, governance and quality control. Limitations We have not attempted to cover all types of diagnostic technology in equal depth. Time and staff resources constrained our ability to carry out review processes in duplicate. Research in this field is limited by the difficulty of obtaining, from publicly available sources, up-to-date information about what models of service are commissioned, where and from which providers. Future work There is a need for research to compare the outcomes of different service models using robust study designs. Comparisons of ‘true’ community-based services with secondary care-based open-access services and rapid access clinics would be particularly valuable. There are specific needs for economic evaluations and for studies that incorporate effects on the wider health system. There appears to be no easy way of identifying what services are being commissioned from whom and keeping up with local evaluations of new services, suggesting a need to improve the availability of information in this area. Funding The National Institute for Health Research Health Services and Delivery Research programme

Research utilisation and knowledge mobilisation in the commissioning and joint planning of public health interventions to reduce alcohol-related harms: a qualitative case design using a cocreation approach

Background: Considerable resources are spent on research to establish what works to improve the nation’s health. If the findings from this research are used, better health outcomes can follow, but we know that these findings are not always used. In public health, evidence of what works may not ‘fit’ everywhere, making it difficult to know what to do locally. Research suggests that evidence use is a social and dynamic process, not a simple application of research findings. It is unclear whether it is easier to get evidence used via a legal contracting process or within unified organisational arrangements with shared responsibilities. Objective: To work in cocreation with research participants to investigate how research is utilised and knowledge mobilised in the commissioning and planning of public health services to reduce alcohol-related harms. Design, setting and participants: Two in-depth, largely qualitative, cross-comparison case studies were undertaken to compare real-time research utilisation in commissioning across a purchaser–provider split (England) and in joint planning under unified organisational arrangements (Scotland) to reduce alcohol-related harms. Using an overarching realist approach and working in cocreation, case study partners (stakeholders in the process) picked the topic and helped to interpret the findings. In Scotland, the topic picked was licensing; in England, it was reducing maternal alcohol consumption. Methods: Sixty-nine interviews, two focus groups, 14 observations of decision-making meetings, two local feedback workshops (n = 23 and n = 15) and one national workshop (n = 10) were undertaken. A questionnaire (n = 73) using a Behaviourally Anchored Rating Scale was issued to test the transferability of the 10 main findings. Given the small numbers, care must be taken in interpreting the findings. Findings: Not all practitioners have the time, skills or interest to work in cocreation, but when there was collaboration, much was learned. Evidence included professional and tacit knowledge, and anecdotes, as well as findings from rigorous research designs. It was difficult to identify evidence in use and decisions were sometimes progressed in informal ways and in places we did not get to see. There are few formal evidence entry points. Evidence (prevalence and trends in public health issues) enters the process and is embedded in strategic documents to set priorities, but local data were collected in both sites to provide actionable messages (sometimes replicating the evidence base). Conclusions: Two mid-range theories explain the findings. If evidence has saliency (relates to ‘here and now’ as opposed to ‘there and then’) and immediacy (short, presented verbally or visually and with emotional appeal) it is more likely to be used in both settings. A second mid-range theory explains how differing tensions pull and compete as feasible and acceptable local solutions are pursued across stakeholders. Answering what works depends on answering for whom and where simultaneously to find workable (if temporary) ‘blends’. Gaining this agreement across stakeholders appeared more difficult across the purchaser–provider split, because opportunities to interact were curtailed; however, more research is needed. Funding: This study was funded by the Health Services and Delivery Research programme of the National Institute for Health Research