Use of Evidence-informed Deliberative Processes by Health Technology Assessment Agencies Around The Globe

Background: Evidence-informed deliberative processes (EDPs) were recently introduced to guide health technology assessment (HTA) agencies to improve their processes towards more legitimate decision-making. The EDP framework provides guidance that covers the HTA process, ie, contextual factors, installation of an appraisal committee, selecting health technologies and criteria, assessment, appraisal, and communication and appeal. The aims of this study were to identify the level of use of EDPs by HTA agencies, identify their needs for guidance, and to learn about best practices.Methods: A questionnaire for an online survey was developed based on the EDP framework, consisting of elements that reflect each part of the framework. The survey was sent to members of the International Network of Agencies for Health Technology Assessment (INAHTA). Two weeks following the invitation, a reminder was sent. The data collection took place between September-December 2018. Results: Contact persons from 27 member agencies filled out the survey (response rate: 54%), of which 25 completed all questions. We found that contextual factors to support HTA development and the critical elements regarding conducting and reporting on HTA are overall in place. Respondents indicated that guidance was needed for specific elements related to selecting technologies and criteria, appraisal, and communication and appeal. With regard to best practices, the Canadian Agency for Drugs and Technologies and the National Institute for Health and Care Excellence (NICE, UK) were most often mentioned. Conclusion: This is the first survey among HTA agencies regarding the use of EDPs and provides useful information for further developing a practical guide for HTA agencies around the globe. The results could support HTA agencies in improving their processes towards more legitimate decision-making, as they could serve as a baseline measurement for future monitoring and evaluation

Ethics in HTA: Examining the “Need for Expansion”

The article by Daniels and colleagues on expanding the scope of health technology assessment (HTA) to embrace ethical analysis has received endorsement and criticism from commentators in this journal. Referring to this debate, we examine in this article the extent and locus of ethical analysis in HTA processes. An expansion/no-expansion framing of HTA is, in our view, not very fruitful. We argue that meaningfulness and relevance to the needs of the population are what should determine the extent of ethics in HTA. Once ‘relevance’ is the guiding principle, engaging in ethical analysis becomes inevitable as values are all over the place in HTA, also in how assessors frame research questions. We also challenge dividing the locus of ethical analysis into assessment and appraisal as this would detach HTA from its purpose, ie, supporting legitimate decision-making. Ethical analysis should therefore be considered integral to the HTA process

Role of health technology assessment in pharmaceutical market access in developed countries

Introduction and use of a health technology in a health care setting has clinical, economic, as well as organizational, social-cultural, legal and ethical impacts. Health Technology Assessment (HTA) is a multidisciplinary field that addresses these impacts, considering healthcare context as well as available alternatives. HTA mainly aims to inform policy and clinical decision making. While systematically evaluating the effects of the health technology, HTA addresses direct and intended effects as well as the indirect and unintended effects. It is a multidisciplinary field with well-developed systematic processes and method

Assessing the impact of health technology assessment in the Netherlands

Copyright © Cambridge University Press 2008Objectives: Investments in health research should lead to improvements in health and health care. This is also the remit of the main HTA program in the Netherlands. The aims of this study were to assess whether the results of this program have led to such improvements and to analyze how best to assess the impact from health research.Methods: We assessed the impact of individual HTA projects by adapting the "payback framework" developed in the United Kingdom. We conducted dossier reviews and sent a survey to principal investigators of forty-three projects awarded between 2000 and 2003. We then provided an overview of documented output and outcome that was assessed by ten HTA experts using a scoring method. Finally, we conducted five case studies using information from additional dossier review and semistructured key informant interviews.Results: The findings confirm that the payback framework is a useful approach to assess the impact of HTA projects. We identified over 101 peer reviewed papers, more than twenty-five PhDs, citations of research in guidelines (six projects), and implementation of new treatment strategies (eleven projects). The case studies provided greater depth and understanding about the levels of impact that arise and why and how they have been achieved.Conclusions: It is generally too early to determine whether the HTA program led to actual changes in healthcare policy and practice. However, the results can be used as a baseline measurement for future evaluation and can help funding organizations or HTA agencies consider how to assess impact, possibly routinely. This, in turn, could help inform research strategies and justify expenditure for health research.This research is funded by ZonMw, the Netherlands organization for health research and development (project 945-15-001)

REVEALING AND ACKNOWLEDGING VALUE JUDGMENTS IN HEALTH TECHNOLOGY ASSESSMENT

Background: Although value issues are increasingly addressed in health technology assessment (HTA) reports, HTA is still seen as a scientific endeavor and sometimes contrasted with value judgments, which are considered arbitrary and unscientific. This article aims at illustrating how numerous value judgments are at play in the HTA process, and why it is important to acknowledge and address value judgments. Methods: A panel of experts involved in HTA, including ethicists, scrutinized the HTA process with regard to implicit value judgments. It was analyzed whether these value judgments undermine the accountability of HTA results. The final results were obtained after several rounds of deliberation. Results: Value judgments are identified before the assessment when identifying and selecting health technologies to assess, and as part of assessment. They are at play in the processes of deciding on how to select, frame, present, summarize or synthesize information in systematic reviews. Also, in economic analysis, value judgments are ubiquitous. Addressing the ethical, legal, and social issues of a given health technology involves moral, legal, and social value judgments by definition. So do the appraisal and the decision-making process. Conclusions: HTA by and large is a process of value judgments. However, the preponderance of value judgments does not render HTA biased or flawed. On the contrary they are basic elements of the HTA process. Acknowledging and explicitly addressing value judgments may improve the accountability of HT

Guidance on the use of logic models in health technology assessments of complex interventions

Challenges in assessments of health technologies In recent years there have been major advances in the development of health technology assessment (HTA). However, HTA still has certain limitations when assessing technologies, which fi are complex, i.e. consist of several interacting components, target different groups or organisational levels, have multiple and variable outcomes, and/or permit a certain degree of flexibility or tailoring; fi are context-dependent, with HTA usually focusing on the technology rather than on the system within which it is used; fi perform differently depending on the way they are implemented; and/or fi have distinct effects on different individuals. Logic models are one important means of conceptualising and handling complexity in HTAs or systematic reviews (SRs) of complex technologies, as well as integrating the findings of multi-component HTAs. A logic model is described as “… a graphic description of a system … designed to identify important elements and relationships within that system”. When evaluating complex health technologies, logic models can serve an instrumental purpose at every stage of the HTA/SR process, from scoping the topic of the HTA/SR, including formulating the question and defining the intervention; conducting the HTA/SR; interpreting results and making the HTA/SR relevant for decision makers to implement in policy and practice. Purpose and scope of the guidance This guidance is targeted at commissioners, producers and users of guidelines, HTAs and SRs with an interest in using logic models as an overarching framework for their work. It aims to make the use of logic models as straightforward as possible by facilitating the systematic identification or development as well as utilisation of different types and sub-types of logic models. In principle, logic models are a useful tool in any kind of SR or HTA, as they aid with the conceptualisation of the intervention and the review question. This is particularly useful for complex technologies, where conceptualising the intervention and its implementation within a system is critical. In addition, logic models can enhance communication within the HTA/SR team and with relevant stakeholders. Three types of logic model are described: With a priori logic models the logic model is specified upfront and remains unchanged during the HTA/SR process. With iterative logic models the logic model is subject to continual modification throughout the course of an HTA/SR. The staged logic model harnesses the strengths of both a priori and iterative approaches by pre-specifying revision points at which major data inputs are anticipated. In | 6 addition, two subtypes are identified, namely logic models that seek to represent structure (system-based) and those that focus on processes or activities (process-orientated). This guidance offers direction on how to choose between distinct types and sub-types of logic models, describes each logic model type and its application in detail, and provides templates for getting started with the development of an HTA/SR-specific logic model. Development of the guidance This guidance was informed by a combination of (i) systematic searches for published examples of logic models supplemented by purposive sampling of iterative logic modelling approaches; (ii) searches for existing guidance on the use of logic models in primary research, SRs and HTAs; (iii) development of two draft templates for system-based and process-orientated logic models in an iterative process within the research team and in consultation with external methodological experts; and (iv) application of these draft templates in multiple SRs and one HTA of different complex health technologies covering technical, educational and policy interventions in environmental health, e-learning for health professionals and models of palliative care. Application of this guidance For a comprehensive integrated assessment of a complex technology we have developed a five step process, the INTEGRATE-HTA model. In Step 1 the HTA objective and the technology are defined with the support from a panel of stakeholders. A system-based logic model is developed in Step 2. It provides a structured overview of technology, the context, implementation issues, and relevant patient groups. It then frames the assessment of the effectiveness, as well as economic, ethical, legal, and socio-cultural aspects in Step 3. In Step 4 a graphical overview of the assessment results, structured by the logic model, is provided. Step 5 is a structured decision-making process informed by the HTA (and is thus not formally part of the HTA but follows it). Logic models therefore form an integral element of the INTEGRATE-HTA model but may also be useful in individual steps. This guidance starts off by offering support in identifying and, as needed, adapting existing logic models from the literature or developing an HTA-/SR-specific logic model de novo. In either case, the user will need to decide upfront whether to pursue an a priori, staged or iterative approach to logic modelling, and the guidance offers criteria on how to decide between these distinct types of logic modelling. The system-based and process-orientated logic model templates provide a starting point for the de novo development of either type of logic model. The guidance also discusses the advantages and drawbacks of adopting the system-based or process-orientated sub-type, and offers some general considerations in applying logic models, such as the variety of data sources used, transparency in reporting and necessary trade-offs between comprehensiveness and complexity of the logic model in communicating with stakeholders. For a priori logic modelling, a six-step process comprises: (1) defining the PICO elements of the HTA/SR as well as relevant aspect of context and implementation; (2) deciding on a system- vs. process-orientated logic model subtype with the former focusing on a conceptualization of the question and the latter more concerned with an explanation of the pathways from the intervention to the outcomes; (3) populating the logic model template with information obtained through literature searches, discussions within the author team and consultations with content experts; (4) asking stakeholders for input and refining the logic model accordingly; (5) repeating steps 3 and 4 until all members of the author team agree that the logic model accurately represents the framework for the specific HTA/SR; and (6) publishing the final logic model with the protocol of the HTA or SR. This logic model remains unchanged during the HTA/SR process. For iterative logic modelling, a five-step process includes: (1) creating an initial logic model as a starting point for subsequent exploration, where a logic model template is used to create an initial logic model de novo; (2) identifying data on the whole system or entire process, or on individual components of the model, where data may come from stakeholders, the review team, ongoing primary research or the published literature; (3) making 7 | changes to the initial logic model repeatedly and at any point of the review and documenting these changes carefully; (4) creating a new numbered version of the logic model, where changes are considered substantive or stepwise; and (5) recording a definitive version of the logic model for the purpose of publication within the final HTA/SR report. It is recognised that this version of the logic model is only definitive with regard to the specific project timeframe and may well be subject to subsequent modification by the HTA/SR team, or indeed by other teams. For staged logic modelling, a four-step process consists of: (1) developing an initial logic model, using one of the templates and various mechanisms to populate them, in particular input from stakeholders and literature searches; (2) pre-specifying points within the HTA/SR process at which significant inputs, defined in terms of quantity or importance, are likely to have an impact on the structure and content of the HTA/SR and thus the logic model; (3) revisiting the logic model at the pre-specified review and revision points, and creating new and clearly labelled versions, documenting how and based on which data sources changes were made; and (4) presenting selected versions of the logic model, as a minimum the initial and the final logic models, in the HTA/ SR report. Conclusions Logic models are an important tool when conducting HTAs or SRs of complex health technologies, as they enhance transparency on underlying assumptions and help understand complexity by depicting the entire system, its parts and the interactions between intervention and outcomes; they also play a key role in integrating across different parts of a multi-component HTA. Nonetheless, logic models are not a panacea in addressing or resolving complexity and each type shows its specific strengths and limitations. This guidance provides a stateof-the-art overview of current practices in the use of logic models within HTAs and SRs. By providing templates for generating a logic model de novo, it aims to make the process of logic model development and application as straightforward as possible. Certain types and sub-types of logic models are more or less suitable depending on the technology concerned and the HTA/SR question addressed and approach pursued. This guidance offers a series of considerations on how to choose between a priori, iterative and staged logic models, illustrated with example applications of each type

Comparing national policy and programme strategies for managing the psychosocial aspects of diabetes

The DAWN2 findings emphasise the importance of having national person-centred diabetes care policies supporting clinical guidelines or standards of care that include regular psychosocial assessments, and reimbursement of psychological care as part of routine diabetes care. ● The responses of HCPs and PWD across the 17 countries confirm the need for policies, diabetes care standards and reimbursement for psychological aspects of diabetes

Ethical analysis in HTA of complex health interventions

Background: In the field of health technology assessment (HTA), there are several approaches that can be used for ethical analysis. However, there is a scarcity of literature that critically evaluates and compares the strength and weaknesses of these approaches when they are applied in practice. In this paper, we analyse the applicability of some selected approaches for addressing ethical issues in HTA in the field of complex health interventions. Complex health interventions have been the focus of methodological attention in HTA. However, the potential methodological challenges for ethical analysis are as yet unknown. Methods: Six of the most frequently described and applied ethical approaches in HTA were critically assessed against a set of five characteristics of complex health interventions: multiple and changing perspectives, indeterminate phenomena, uncertain causality, unpredictable outcomes, and ethical complexity. The assessments are based on literature and the authors’ experiences of developing, applying and assessing the approaches. Results: The Interactive, participatory HTA approach is by its nature and flexibility, applicable across most complexity characteristics. Wide Reflective Equilibrium is also flexible and its openness to different perspectives makes it better suited for complex health interventions than more rigid conventional approaches, such as Principlism and Casuistry. Approaches developed for HTA purposes are fairly applicable for complex health interventions, which one could expect because they include various ethical perspectives, such as the HTA Core Model® and the Socratic approach. Conclusion: This study shows how the applicability for addressing ethical issues in HTA of complex health interventions differs between the selected ethical approaches. Knowledge about these differences may be helpful when choosing and applying an approach for ethical analyses in HTA. We believe that the study contributes to increasing awareness and interest of the ethical aspects of complex health interventions in general

Comparing national policies and programmes for education and training in diabetes management

The 2012 situational policy desk research proved useful for identifying national public policies responsive to diabetes education and training, but these did not align with survey participation rates for diabetes education and training as reported by PWD, FMs and HCPs. ● In the 2012 situational analysis of national policies, it was found that making education accessible, reimbursed and part of mandatory treatment or care did not result in higher diabetes education participation rates for PWD, FMs and HCPs. Further research on policies and diabetes education programmes is needed to understand why participation rates are low. ● Policies are needed to support education for PWD as it has been shown in other studies that PWD who participated in diabetes education reported fewer psychological problems and enhanced self-management compared with those who had not participated in any educational programme.5 ● As part of a global call to action, each country has a responsibility to make improvements in diabetes education and training access, standards or certification, and reimbursement, all of which promote active stakeholder participation and improved diabetes care and outcomes