Field testing of a multicriteria decision analysis (MCDA) framework for coverage of a screening test for cervical cancer in South Africa

<p>Abstract</p> <p>Background</p> <p>Systematic and transparent approaches to priority setting are needed, particularly in low-resource settings, to produce decisions that are sound and acceptable to stakeholders. The EVIDEM framework brings together Health Technology Assessment (HTA) and multi-criteria decision analysis (MCDA) by proposing a comprehensive set of decision criteria together with standardized processes to support decisionmaking. The objective of the study was to field test the framework for decisionmaking on a screening test by a private health plan in South Africa.</p> <p>Methods</p> <p>Liquid-based cytology (LBC) for cervical cancer screening was selected by the health plan for this field test. An HTA report structured by decision criterion (14 criteria organized in the MCDA matrix and 4 contextual criteria) was produced based on a literature review and input from the health plan. During workshop sessions, committee members 1) weighted each MCDA decision criterion to express their individual perspectives, and 2) to appraise LBC, assigned scores to each MCDA criterion on the basis of the by-criterion HTA report.</p> <p>Committee members then considered the potential impacts of four contextual criteria on the use of LBC in the context of their health plan. Feedback on the framework and process was collected through discussion and from a questionnaire.</p> <p>Results</p> <p>For 9 of the MCDA matrix decision criteria, 89% or more of committee members thought they should always be considered in decisionmaking. Greatest weights were given to the criteria "Budget impact", "Cost-effectiveness" and "Completeness and consistency of reporting evidence". When appraising LBC for cervical cancer screening, the committee assigned the highest scores to "Relevance and validity of evidence" and "Disease severity". Combination of weights and scores yielded a mean MCDA value estimate of 46% (SD 7%) of the potential maximum value. Overall, the committee felt the framework brought greater clarity to the decisionmaking process and was easily adaptable to different types of health interventions.</p> <p>Conclusions</p> <p>The EVIDEM framework was easily adapted to evaluating a screening technology in South Africa, thereby broadening its applicability in healthcare decision making.</p

Combining multicriteria decision analysis, ethics and health technology assessment: applying the EVIDEM decisionmaking framework to growth hormone for Turner syndrome patients

<p>Abstract</p> <p>Objectives</p> <p>To test and further develop a healthcare policy and clinical decision support framework using growth hormone (GH) for Turner syndrome (TS) as a complex case study.</p> <p>Methods</p> <p>The EVIDEM framework was further developed to complement the multicriteria decision analysis (MCDA) Value Matrix, that includes 15 quantifiable components of decision clustered in four domains (quality of evidence, disease, intervention and economics), with a qualitative tool including six ethical and health system-related components of decision. An extensive review of the literature was performed to develop a health technology assessment report (HTA) tailored to each component of decision, and content was validated by experts. A panel of representative stakeholders then estimated the MCDA value of GH for TS in Canada by assigning weights and scores to each MCDA component of decision and then considered the impact of non-quantifiable components of decision.</p> <p>Results</p> <p>Applying the framework revealed significant data gaps and the importance of aligning research questions with data needs to truly inform decision. Panelists estimated the value of GH for TS at 41% of maximum value on the MCDA scale, with good agreement at the individual level (retest value 40%; ICC: 0.687) and large variation across panelists. Main contributors to this panel specific value were "Improvement of efficacy", "Disease severity" and "Quality of evidence". Ethical considerations on utility, efficiency and fairness as well as potential misuse of GH had mixed effects on the perceived value of the treatment.</p> <p>Conclusions</p> <p>This framework is proposed as a pragmatic step beyond the current cost-effectiveness model, combining HTA, MCDA, values and ethics. It supports systematic consideration of all components of decision and available evidence for greater transparency. Further testing and validation is needed to build up MCDA approaches combined with pragmatic HTA in healthcare decisionmaking.</p

Evidence and Value: Impact on DEcisionMaking – the EVIDEM framework and potential applications

<p>Abstract</p> <p>Background</p> <p>Healthcare decisionmaking is a complex process relying on disparate types of evidence and value judgments. Our objectives for this study were to develop a practical framework to facilitate decisionmaking in terms of supporting the deliberative process, providing access to evidence, and enhancing the communication of decisions.</p> <p>Methods</p> <p>Extensive analyses of the literature and of documented decisionmaking processes around the globe were performed to explore what steps are currently used to make decisions with respect to context (from evidence generation to communication of decision) and thought process (conceptual components of decisions). Needs and methodologies available to support decisionmaking were identified to lay the groundwork for the EVIDEM framework.</p> <p>Results</p> <p>A framework was developed consisting of seven modules that can evolve over the life cycle of a healthcare intervention. Components of decision that could be quantified, i.e., intrinsic value of a healthcare intervention and quality of evidence available, were organized into matrices. A multicriteria decision analysis (MCDA) Value Matrix (VM) was developed to include the 15 quantifiable components that are currently considered in decisionmaking. A methodology to synthesize the evidence needed for each component of the VM was developed including electronic access to full text source documents. A Quality Matrix was designed to quantify three criteria of quality for the 12 types of evidence usually required by decisionmakers. An integrated system was developed to optimize data analysis, synthesis and validation by experts, compatible with a collaborative structure.</p> <p>Conclusion</p> <p>The EVIDEM framework promotes transparent and efficient healthcare decisionmaking through systematic assessment and dissemination of the evidence and values on which decisions are based. It provides a collaborative framework that could connect all stakeholders and serve the healthcare community at local, national and international levels by allowing sharing of data, resources and values. Validation and further development is needed to explore the full potential of this approach.</p

Implementation and Outcomes of Commercial Disease Management Programs in the United States: The Disease Management Outcomes Consolidation Survey

Despite widespread adoption of disease management (DM) programs by US health plans, gaps remain in the evidence for their benefit. The Disease Management Outcomes Consolidation Survey was designed to gather data on DM programs for commercial health plans, to assess program success and DM effectiveness. The questionnaire was mailed to 292 appropriate health plan contacts; 26 plans covering more than 14 million commercial members completed and returned the survey. Respondents reported that DM plays a significant and increasing role in their organizations. Key reasons for adopting DM were improving clinical outcomes, reducing medical costs and utilization, and improving member satisfaction. More respondents were highly satisfied with clinical results than with utilization or cost outcomes of their programs (46%, 17%, and 13%, respectively). Detailed results were analyzed for 57 DM programs with over 230,000 enrollees. Most responding plans offered DM programs for diabetes and asthma, with return on investment (ROI) ranging from 0.16:1 to 4:1. Weighted by number of enrollees per DM program, average ROI was 2.56:1 for asthma (n = 1,136 enrollees) and 1.98:1 for diabetes (n = 25,364). Most (but not all) respondents reported reduced hospital admissions, increasing rates of preventive care, and improved clinical measures. Few respondents provided detailed information about DM programs for other medical conditions, but most that did reported positive outcomes. Lack of standardized methodology was identified as a major barrier to in-house program evaluation. Although low response rate precluded drawing many general conclusions, a clear need emerged for more rigorous evaluation methods and greater standardization of outcomes measurement. (Disease Management 2005;8:253–264)Peer Reviewedhttp://deepblue.lib.umich.edu/bitstream/2027.42/63399/1/dis.2005.8.253.pd

Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada

<p>Abstract</p> <p>Background</p> <p>Consistent healthcare decisionmaking requires systematic consideration of decision criteria and evidence available to inform them. This can be tackled by combining multicriteria decision analysis (MCDA) and Health Technology Assessment (HTA). The objective of this study was to field-test a decision support framework (EVIDEM), explore its utility to a drug advisory committee and test its reliability over time.</p> <p>Methods</p> <p>Tramadol for chronic non-cancer pain was selected by the health plan as a case study relevant to their context. Based on extensive literature review, a by-criterion HTA report was developed to provide synthesized evidence for each criterion of the framework (14 criteria for the MCDA Core Model and 6 qualitative criteria for the Contextual Tool). During workshop sessions, committee members tested the framework in three steps by assigning: 1) weights to each criterion of the MCDA Core Model representing individual perspective; 2) scores for tramadol for each criterion of the MCDA Core Model using synthesized data; and 3) qualitative impacts of criteria of the Contextual Tool on the appraisal. Utility and reliability of the approach were explored through discussion, survey and test-retest. Agreement between test and retest data was analyzed by calculating intra-rater correlation coefficients (ICCs) for weights, scores and MCDA value estimates.</p> <p>Results</p> <p>The framework was found useful by the drug advisory committee in supporting systematic consideration of a broad range of criteria to promote a consistent approach to appraising healthcare interventions. Directly integrated in the framework as a "by-criterion" HTA report, synthesized evidence for each criterion facilitated its consideration, although this was sometimes limited by lack of relevant data. Test-retest analysis showed fair to good consistency of weights, scores and MCDA value estimates at the individual level (ICC ranging from 0.676 to 0.698), thus lending some support for the reliability of the approach. Overall, committee members endorsed the inclusion of most framework criteria and revealed important areas of discussion, clarification and adaptation of the framework to the needs of the committee.</p> <p>Conclusions</p> <p>By promoting systematic consideration of all decision criteria and the underlying evidence, the framework allows a consistent approach to appraising healthcare interventions. Further testing and validation are needed to advance MCDA approaches in healthcare decisionmaking.</p

Phosphorylation and purification of integral endoplasmic reticulum membrane proteings

Three proteins of stripped rough microsomes (SRM) from dog pancreas or rat liver, with apparent molecular weights of 35, 56 and 90 kDa (pgp35, pp56, pp90), were phosphorylated in vitro by both ($tau$-32P) GTP and ($tau$-32P) ATP. Another SRM protein of 15 kDa (pp15) was phosphorylated in vitro only by ($tau$-32P) GTP. Comparison of the in vitro phosphorylation profile of SRM to those of other well defined subcellular fractions, i.e., plasma membranes, Golgi apparatus, lysosomes, endosomes, mitochondria and smooth microsomes, showed the four major GTP phosphorylated proteins were restricted to the endoplasmic reticulum (ER). Further characterization of these proteins showed them to be phosphorylated on serine residues at the cis face of SRM and to be integral membrane proteins. The 35 kDa protein was glycosylated, with 2 N-linked oligosaccharide sidechains, therefore possessing a luminal domain. Competition and inhibition studies showed that GTP and ATP phosphorylation of the proteins were distinct. Regulation of GTP specific phosphorylation was by adenosine nucleoside. Purification of the 35 and 90 kDa phosphoproteins was achieved, along with another nonphosphorylated glycoprotein of 25 kDa, as a phosphoglycoprotein complex which elutes from Sephacryl S300 chromatography at an apparent molecular weight of about 400,000. Partial Sequence Receptor (Weidmann et al, (1987) Nature 328: 830-833), suggesting that this phosphoglycoprotein complex may form part of the translocation apparatus of the rough ER. These results suggest a role for phosphorylation of ER membrane proteins in the process of translocation