Validating a Multi-criteria decision analysis (MCDA) framework for health care decision making (abstract)

OBJECTIVES: When evaluating healthcare interventions, decision-makers are increasingly asked to consider multiple criteria to support their decision. The MCDA-based EVIDEM framework was developed to support this process. It includes a simple weight elicitation technique, designed to be easily applicable by a broad range of users. The objective of this study was to compare the EVIDEM technique with more traditional techniques. METHODS: An online questionnaire was developed comparing the EVIDEM technique with four alternative techniques including AHP, best/worst scaling, ranking and point-allocation. A convenience sample of 60 Dutch and Canadian students were asked to fill out the questionnaires as if they were sitting in an advisory committee for reimbursement/prioritization of healthcare interventions. They were asked to provide weights for 14 criteria using two techniques, and to provide feedback on ease of use and clarity of concepts of the different techniques. RESULTS: Results based on the first 30 responses show that EVIDEM is easy to understand and takes little time to complete, three minutes on average. Criteria weights derived using the EVIDEM technique and best/worst scaling are divergent. Comparing the rank order of criteria respondents gave using these two techniques; there is more resemblance in rank order of criteria weighted with the EVIDEM technique. Compared to AHP/ranking/point-allocation, EVIDEM takes less time to complete but is only preferred by 33% of decision-makers. AHP/ranking and point allocation were often described as clearer and more reflective of the respondents’ opinion. CONCLUSIONS: The simple technique is proposed as a starting point for users wishing to adapt the EVIDEM framework to their own context. Other techniques may be preferred and their impact on the MCDA value estimate generated by applying the framework is being explored. This project is part of a large collaborative work that includes developing and validating this framework to facilitate sound and efficient MCDA-applications

MO4 - Using AHP weights to fill missing gaps in Markov decision models

OBJECTIVES:\ud We propose to combine the versatility of the analytic hierarchy process (AHP) with the decision-analytic sophistication of health-economic modeling in a new methodology for early technology assessment. As an illustration, we apply this methodology to a new technology to diagnose breast cancer.\ud \ud METHODS:\ud The AHP is a technique for multicriteria analysis, relatively new in the fi eld of technology assessment. It can integrate both quantitative and qualitative criteria in the assessment of alternative technologies. We applied the AHP to prioritize a more versatile set of outcome measures than most Markov models do. These outcome measures include clinical effectiveness and costs, but also weighted estimates of patient comfort and safety. Furthermore, as no clinical data are available for this technology yet, the AHP is applied to predict the performance of the new technology with regard to all these outcome measures. Results of the AHP are subsequently integrated in a Markov model to make an early assessment of the expected incremental cost-effectiveness of alternative technologies.\ud \ud RESULTS:\ud We systematically estimated priors on the clinical effectiveness and wider impacts of the new technology using AHP. In our illustration, AHP estimates for sensitivity and specifi city of the new diagnostic technology were used as probability parameters in the Markov model. Moreover, the prioritized outcome measures including clinical effectiveness (weight = 0.61), patient comfort (weight = 0.09), and safety (weight = 0.30) were integrated into one outcome measure in the Markov model.\ud \ud CONCLUSIONS:\ud Combining AHP and Markov modelling is particularly valuable in early technology assessment when evidence about the effectiveness of health care technology is still limited or missing. Moreover, combining these methods is valuable when decision makers are interested in other patient relevant outcomes measures besides the technology’s clinical effectiveness, and that may not (adequately or explicitly) be captured in mainstream utility measures

Empirical comparison of discrete choice experiment and best-worst scaling to estimate stakeholders' risk tolerance for hip replacement surgery

Objectives Empirical comparison of two preference elicitation methods, discrete choice experiment (DCE) and profile case best-worst scaling (BWS), regarding the estimation of the risk tolerance for hip replacement surgery (total hip arthroplasty and total hip resurfacing arthroplasty). Methods An online survey was constructed, following international guidelines, and consisted of socio-demographic questions and two randomised sections with 12 DCE and 8 BWS questions. The survey was sent to a general population who can be faced with choosing between THA and TRA (males between 45-65 years old) in the US. After an intensive literature search, the following attributes were selected: probability of a first and a second revision in seven years, pain relief, ability to perform moderate daily activities, and hospital stay. In addition, survey respondents rated the difficulty of each method and the time to complete each section was monitored. BWS and DCE data was analysed using conditional logit analysis. The maximum acceptable risk (MAR) for a revision was estimated for four different hypothetical hip replacement scenarios. Results The final data set consisted of 429 respondents. The MARs estimated for four hypothetical hip replacement scenarios differed between both methods, ranging from 0% to 19% difference for a first revision. BWS questions took significantly more time (401 s.) than DCE (228 s.) questions. And respondents found BWS more difficult to complete. Conclusions Both methods to elicit stakeholder preferences produce different results. Yet, both seem to be consistent in predicting risk tolerance if the benefits are changed. However, DCE seems to be more sensitive for a change in benefits and risks while the MAR estimates obtained through BWS have considerably lower uncertainty than DC

Dietary supplementation with multiple micronutrients: No beneficial effects in pediatric cystic fibrosis patients

AbstractBackgroundCystic fibrosis (CF) patients are subjected to increased oxidative stress due to chronic pulmonary inflammation and recurrent infections. Additionally, these patients have diminished skeletal muscle performance and exercise capacity. We hypothesize that a mixture of multiple micronutrients could have beneficial effects on pulmonary function and muscle performance.MethodsA double-blind, randomized, placebo controlled, cross-over trial with a mixture of multiple micronutrients (ML1) was performed in 22 CF patients (12.9±2.5 yrs) with predominantly mild lung disease. Anthropometric measures, pulmonary function, exercise performance by bicycle ergometry, muscular strength and vitamins A and E were determined.ResultsAnalysis was performed using the paired Student t-test comparing the change in each parameter during ML1 and placebo. Plasma vitamin E and A levels increased during ML1 when compared to placebo. However, no significant difference between the effect of the ML1 or placebo was observed neither for FEV1, FVC, anthropometry, nor for the parameters for muscle performance.ConclusionsThe micronutrient mixture was not superior to placebo with respect to changes in pulmonary function or muscle performance in pediatric CF patients, despite a significant increase in plasma vitamin E concentrations

Do contaminants compromise the use of recycled nutrients in organic agriculture? A review and synthesis of current knowledge on contaminant concentrations, fate in the environment and risk assessment

Use of nutrients recycled from societal waste streams in agriculture is part of the circular economy, and in line with organic farming principles. Nevertheless, diverse contaminants in waste streams create doubts among organic farmers about potential risks for soil health. Here, we gather the current knowledge on contaminant levels in waste streams and recycled nutrient sources, and discuss associated risks. For potentially toxic elements (PTEs), the input of zinc (Zn) and copper (Cu) from mineral feed supplements remains of concern, while concentrations of PTEs in many waste streams have decreased substantially in Europe. The same applies to organic contaminants, although new chemical groups such as flame retardants are of emerging concern and globally contamination levels differ strongly. Compared to inorganic fertilizers, application of organic fertilizers derived from human or animal feces is associated with an increased risk for environmental dissemination of antibiotic resistance. The risk depends on the quality of the organic fertilizers, which varies between geographical regions, but farmland application of sewage sludge appears to be a safe practice as shown by some studies (e.g. from Sweden). Microplastic concentrations in agricultural soils show a wide spread and our understanding of its toxicity is limited, hampering a sound risk assessment. Methods for assessing public health risks for organic contaminants must include emerging contaminants and potential interactions of multiple compounds. Evidence from long-term field experiments suggests that soils may be more resilient and capable to degrade or stabilize pollutants than often assumed. In view of the need to source nutrients for expanding areas under organic farming, we discuss inputs originating from conventional farms vs. non-agricultural (i.e. societal) inputs. Closing nutrient cycles between agriculture and society is feasible in many cases, without being compromised by contaminants, and should be enhanced, aided by improved source control, waste treatment and sound risk assessments

Motivations for innovation in the built environment: new directions for research

Innovation in the built environment involves multiple actors with diverse motivations. Policy-makers find it difficult to promote changes that require cooperation from these numerous and dispersed actors and to align their sometimes divergent interests. Established research traditions on the economics and management of innovation pay only limited attention to stakeholder choices, engagement and motivation. This paper reviews the insights that emerge as research in these traditions comes into contact with work on innovation from sociological and political perspectives. It contributes by highlighting growing areas of research on user involvement in complex innovation, collective action, distributed innovation and transition management. To differing extents, these provide approaches to incorporate the motivations of different actors into theoretical understanding. These indicate new directions for research that promise to enrich understanding of innovation

Human leukocyte antigen supertype matching after myeloablative hematopoietic cell transplantation with 7/8 matched unrelated donor allografts: a report from the Center for International Blood and Marrow Transplant Research

The diversity of the human leukocyte antigen (HLA) class I and II alleles can be simplified by consolidating them into fewer supertypes based on functional or predicted structural similarities in epitope-binding grooves of HLA molecules. We studied the impact of matched and mismatched HLA-A (265 versus 429), -B (230 versus 92), -C (365 versus 349), and -DRB1 (153 versus 51) supertypes on clinical outcomes of 1934 patients with acute leukemias or myelodysplasia/myeloproliferative disorders. All patients were reported to the Center for International Blood and Marrow Transplant Research following single-allele mismatched unrelated donor myeloablative conditioning hematopoietic cell transplantation. Single mismatched alleles were categorized into six HLA-A (A01, A01A03, A01A24, A02, A03, A24), six HLA-B (B07, B08, B27, B44, B58, B62), two HLA-C (C1, C2), and five HLA-DRB1 (DR1, DR3, DR4, DR5, DR9) supertypes. Supertype B mismatch was associated with increased risk of grade II-IV acute graft-versus-host disease (hazard ratio =1.78, P=0.0025) compared to supertype B match. Supertype B07-B44 mismatch was associated with a higher incidence of both grade II-IV (hazard ratio=3.11, P=0.002) and III-IV (hazard ratio=3.15, P=0.01) acute graft-versus-host disease. No significant associations were detected between supertype-matched versus -mismatched groups at other HLA loci. These data suggest that avoiding HLA-B supertype mismatches can mitigate the risk of grade II-IV acute graft-versus-host disease in 7/8-mismatched unrelated donor hematopoietic cell transplantation when multiple HLA-B supertype-matched donors are available. Future studies are needed to define the mechanisms by which supertype mismatching affects outcomes after alternative donor hematopoietic cell transplantation

One-Antigen Mismatched Related versus HLA-Matched Unrelated Donor Hematopoietic Stem Cell Transplantation in Adults with Acute Leukemia: Center for International Blood and Marrow Transplant Research Results in the Era of Molecular HLA Typing

Approximately 13% of patients lacking an HLA-identical sibling have a one-antigen–mismatched related donor (MMRD). Historically, outcomes from the use of a one-antigen MMRD were considered equivalent to those from the use of a matched unrelated donor (UD). Recent improvements in UD stem cell transplantation (SCT) resulting from better molecular HLA matching justifies investigating whether UD should be preferred over MMRD in adult patients with acute leukemia. Here, we compared the outcomes of MMRD (n = 89) and HLA-A, -B, -C, and -DRB1 allele–matched UD (n = 700) SCT reported to the Center for International Blood and Marrow Transplant Research between 1995 and 2005. The patients underwent transplantation for acute myelogenous leukemia or acute lymphoblastic leukemia in first or second complete remission. Donor type was not associated with hematologic recovery. Univariate and multivariate comparisons of MMRD versus HLA-matched UD transplants showed no statistically significant differences in overall survival, disease-free survival, treatment-related mortality, relapse, or 100-day grade III-IV acute graft-versus-host disease (GVHD). MMRD SCT was associated with a lower rate of chronic GVHD at 1 year (35% vs 47%; P = .03), which was confirmed by multivariate analysis (relative risk, 0.58; 95% confidence interval, 0.39-0.85; P < .01). According to our data, HLA-matched UD and MMRD SCT are associated with comparable survival. Given that less chronic GVHD was observed in the MMRD transplantations, this option, when available, remains the first choice in patients with acute leukemia without an HLA-identical sibling in need of allogeneic SCT