Improving the use of research evidence in guideline development: 10. Integrating values and consumer involvement

BACKGROUND: The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the 10(th )of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this. OBJECTIVES: We reviewed the literature on integrating values and consumers in guideline development. METHODS: We searched PubMed and three databases of methodological studies for existing systematic reviews and relevant methodological research. We reviewed the titles of all citations and retrieved abstracts and full text articles if the citations appeared relevant to the topic. We checked the reference lists of articles relevant to the questions and used snowballing as a technique to obtain additional information. We did not conduct a full systematic review ourselves. Our conclusions based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments. KEY QUESTIONS AND ANSWERS: We did not find a systematic review of methods for integrating values in guidelines, but we found several systematic reviews that dealt with related topics. Whose values should WHO use when making recommendations? • Values, the relative importance or worth of a state or consequences of a decision (outcomes relating to benefits, harms, burden and costs), play a role in every recommendation. Ethical considerations, concepts that determine what is right, also play a role. • The values used in making recommendations should reflect those of the people affected. Judgements should be explicit and should be informed by input from those affected (including citizens, patients, clinicians and policy makers). • When differences in values may lead to different decisions or there is uncertainty about values, this should also be explicit. If differences in values are likely to affect a decision, such that people in different setting would likely make different choices about interventions or actions based on differences in their values, global recommendations should be explicit in terms of which values were applied and allow for adaptation after incorporating local values. How should WHO ensure that appropriate values are integrated in recommendations? • All WHO guideline groups should uniformly apply explicit, transparent and clearly described methods for integrating values. • WHO should consider involving relevant stakeholders if this is feasible and efficient. • WHO should develop a checklist for guidelines panels to help them to ensure that ethical considerations relevant to recommendations are addressed explicitly and transparently. How should users and consumers be involved in generating recommendations? • Including consumers in groups that are making global recommendations presents major challenges with respect to the impossibility of including a representative spectrum of consumers from a variety of cultures and settings. Nonetheless, consideration should be given to including consumers in groups who are able to challenge assumptions that are made about the values used for making recommendations, rather than represent the values of consumers around the world. • WHO should establish a network to facilitate involvement of users. • Draft recommendations should be reviewed by consumers, who should be asked explicitly to consider the values that were used. How should values be presented in recommendations? • Recommendations should include a description of how decisions were made about the relative importance of the consequences (benefits, harms and costs) of a decision. • Values that influence recommendations should be reported along with the research evidence underlying recommendations. • When differences in values would lead to different decisions or there is important uncertainty about values that are critical to a decision, this should be flagged and reflected in the strength of the recommendation. • Adaptable guideline templates that allow for integration of different values should be developed and used when differences in values are likely to be critical to a decision

A Bayesian reanalysis of the Standard versus Accelerated Initiation of Renal-Replacement Therapy in Acute Kidney Injury (STARRT-AKI) trial

Background Timing of initiation of kidney-replacement therapy (KRT) in critically ill patients remains controversial. The Standard versus Accelerated Initiation of Renal-Replacement Therapy in Acute Kidney Injury (STARRT-AKI) trial compared two strategies of KRT initiation (accelerated versus standard) in critically ill patients with acute kidney injury and found neutral results for 90-day all-cause mortality. Probabilistic exploration of the trial endpoints may enable greater understanding of the trial findings. We aimed to perform a reanalysis using a Bayesian framework. Methods We performed a secondary analysis of all 2927 patients randomized in multi-national STARRT-AKI trial, performed at 168 centers in 15 countries. The primary endpoint, 90-day all-cause mortality, was evaluated using hierarchical Bayesian logistic regression. A spectrum of priors includes optimistic, neutral, and pessimistic priors, along with priors informed from earlier clinical trials. Secondary endpoints (KRT-free days and hospital-free days) were assessed using zero–one inflated beta regression. Results The posterior probability of benefit comparing an accelerated versus a standard KRT initiation strategy for the primary endpoint suggested no important difference, regardless of the prior used (absolute difference of 0.13% [95% credible interval [CrI] − 3.30%; 3.40%], − 0.39% [95% CrI − 3.46%; 3.00%], and 0.64% [95% CrI − 2.53%; 3.88%] for neutral, optimistic, and pessimistic priors, respectively). There was a very low probability that the effect size was equal or larger than a consensus-defined minimal clinically important difference. Patients allocated to the accelerated strategy had a lower number of KRT-free days (median absolute difference of − 3.55 days [95% CrI − 6.38; − 0.48]), with a probability that the accelerated strategy was associated with more KRT-free days of 0.008. Hospital-free days were similar between strategies, with the accelerated strategy having a median absolute difference of 0.48 more hospital-free days (95% CrI − 1.87; 2.72) compared with the standard strategy and the probability that the accelerated strategy had more hospital-free days was 0.66. Conclusions In a Bayesian reanalysis of the STARRT-AKI trial, we found very low probability that an accelerated strategy has clinically important benefits compared with the standard strategy. Patients receiving the accelerated strategy probably have fewer days alive and KRT-free. These findings do not support the adoption of an accelerated strategy of KRT initiation

Regional Practice Variation and Outcomes in the Standard Versus Accelerated Initiation of Renal Replacement Therapy in Acute Kidney Injury (STARRT-AKI) Trial: A Post Hoc Secondary Analysis.

ObjectivesAmong patients with severe acute kidney injury (AKI) admitted to the ICU in high-income countries, regional practice variations for fluid balance (FB) management, timing, and choice of renal replacement therapy (RRT) modality may be significant.DesignSecondary post hoc analysis of the STandard vs. Accelerated initiation of Renal Replacement Therapy in Acute Kidney Injury (STARRT-AKI) trial (ClinicalTrials.gov number NCT02568722).SettingOne hundred-fifty-three ICUs in 13 countries.PatientsAltogether 2693 critically ill patients with AKI, of whom 994 were North American, 1143 European, and 556 from Australia and New Zealand (ANZ).InterventionsNone.Measurements and main resultsTotal mean FB to a maximum of 14 days was +7199 mL in North America, +5641 mL in Europe, and +2211 mL in ANZ (p p p p p p p p = 0.007).ConclusionsAmong STARRT-AKI trial centers, significant regional practice variation exists regarding FB, timing of initiation of RRT, and initial use of continuous RRT. After adjustment, such practice variation was associated with lower ICU and hospital stay and 90-day mortality among ANZ patients compared with other regions