Investigating the complementary value of discrete choice experiments for the evaluation of barriers and facilitators in implementation research: a questionnaire survey

<p>Abstract</p> <p>Background</p> <p>The potential barriers and facilitators to change should guide the choice of implementation strategy. Implementation researchers believe that existing methods for the evaluation of potential barriers and facilitators are not satisfactory. Discrete choice experiments (DCE) are relatively new in the health care sector to investigate preferences, and may be of value in the field of implementation research. The objective of our study was to investigate the complementary value of DCE for the evaluation of barriers and facilitators in implementation research.</p> <p>Methods</p> <p>Clinical subject was the implementation of the guideline for breast cancer surgery in day care. We identified 17 potential barriers and facilitators to the implementation of this guideline. We used a traditional questionnaire that was made up of statements about the potential barriers and facilitators. Respondents answered 17 statements on a five-point scale ranging from one (fully disagree) to five (fully agree). The potential barriers and facilitators were included in the DCE as decision attributes. Data were gathered among anaesthesiologists, surgical oncologists, and breast care nurses by means of a paper-and-pencil questionnaire.</p> <p>Results</p> <p>The overall response was 10%. The most striking finding was that the responses to the traditional questionnaire hardly differentiated between barriers. Forty-seven percent of the respondents thought that DCE is an inappropriate method. These respondents considered DCE too difficult and too time-consuming. Unlike the traditional questionnaire, the results of a DCE provide implementation researchers and clinicians with a relative attribute importance ranking that can be used to prioritize potential barriers and facilitators to change, and hence to better fine-tune the implementation strategies to the specific problems and challenges of a particular implementation process.</p> <p>Conclusion</p> <p>The results of our DCE and traditional questionnaire would probably lead to different implementation strategies. Although there is no 'gold standard' for prioritising potential barriers and facilitators to the implementation of change, theoretically, DCE would be the method of choice. However, the feasibility of using DCE was less favourable. Further empirical applications should investigate whether DCE can really make a valuable contribution to the implementation science.</p

Nominal group technique to select attributes for discrete choice experiments: an example for drug treatment choice in osteoporosis.

BACKGROUND: Attribute selection represents an important step in the development of discrete-choice experiments (DCEs), but is often poorly reported. In some situations, the number of attributes identified may exceed what one may find possible to pilot in a DCE. Hence, there is a need to gain insight into methods to select attributes in order to construct the final list of attributes. This study aims to test the feasibility of using the nominal group technique (NGT) to select attributes for DCEs. METHODS: Patient group discussions (4-8 participants) were convened to prioritize a list of 12 potentially important attributes for osteoporosis drug therapy. The NGT consisted of three steps: an individual ranking of the 12 attributes by importance from 1 to 12, a group discussion on each of the attributes, including a group review of the aggregate score of the initial rankings, and a second ranking task of the same attributes. RESULTS: Twenty-six osteoporotic patients participated in five NGT sessions. Most (80%) of the patients changed their ranking after the discussion. However, the average initial and final ranking did not differ markedly. In the final ranking, the most important medication attributes were effectiveness, side effects, and frequency and mode of administration. Some (15%) of the patients did not correctly rank from 1 to 12, and the order of attributes did play a role in the ranking. CONCLUSION: The NGT is feasible for selecting attributes for DCEs. Although in the context of this study, the NGT session had little impact on prioritizing attributes, this approach is rigorous, transparent, and improves the face validity of DCEs. Additional research in other contexts (different decisional problems or different diseases) is needed to determine the added value of the NGT session, to assess the optimal ranking/rating method with control of ordering effects, and to compare the attributes selected with the different approaches