Training clinicians in how to use patient-reported outcome measures in routine clinical practice

Introduction: Patient-reported outcome measures (PROs) were originally developed for comparing groups of people in clinical trials and population studies, and the results were used to support treatment recommendations or inform health policy, but there was not direct benefit for the participants providing PROs data. However, as the experience in using those measures increased, it became obvious the clinical value in using individual patient PROs profiles in daily practice to identify/monitor symptoms, evaluate treatment outcomes and support shared decision-making. A key issue limiting successful implementation is clinicians’ lack of knowledge on how to effectively utilize PROs data in their clinical encounters. Methods: Using a change management theoretical framework, this paper describes the development and implementation of three programs for training clinicians to effectively use PRO data in routine practice. The training programs are in three diverse clinical areas (adult oncology, lung transplant and paediatrics), in three countries with different healthcare systems, thus providing a rare opportunity to pull out common approaches whilst recognizing specific settings. For each program, we describe the clinical and organizational setting, the program planning and development, the content of the training session with supporting material, subsequent monitoring of PROs use and evidence of adoption. The common successful components and practical steps are identified, leading to discussion and future recommendations. Results: The results of the three training programs are described as the implementation. In the oncology program, PRO data have been developed and are currently evaluated; in the lung transplant program, PRO data are used in daily practice and the integration with electronic patient records is under development; and in the paediatric program, PRO data are fully implemented with around 7,600 consultations since the start of the implementation. Conclusion: Adult learning programs teaching clinicians how to use and act on PROs in clinical practice are a key steps in supporting patient engagement and participation in shared decision-making. Researchers and clinicians from different clinical areas should collaborate to share ideas, develop guidelines and promote good practice in patient-centred care

Construct validation of the Health Utilities Index and the Child Health Questionnaire in children undergoing cancer chemotherapy

The objective of this study was to evaluate the construct validity of two questionnaire-based measures of health-related quality of life (HRQL) in children undergoing cancer chemotherapy: the Health Utilities Index (HUI) and the Child Health Questionnaire (CHQ). Subjects were children hospitalised for chemotherapy. To examine construct validity: (1) a priori expected relations between CHQ concepts and HUI attributes were examined; (2) HUI and CHQ summary scores were compared to visual analogue scale (VAS) scores. Ease of completion was rated using a 5-point categorical scale and completion time was recorded. A total of 36 subjects were included. The maximum score was seen in 15 (47%) of HUI3 assessments. As predicted, CHQ body pain was moderately correlated with HUI3 pain (r=0.51), CHQ physical functioning was moderately correlated with HUI2 mobility (r=0.58) and CHQ mental health was moderately correlated with HUI2 emotion (r=0.53). Only the CHQ psychosocial subscale (and not HUI) was correlated with VAS (r=0.44). The CHQ and the HUI were both easy to use. The HUI questionnaires required less time to complete (mean=3.1, s.d.=1 min) compared with CHQ (mean=13.1, s.d.=3.4 min, P<0.0001). In conclusion, HUI and CHQ demonstrated construct validity in children undergoing cancer chemotherapy. The Health Utilities Index is subject to a ceiling effect whereas CHQ requires more time to complete

An assessment of validity and responsiveness of generic measures of health-related quality of life in hearing impairment

This article is made available through the Brunel Open Access Publishing Fund. This article is distributed under the terms of the Creative Commons Attribution License which permits any use, distribution, and reproduction in any medium, provided the original author(s) and the source are credited.Purpose: This review examines psychometric performance of three widely used generic preference-based measures, that is, EuroQol 5 dimensions (EQ-5D), Health Utility Index 3 (HUI3) and Short-form 6 dimensions (SF-6D) in patients with hearing impairments. Methods: A systematic search was undertaken to identify studies of patients with hearing impairments where health state utility values were measured and reported. Data were extracted and analysed to assess the reliability, validity (known group differences and convergent validity) and responsiveness of the measures across hearing impairments. Results: Fourteen studies (18 papers) were included in the review. HUI3 was the most commonly used utility measures in hearing impairment. In all six studies, the HUI3 detected difference between groups defined by the severity of impairment, and four out of five studies detected statistically significant changes as a result of intervention. The only study available suggested that EQ-5D only had weak ability to discriminate difference between severity groups, and in four out of five studies, EQ-5D failed to detected changes. Only one study involved the SF-6D; thus, the information is too limited to conclude on its performance. Also evidence for the reliability of these measures was not found. Conclusion: Overall, the validity and responsiveness of the HUI3 in hearing impairment was good. The responsiveness of EQ-5D was relatively poor and weak validity was suggested by limited evidence. The evidence on SF-6D was too limited to make any judgment. More head-to-head comparisons of these and other preference measures of health are required.Medical Research Counci

Using Rasch analysis to form plausible health states amenable to valuation: the development of CORE-6D from CORE-OM in order to elicit preferences for common mental health problems

Purpose: To describe a new approach for deriving a preference-based index from a condition specific measure that uses Rasch analysis to develop health states. Methods: CORE-OM is a 34-item instrument monitoring clinical outcomes of people with common mental health problems. CORE-OM is characterised by high correlation across its domains. Rasch analysis was used to reduce the number of items and response levels in order to produce a set of unidimensionally-behaving items, and to generate a credible set of health states corresponding to different levels of symptom severity using the Rasch item threshold map. Results: The proposed methodology resulted in the development of CORE-6D, a 2-dimensional health state description system consisting of a unidimensionally-behaving 5-item emotional component and a physical symptom item. Inspection of the Rasch item threshold map of the emotional component helped identify a set of 11 plausible health states, which, combined with the physical symptom item levels, will be used for the valuation of the instrument, resulting in the development of a preference-based index. Conclusions: This is a useful new approach to develop preference-based measures where the domains of a measure are characterised by high correlation. The CORE-6D preference-based index will enable calculation of Quality Adjusted Life Years in people with common mental health problems

Preferred reporting items for studies mapping onto preference-based outcome measures: The MAPS statement

'Mapping' onto generic preference-based outcome measures is increasingly being used as a means of generating health utilities for use within health economic evaluations. Despite publication of technical guides for the conduct of mapping research, guidance for the reporting of mapping studies is currently lacking. The MAPS (MApping onto Preference-based measures reporting Standards) statement is a new checklist, which aims to promote complete and transparent reporting of mapping studies. The primary audiences for the MAPS statement are researchers reporting mapping studies, the funders of the research, and peer reviewers and editors involved in assessing mapping studies for publication. A de novo list of 29 candidate reporting items and accompanying explanations was created by a working group comprised of six health economists and one Delphi methodologist. Following a two-round, modified Delphi survey with representatives from academia, consultancy, health technology assessment agencies and the biomedical journal editorial community, a final set of 23 items deemed essential for transparent reporting, and accompanying explanations, was developed. The items are contained in a user friendly 23 item checklist. They are presented numerically and categorised within six sections, namely: (i) title and abstract; (ii) introduction; (iii) methods; (iv) results; (v) discussion; and (vi) other. The MAPS statement is best applied in conjunction with the accompanying MAPS explanation and elaboration document. It is anticipated that the MAPS statement will improve the clarity, transparency and completeness of reporting of mapping studies. To facilitate dissemination and uptake, the MAPS statement is being co-published by eight health economics and quality of life journals, and broader endorsement is encouraged. The MAPS working group plans to assess the need for an update of the reporting checklist in five years' time. This statement was published jointly in Applied Health Economics and Health Policy, Health and Quality of Life Outcomes, International Journal of Technology Assessment in Health Care, Journal of Medical Economics, Medical Decision Making, PharmacoEconomics, and Quality of Life Research

Generalizability of evidence-based assessment recommendations for pediatric bipolar disorder.

Bipolar disorder is frequently clinically diagnosed in youths who do not actually satisfy DSM-IV criteria, yet cases that would satisfy full DSM-IV criteria are often undetected clinically. Evidence-based assessment methods that incorporate Bayesian reasoning have demonstrated improved diagnostic accuracy, and consistency; however, their clinical utility is largely unexplored. The present study examines the effectiveness of promising evidence-based decision-making compared to the clinical gold standard. Participants were 562 youth, ages 5-17 and predominantly African American, drawn from a community mental health clinic. Research diagnoses combined semi-structured interview with youths’ psychiatric, developmental, and family mental health histories. Independent Bayesian estimates relied on published risk estimates from other samples discriminated bipolar diagnoses, Area Under Curve=.75, prs =.30. Agreement about an evidence-based assessment intervention “threshold model” (wait/assess/treat) had K=.24, pr=.81,

EQ-5D in skin conditions: an assessment of validity and responsiveness

Aims and objectives This systematic literature review aims to assess the reliability, validity and responsiveness of three widely used generic preference-based measures of health-related quality of life (HRQL), i.e., EQ-5D, Health Utility Index 3 (HUI3) and SF-6D in patients with skin conditions. Methods A systematic search was conducted to identify studies reporting health state utility values obtained using EQ-5D, SF-6D, or HUI3 alongside other HRQL measures or clinical indices for patients with skin conditions. Data on test-retest analysis for reliability, known group differences or correlation and regression analyses for validity, and change over time or responsiveness indices analysis were extracted and reviewed. Results A total of 16 papers reporting EQ-5D utilities in people with skin conditions were included in the final review. No papers for SF-6D and HUI3 were found. Evidence of reliability was not found for any of these measures. The majority of studies included in the review (12 out of 16) examined patients with plaque psoriasis or psoriatic arthritis and the remaining four studies examined patients with either acne, hidradenitis suppurativa, hand eczema, or venous leg ulcers. The findings were generally positive in terms of performance of EQ-5D. Six studies showed that EQ-5D was able to reflect differences between severity groups and only one reported differences that were not statistically significant. Four studies found that EQ-5D detected differences between patients and the general population, and differences were statistically different for three of them. Further, moderate-to-strong correlation coefficients were found between EQ-5D and other skin-specific HRQL measures in four studies. Eight studies showed that EQ-5D was able to detect change in HRQL appropriately over time and the changes were statistically significant in seven studies. Conclusions Overall, the validity and responsiveness of the EQ-5D was found to be good in people with skin diseases, especially plaque psoriasis or psoriatic arthritis. No evidence on SF-6D and HUI3 was available to enable any judgments to be made on their performance

Choosing between measures: comparison of EQ-5D, HUI2 and HUI3 in persons with hearing complaints

OBJECTIVES: To generate insight into the differences between utility measures EuroQol 5D (EQ-5D), Health Utilities Index Mark II (HUI2) and Mark III (HUI3) and their impact on the incremental cost-effectiveness ratio (ICER) for hearing aid fitting METHODS: Persons with hearing complaints completed EQ-5D, HUI2 and HUI3 at baseline and, when applicable, after hearing aid fitting. Practicality, construct validity, agreement, responsiveness and impact on the ICER were examined. RESULTS: All measures had high completion rates. HUI3 was capable of discriminating between clinically distinctive groups. Utility scores (n = 315) for EQ-5D UK and Dutch tariff (0.83; 0.86), HUI2 (0.77) and HUI3 (0.61) were significantly different, agreement was low to moderate. Change after hearing aid fitting (n = 70) for HUI2 (0.07) and HUI3 (0.12) was statistically significant, unlike the EQ-5D UK (0.01) and Dutch (0.00) tariff. ICERs varied from 647,209 euros/QALY for the EQ-5D Dutch tariff to 15,811 euros/QALY for HUI3. CONCLUSION: Utility scores, utility gain and ICERs heavily depend on the measure that is used to elicit them. This study indicates HUI3 as the instrument of first choice when measuring utility in a population with hearing complaints, but emphasizes the importance of a clear notion of what constitutes utility with regard to economic analyse

Mapping the disease-specific LupusQoL to the SF-6D

Purpose To derive a mapping algorithm to predict SF-6D utility scores from the non-preference-based LupusQoL and test the performance of the developed algorithm on a separate independent validation data set. Method LupusQoL and SF-6D data were collected from 320 patients with systemic lupus erythematosus (SLE) attending routine rheumatology outpatient appointments at seven centres in the UK. Ordinary least squares (OLS) regression was used to estimate models of increasing complexity in order to predict individuals’ SF-6D utility scores from their responses to the LupusQoL questionnaire. Model performance was judged on predictive ability through the size and pattern of prediction errors generated. The performance of the selected model was externally validated on an independent data set containing 113 female SLE patients who had again completed both the LupusQoL and SF-36 questionnaires. Results Four of the eight LupusQoL domains (physical health, pain, emotional health, and fatigue) were selected as dependent variables in the final model. Overall model fit was good, with R2 0.7219, MAE 0.0557, and RMSE 0.0706 when applied to the estimation data set, and R2 0.7431, MAE 0.0528, and RMSE 0.0663 when applied to the validation sample. Conclusion This study provides a method by which health state utility values can be estimated from patient responses to the non-preference-based LupusQoL, generalisable beyond the data set upon which it was estimated. Despite concerns over the use of OLS to develop mapping algorithms, we find this method to be suitable in this case due to the normality of the SF-6D data