A Think Aloud Study Comparing the Validity and Acceptability of Discrete Choice and Best Worst Scaling Methods

Objectives This study provides insights into the validity and acceptability of Discrete Choice Experiment (DCE) and profile-case Best Worst Scaling (BWS) methods for eliciting preferences for health care in a priority-setting context. Methods An adult sample (N = 24) undertook a traditional DCE and a BWS choice task as part of a wider survey on Health Technology Assessment decision criteria. A ‘think aloud’ protocol was applied, whereby participants verbalized their thinking while making choices. Internal validity and acceptability were assessed through a thematic analysis of the decision-making process emerging from the qualitative data and a repeated choice task. Results A thematic analysis of the decision-making process demonstrated clear evidence of ‘trading’ between multiple attribute/levels for the DCE, and to a lesser extent for the BWS task. Limited evidence consistent with a sequential decision-making model was observed for the BWS task. For the BWS task, some participants found choosing the worst attribute/level conceptually challenging. A desire to provide a complete ranking from best to worst was observed. The majority (18,75%) of participants indicated a preference for DCE, as they felt this enabled comparison of alternative full profiles. Those preferring BWS were averse to choosing an undesirable characteristic that was part of a ‘package’, or perceived BWS to be less ethically conflicting or burdensome. In a repeated choice task, more participants were consistent for the DCE (22,92%) than BWS (10,42%) (p = 0.002). Conclusions This study supports the validity and acceptability of the traditional DCE format. Findings relating to the application of BWS profile methods are less definitive. Research avenues to further clarify the comparative merits of these preference elicitation methods are identified

The relationship between quality of life, health and care transition: an empirical comparison in an older post-acute population

Background: The aim of this study was to explore, via empirical comparison, the relationship between quality of life, as measured by the ICECAP-O capability index (a new instrument designed to measure and value quality of life in older people), with both self-reported health status and the quality of care transition in adults aged 65 and over participating in two post-acute rehabilitation programs (outpatient day rehabilitation and the Australian National Transition Care residential program). Methods: The ICECAP-O was administered to patients receiving either outpatient day rehabilitation (n=53) or residential transition care (n=29) during a face to face interview. The relationships between the ICECAP-O and other instruments, including the EQ-5D (a self-reported measure of health status) and CTM-3 (a self-reported measure of the quality of care transitions), the type of post-acute care being received and socio-demographic characteristics were examined. Results: The mean ICECAP-O score for the total sample was 0.81 (SD: 0.15). Patients receiving outpatient day rehabilitation generally reported higher levels of capability, than p atients receiving residential transition care (mean 0.82 [SD: 0.15] and 0.79 [SD: 0.164] re spectively), however these differences were not statistically significant. The mean EQ-5D score for the total sample was somewhat lower than the ICECAP-O (mean 0.52; SD: 0.27) indicating significant levels of health i mpairment with the outpatient day rehabilitation group demonstrating slightly higher levels of health status than the transition care group (mean 0.54 [SD: 0.254] and mean 0.49 [SD: 0.30]). The ICECAP-O was found to be positively correlated with both the CTM-3 (Spearman ’ s r =0.234; p ≤ 0.05) and the EQ-5D (Spearman ’ sr=0.437;p ≤ 0.001). The relationships between the total EQ-5D and CTM-3 scores and the individual attributes of the ICECAP-O indicate health status and quality of care transition in this patient population to be influential in some, but not all aspects of capability. Conclusions: The correlations between the ICECAP-O, EQ-5D and CTM-3 instruments illustrate that capability is strongly and positively associated with health-related quality of life and the quality of care transitions. However further research is required to further examine the construct validity of the ICECAP-O and to examine its potential for incorporation into economic evaluation

Physiotherapy after arthroscopic partial meniscectomy surgery: An assessment of costs to the National Health Service, patients and society

Objectives: The purpose of this study was to determine and inform clinicians, managers, and budget allocators of the costs incurred to the British National Health Service (NHS), patient, and society when attending clinic-based physiotherapy compared with not attending clinic-based physiotherapy after arthroscopic partial meniscectomy surgery. Methods: The valuation principle used in this study was the economic concept of opportunity cost. Costs were referred to as direct medical (NHS), direct nonmedical (patient), and indirect (societal) costs. Due to the difficulties of their measurement and valuation, intangible costs, in the form of pain and anxiety related to the effect of receiving or not receiving treatment, have not been considered in this analysis. Results: Providing clinic-based physiotherapy after knee arthroscopic partial meniscectomy surgery is more costly to the NHS and patient, but no more costly to society than when not providing it and does not result in reduced contact with the NHS. Conclusions: Clinic-based physiotherapy after knee arthroscopic partial meniscectomy surgery is costly and evidence is needed that its effectiveness is high enough to support its use

The relative value of different QALY types

The oft-applied assumption in the use of Quality Adjusted Life Years (QALYs) in economic evaluation, that all QALYs are valued equally, has been questioned from the outset. The literature has focused on differential values of a QALY based on equity considerations such as the characteristics of the beneficiaries of the QALYs. However, a key characteristic which may affect the value of a QALY is the type of QALY itself. QALY gains can be generated purely by gains in survival, purely by improvements in quality of life, or by changes in both. Using a discrete choice experiment and a new methodological approach to the derivation of relative weights, we undertake the first direct and systematic exploration of the relative weight accorded different QALY types and do so in the presence of equity considerations; age and severity. Results provide new evidence against the normative starting point that all QALYs are valued equally.This study was funded by an Australian National Health and Medical Research Council project grant APP1047788

Measuring technology self efficacy: reliability and construct validity of a modified computer self efficacy scale in a clinical rehabilitation setting

Author version made available in accordance with the Publisher's policy.Purpose: To describe a modification of the Computer Self Efficacy Scale for use in clinical settings and to report on the modified scale’s reliability and construct validity. Methods: The Computer Self Efficacy Scale was modified to make it applicable for clinical settings (for use with older people or people with disabilities using everyday technologies). The modified scale was piloted, then tested with patients in an Australian inpatient rehabilitation setting (n=88) to determine the internal consistency using Cronbach’s alpha coefficient. Construct validity was assessed by correlation of the scale with age and technology use. Factor analysis using principal components analysis was undertaken to identify important constructs within the scale. Results: The modified Computer Self Efficacy scale demonstrated high internal consistency with a standardised alpha coefficient of 0.94. Two constructs within the scale were apparent; using the technology alone, and using the technology with the support of others. Scores on the scale were correlated with age and frequency of use of some technologies thereby supporting construct validity. Conclusions: The modified Computer Self Efficacy Scale has demonstrated reliability and construct validity for measuring the self efficacy of older people or people with disabilities when using everyday technologies. This tool has the potential to assist clinicians in identifying older patients who may be more open to using new technologies to maintain independence

Virtual reality stroke rehabilitation – hype or hope?

Author version made in accordance with Publisher copyright policy

Where’s the evidence? a systematic review of economic analyses of residential aged care infrastructure

© The Author(s). 2017 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.Background Residential care infrastructure, in terms of the characteristics of the organisation (such as proprietary status, size, and location) and the physical environment, have been found to directly influence resident outcomes. This review aimed to summarise the existing literature of economic evaluations of residential care infrastructure. Methods A systematic review of English language articles using AgeLine, CINAHL, Econlit, Informit (databases in Health; Business and Law; Social Sciences), Medline, ProQuest, Scopus, and Web of Science with retrieval up to 14 December 2015. The search strategy combined terms relating to nursing homes, economics, and older people. Full economic evaluations, partial economic evaluations, and randomised trials reporting more limited economic information, such as estimates of resource use or costs of interventions were included. Data was extracted using predefined data fields and synthesized in a narrative summary to address the stated review objective. Results Fourteen studies containing an economic component were identified. None of the identified studies attempted to systematically link costs and outcomes in the form of a cost-benefit, cost-effectiveness, or cost-utility analysis. There was a wide variation in approaches taken for valuing the outcomes associated with differential residential care infrastructures: 8 studies utilized various clinical outcomes as proxies for the quality of care provided, and 2 focused on resident outcomes including agitation, quality of life, and the quality of care interactions. Only 2 studies included residents living with dementia. Conclusions Robust economic evidence is needed to inform aged care facility design. Future research should focus on identifying appropriate and meaningful outcome measures that can be used at a service planning level, as well as the broader health benefits and cost-saving potential of different organisational and environmental characteristics in residential care

Advancing aged care: a systematic review of economic evaluations of workforce structures and care processes in a residential care setting

This is an open access article. This article is distributed under the terms of the Creative Commons Attribution 4.0 International License http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.Long-term care for older people is provided in both residential and non-residential settings, with residential settings tending to cater for individuals with higher care needs. Evidence relating to the costs and effectiveness of different workforce structures and care processes is important to facilitate the future planning of residential aged care services to promote high quality care and to enhance the quality of life of individuals living in residential care. A systematic review conducted up to December 2015 identified 19 studies containing an economic component; seven included a complete economic evaluation and 12 contained a cost analysis only. Key findings include the potential to create cost savings from a societal perspective through enhanced staffing levels and quality improvement interventions within residential aged care facilities, while integrated care models, including the integration of health disciplines and the integration between residents and care staff, were shown to have limited cost-saving potential. Six of the 19 identified studies examined dementia-specific structures and processes, in which person-centred interventions demonstrated the potential to reduce agitation and improve residents’ quality of life. Importantly, this review highlights methodological limitations in the existing evidence and an urgent need for future research to identify appropriate and meaningful outcome measures that can be used at a service planning level

Valuing EQ-5D health states: A review and analysis, CHERE Working Paper 2007/9

Objective: To identify the key methodological issues in the construction of population-level EQ-5D / Time Trade-Off (TTO) preference elicitation studies. Study Design: This study involves three components. The first was to identify existing population-level EQ-5D TTO studies. The second was to illustrate and discuss the key areas of divergence between studies, including the international comparison of tariffs. The third was to portray the relative merits of each of the approaches, and to compare the results of studies across countries. Results: While most papers report use of the protocol developed in the original UK study, we identified three key areas of divergence in the construction and analysis of surveys. These are the number of health states valued in order to determine the algorithm for estimating all health states, the approach to valuing states worse than immediate death, and the choice of algorithm. Finally, the evidence on international comparisons suggests differences between countries, although it is difficult to disentangle differences in cultural attitudes with random error and differences due to methodological divergence. Conclusion: Differences in methods are likely to obscure true differences in values between countries. However, population-specific valuation sets for countries engaging in economic evaluation would better represent societal attitudes.health state valuation, EQ5-D