Comparing the measurement equivalence of EQ-5D-5L across different modes of administration

Background: Interest in collecting Patient Reported Outcomes using electronic methods such as mobile phones has increased in recent years. However there is debate about the level of measurement equivalence between the traditional paper and newer electronic modes. Information about the acceptability of the electronic versions to respondents is also required. The aim of this study is to compare the equivalence of delivering a widely used generic measure of health status (EQ-5D-5L) across two administration modes (paper and mobile phone). Methods: Respondents from a research cohort of people in South Yorkshire were identified, and randomly allocated to one of two administration modes (paper vs. mobile phone) based on stratifications for age and gender (and across a range of self-reported health conditions). A parallel group design was used where each respondent only completed EQ-5D-5L using one of the modes. In total, 70 respondents completed the measure in the mobile phone arm, and 66 completed the standard paper version. Follow up usability questions were also included to assess the acceptability of the mobile version of EQ-5D-5L. Measurement equivalence was compared at the dimension, utility score and visual analogue scale level using chi square analysis and ANOVA, and by comparing mean differences to an estimated minimally important difference value. Results: Response rates were higher in the mobile arm. The mean EQ-5D-5L utility and VAS scores, and the frequency of respondents endorsing individual EQ-5D-5L dimension response levels did not significantly differ across the administration modes. The majority of the mobile arm agreed that the mobile version of EQ-5D-5L was easy to complete, and that the phone was easy to use, and that they would complete mobile health measures again. Conclusions: Completing health status measures such as EQ-5D using mobile phones produces equivalent results to more traditional methods, but with added benefits (for example lessening the burden of data entry). Respondents are positive towards completing questionnaires using these methods. The results provide evidence that electronic measures are valid for use to collect data in a range of settings including clinical trials, routine care, and in health diary settings

Study protocol of a Dutch smoking cessation e-health program

<p>Abstract</p> <p>Background</p> <p>The study aims to test the differential effects of a web-based text and a web-based video-driven computer-tailored approach for lower socio-economic status (LSES) and higher socio-economic status (HSES) smokers which incorporate multiple computer-tailored feedback moments. The two programs differ only in the mode of delivery (video- versus text-based messages). The paper aims to describe the development and design of the two computer-tailored programs.</p> <p>Methods/design</p> <p>Respondents who smoked at the time of the study inclusion, who were motivated to quit within the following six months and who were aged 18 or older were included in the program. The study is a randomized control trial with a 2 (video/text) * 2(LSES/HSES) design. Respondents were assigned either to one of the intervention groups (text versus video tailored feedback) or to the control group (non-tailored generic advice). In all three conditions participants were asked to fill in the baseline questionnaire based on the I-Change model. The questionnaire assessed socio-demographics, attitude towards smoking, knowledge, self-efficacy, social influence, depression, level of addiction, action planning, goal actions, intention to quit smoking, seven-day point prevalence and continued abstinence. Follow-up measurements were conducted at six and twelve months after baseline.</p> <p>Discussion</p> <p>The present paper describes the development of the two computer-tailored smoking cessation programs, their components and the design of the study. The study results reveal different working mechanisms of multiple tailored smoking cessation interventions and will help us to gain more insight into effective strategies to target different subgroups, especially smokers with a lower socio-economic status.</p> <p>Trial registration</p> <p>Dutch Trial Register <a href="http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=NTR3102">NTR3102</a></p

Understanding and assessing the impact of treatment in diabetes: the Treatment-Related Impact Measures for Diabetes and Devices (TRIM-Diabetes and TRIM-Diabetes Device)

<p>Abstract</p> <p>Purpose</p> <p>Diabetes is a debilitating illness requiring lifelong management. Treatments can be varied in terms of mode of administration as well as type of agent. Unfortunately, most patient reported outcome measures currently available to assess the impact of treatment are specific to diabetes type, treatment modality or delivery systems and are designed to be either a HRQoL or treatment satisfaction measure. To address these gaps, the Treatment Related Impact Measure-Diabetes and Device measures were developed. This paper presents the item development and validation of the TRIM Diabetes/Device.</p> <p>Methods</p> <p>Patient interviews were conducted to collect the patient perspective and ensure high content validity. Interviews were hand coded and qualitatively analyzed to identify common themes. A conceptual model of the impact of diabetes medication was developed and preliminary items for the TRIM-Diabetes/Device were generated and cognitively debriefed. Validation data was collected via an on-line survey and analyzed according to an a priori statistical analysis plan to validate the overall score as well as each domain. Item level criteria were used to reduce the preliminary item pool. Next, factor analysis to identify structural domains was performed. Reliability and validity testing was then performed.</p> <p>Results</p> <p>One hundred and five patients were interviewed in focus groups, individual interviews and for cognitive debriefing. Five hundred seven patients participated in the validation study. Factor analysis identified seven domains: Treatment Burden, Daily Life; Diabetes Management; Psychological Health; Compliance and Device Function and Bother. Internal consistency reliability coefficients of the TRIM-Diabetes/Device ranged from 0.80 and 0.94. Test-retest reliability of the TRIM-Diabetes/Device ranged from 0.71 to 0.89. All convergent and known groups validity hypotheses were met for the TRIM-Diabetes/Device total scores and sub-scales.</p> <p>Conclusion</p> <p>Validation is an ongoing and iterative process. These findings are the first step in that process and have shown that both the TRIM-Diabetes and the TRIM-Diabetes Device have acceptable psychometric properties. Future research is needed to continue the validation process and examine responsiveness and the validity of the TRIM-Diabetes/Device in a clinical trial population.</p

Integrating cancer survivors' experiences into UK cancer registries: design and development of the ePOCS system (electronic Patient-reported Outcomes from Cancer Survivors)

BACKGROUND: Understanding the psychosocial challenges of cancer survivorship, and identifying which patients experience ongoing difficulties, is a key priority. The ePOCS (electronic patient-reported outcomes from cancer survivors) project aims to develop and evaluate a cost-efficient, UK-scalable electronic system for collecting patient-reported outcome measures (PROMs), at regular post-diagnostic timepoints, and linking these with clinical data in cancer registries. METHODS: A multidisciplinary team developed the system using agile methods. Design entailed process mapping the system's constituent parts, data flows and involved human activities, and undertaking usability testing. Informatics specialists built new technical components, including a web-based questionnaire tool and tracking database, and established component-connecting data flows. Development challenges were overcome, including patient usability and data linkage and security. RESULTS: We have developed a system in which PROMs are completed online, using a secure questionnaire administration tool, accessed via a public-facing website, and the responses are linked and stored with clinical registry data. Patient monitoring and communications are semiautomated via a tracker database, and patient correspondence is primarily Email-based. The system is currently honed for clinician-led hospital-based patient recruitment. CONCLUSIONS: A feasibility test study is underway. Although there are possible challenges to sustaining and scaling up ePOCS, the system has potential to support UK epidemiological PROMs collection and clinical data linkage

Validity and reliability of telephone administration of the patient-specific functional scale for the assessment of recovery from snakebite envenomation

Objectives: Although more than 1.8 million people survive snakebite envenomation each year, their recovery is understudied. Obtaining long-term follow-up is challenging in both high- and low-resource settings. The Patient-Specific Functional Scale (PSFS) is an easily administered, well-accepted patient-reported outcome that is validated for assessing limb recovery from snakebite envenomation. We studied whether the PSFS is valid and reliable when administered by telephone. Methods: This is a secondary analysis of data from a randomized clinical trial. We analyzed the results of PSFS collected in-person on days 3, 7, 14, 21, and 28 and by telephone on days 10, 17, and 24. We assessed the following scale psychometric properties: (a) content validity (ceiling and floor effects), (b) internal structure and consistency (Cronbach’s alpha), and (c) temporal and external validity using Intraclass Correlation Coefficient (ICC). Temporal stability was assessed using Spearman’s correlation coefficient and agreement between adjacent in-person and telephonic assessments with Cohen’s kappa. Bland Altman analysis was used to assess differential bias in low and high score results. Results: Data from 74 patients were available for analysis. Floor effects were seen in the early post-injury time points (median: 3 (IQR: 0, 5) at 3 days post-enrollment) and ceiling effects in the late time points (median: 9 (IQR: 8, 10). Internal consistency was good to excellent with both in-person (Cronbach α: 0.91 (95%CI 0.88, 0.95)) and telephone administration (0.81 (0.73, 0.89). Temporal stability was also good (ICC: 0.83 (0.72, 0.89) in-person, 0.80 (0.68, 0.88) telephone). A strong linear correlation was found between in-person and telephone administration (Spearman’s �: 0.83 (CI: 0.78, 0.84), consistency was assessed as excellent (Cohen’s κ 0.81 (CI: 0.78, 0.84), and Bland Altman analysis showed no systematic bias. Conclusions: Telephone administration of the PSFS provides valid, reliable, and consistent data for the assessment of recovery from snakebite envenomation

Relapse prevention for addictive behaviors

The Relapse Prevention (RP) model has been a mainstay of addictions theory and treatment since its introduction three decades ago. This paper provides an overview and update of RP for addictive behaviors with a focus on developments over the last decade (2000-2010). Major treatment outcome studies and meta-analyses are summarized, as are selected empirical findings relevant to the tenets of the RP model. Notable advances in RP in the last decade include the introduction of a reformulated cognitive-behavioral model of relapse, the application of advanced statistical methods to model relapse in large randomized trials, and the development of mindfulness-based relapse prevention. We also review the emergent literature on genetic correlates of relapse following pharmacological and behavioral treatments. The continued influence of RP is evidenced by its integration in most cognitive-behavioral substance use interventions. However, the tendency to subsume RP within other treatment modalities has posed a barrier to systematic evaluation of the RP model. Overall, RP remains an influential cognitive-behavioral framework that can inform both theoretical and clinical approaches to understanding and facilitating behavior change

Mode equivalence and acceptability of tablet computer-, interactive voice response system-, and paper-based administration of the U.S. National Cancer Institute’s Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE)

Background PRO-CTCAE is a library of items that measure cancer treatment-related symptomatic adverse events (NCI Contracts: HHSN261201000043C and HHSN 261201000063C). The objective of this study is to examine the equivalence and acceptability of the three data collection modes (Web-enabled touchscreen tablet computer, Interactive voice response system [IVRS], and paper) available within the US National Cancer Institute (NCI) Patient-Reported Outcomes version of the Common Terminology Criteria for Adverse Events (PRO-CTCAE) measurement system. Methods Participants (n = 112; median age 56.5; 24 % high school or less) receiving treatment for cancer at seven US sites completed 28 PRO-CTCAE items (scoring range 0–4) by three modes (order randomized) at a single study visit. Subjects completed one page (approx. 15 items) of the EORTC QLQ-C30 between each mode as a distractor. Item scores by mode were compared using intraclass correlation coefficients (ICC); differences in scores within the 3-mode crossover design were evaluated with mixed-effects models. Difficulties with each mode experienced by participants were also assessed. Results 103 (92 %) completed questionnaires by all three modes. The median ICC comparing tablet vs IVRS was 0.78 (range 0.55–0.90); tablet vs paper: 0.81 (0.62–0.96); IVRS vs paper: 0.78 (0.60–0.91); 89 % of ICCs were ≥0.70. Item-level mean differences by mode were small (medians [ranges] for tablet vs. IVRS = −0.04 [−0.16–0.22]; tablet vs paper = −0.02 [−0.11–0.14]; IVRS vs paper = 0.02 [−0.07–0.19]), and 57/81 (70 %) items had bootstrapped 95 % CI around the effect sizes within +/−0.20. The median time to complete the questionnaire by tablet was 3.4 min; IVRS: 5.8; paper: 4.0. The proportion of participants by mode who reported “no problems” responding to the questionnaire was 86 % tablet, 72 % IVRS, and 98 % paper. Conclusions Mode equivalence of items was moderate to high, and comparable to test-retest reliability (median ICC = 0.80). Each mode was acceptable to a majority of respondents. Although the study was powered to detect moderate or larger discrepancies between modes, the observed ICCs and very small mean differences between modes provide evidence to support study designs that are responsive to patient or investigator preference for mode of administration, and justify comparison of results and pooled analyses across studies that employ different PRO-CTCAE modes of administration. Trial registration NCT Clinicaltrials.gov identifier: NCT0215863

Nicotine patch preloading for smoking cessation (the preloading trial): study protocol for a randomized controlled trial

Background: The use of nicotine replacement therapy before quitting smoking is called nicotine preloading. Standard smoking cessation protocols suggest commencing nicotine replacement therapy only on the first day of quitting smoking (quit day) aiming to reduce withdrawal symptoms and craving. However, other, more successful smoking cessation pharmacotherapies are used prior to the quit day as well as after. Nicotine preloading could improve quit rates by reducing satisfaction from smoking prior to quitting and breaking the association between smoking and reward. A systematic literature review suggests that evidence for the effectiveness of preloading is inconclusive and further trials are needed. Methods/Design: This is a study protocol for a multicenter, non-blinded, randomized controlled trial based in the United Kingdom, enrolling 1786 smokers who want to quit, funded by the National Institute for Health Research, Health Technology Assessment program, and sponsored by the University of Oxford. Participants will primarily be recruited through general practices and smoking cessation clinics, and randomized (1:1) either to use 21 mg nicotine patches, or not, for four weeks before quitting, whilst smoking as normal. All participants will be referred to receive standard smoking cessation service support. Follow-ups will take place at one week, four weeks, six months and 12 months after quit day. The primary outcome will be prolonged, biochemically verified six-month abstinence. Additional outcomes will include point prevalence abstinence and abstinence of four-week and 12-month duration, side effects, costs of treatment, and markers of potential mediators and moderators of the preloading effect. Discussion: This large trial will add substantially to evidence on the effectiveness of nicotine preloading, but also on its cost effectiveness and potential mediators, which have not been investigated in detail previously. A range of recruitment strategies have been considered to try and compensate for any challenges encountered in recruiting the large sample, and the multicentre design means that knowledge can be shared between recruitment teams. The pragmatic study design means that results will give a realistic estimate of the success of the intervention if it were to be rolled out as part of standard smoking cessation service practice. Trial registration: Current Controlled Trials ISRCTN33031001. Registered 27 April 2012