Development and validation of the WEll-being and Satisfaction of CAREgivers of Children with Diabetes Questionnaire (WE-CARE)

This is an Open Access article distributed under the terms of the Creative Commons Attribution Licens

Using qualitative methods to inform the trade-off between content validity and consistency in utility assessment: the example of type 2 diabetes and Alzheimer's Disease

<p>Abstract</p> <p>Background</p> <p>Key stakeholders regard generic utility instruments as suitable tools to inform health technology assessment decision-making regarding allocation of resources across competing interventions. These instruments require a 'descriptor', a 'valuation' and a 'perspective' of the economic evaluation. There are various approaches that can be taken for each of these, offering a potential lack of consistency between instruments (a basic requirement for comparisons across diseases). The 'reference method' has been proposed as a way to address the limitations of the Quality-Adjusted Life Year (QALY). However, the degree to which generic measures can assess patients' specific experiences with their disease would remain unresolved. This has been neglected in the discussions on methods development and its impact on the QALY values obtained and resulting cost per QALY estimate underestimated. This study explored the content of utility instruments relevant to type 2 diabetes and Alzheimer's disease (AD) as examples, and the role of qualitative research in informing the trade-off between content coverage and consistency.</p> <p>Method</p> <p>A literature review was performed to identify qualitative and quantitative studies regarding patients' experiences with type 2 diabetes or AD, and associated treatments. Conceptual models for each indication were developed. Generic- and disease-specific instruments were mapped to the conceptual models.</p> <p>Results</p> <p>Findings showed that published descriptions of relevant concepts important to patients with type 2 diabetes or AD are available for consideration in deciding on the most comprehensive approach to utility assessment. While the 15-dimensional health related quality of life measure (15D) seemed the most comprehensive measure for both diseases, the Health Utilities Index 3 (HUI 3) seemed to have the least coverage for type 2 diabetes and the EuroQol-5 Dimensions (EQ-5D) for AD. Furthermore, some of the utility instruments contained items that could not be mapped onto either of the proposed conceptual models.</p> <p>Conclusions</p> <p>Content of the utility measure has a significant impact on the treatment effects that can be observed. This varies from one disease to the next and as such contributes to lack of consistency in observable utility effects and incremental utility scores. This observation appears to have been omitted from the method development considerations such as reference methods. As a result, we recommend that patients' perspectives obtained via qualitative methods are taken into consideration in the ongoing methods development in health state descriptions for generic utility instruments. Also, as a more immediate contribution to improving decision making, we propose that a content map of the chosen utility measure with patient-reported domains be provided as standard reporting in utility measurement in order to improve the transparency of the trade-offs in relation to patient relevance and consistency.</p

The reliability, validity and responsiveness of the Restless Legs Syndrome Quality of Life questionnaire (RLSQoL) in a trial population

BACKGROUND: The aim of this study was to determine the reliability, validity and responsiveness of the Restless Legs Syndrome Quality of Life questionnaire (RLSQoL) in a clinical trial setting. METHODS: Two matching, placebo-controlled, multinational studies assessing the effectiveness and safety of ropinirole for treating moderate-to-severe Restless Legs Syndrome (RLS) formed the basis of this psychometric assessment. Validity and reliability were assessed using baseline data. Responsiveness was determined using longitudinal data collected at baseline and 12 weeks. RESULTS: A total of 547 subjects formed the baseline validation population; 519 were used for assessing responsiveness (n = 284/263 and 271/248 for both studies, respectively). Construct validity assessment confirmed that an overall life impact score could be calculated. All item-scale correlations were = 0.4, except items 1 (r = 0.36) and 5 (r = 0.35) in one study. Floor and ceiling effects were minimal. Cronbach's alpha values were 0.82 and 0.87, respectively, confirming internal consistency reliability. Correlations with the International Restless Legs Syndrome Study Group's severity rating scale (International Restless Legs Scale; IRLS) were moderate (r = -0.68 and -0.67, respectively; p < 0.0001). The RLSQoL was able to discriminate between levels of sleep problems (p < 0.0001) and between levels of global health status determined by a Clinical Global Impression of severity (CGI-S) (p < 0.0001). Responsiveness was demonstrated by significant differences in overall life impact change scores between CGI improvement levels after 12 weeks (p < 0.0001). CONCLUSION: The RLSQoL is a valid, reliable and responsive measure of quality of life for patients with RLS, in a clinical trial setting where group comparisons are anticipated

Development and validation of the impact of dry eye on everyday life (IDEEL) questionnaire, a patient-reported outcomes (PRO) measure for the assessment of the burden of dry eye on patients

<p>Abstract</p> <p>Objective</p> <p>To develop and validate a comprehensive patient-reported outcomes instrument focusing on the impact of dry eye on everyday life (IDEEL).</p> <p>Methods</p> <p>Development and validation of the IDEEL occurred in four phases: 1) focus groups with 45 dry eye patients to develop a draft instrument, 2) item generation, 3) pilot study to assess content validity in 16 patients and 4) psychometric validation in 210 subjects: 130 with non-Sjögren's keratoconjunctivitis sicca, 32 with Sjögren's syndrome and 48 controls, and subsequent item reduction.</p> <p>Results</p> <p>Focus groups identified symptoms and the associated bother, the impact of dry eye on daily life and the patients' satisfaction with their treatment as the central concepts in patients' experience of dry eye. Qualitative analysis indicated that saturation was achieved for these concepts and yielded an initial 112-item draft instrument. Patients understood the questionnaire and found the items to be relevant indicating content validity. Patient input, item descriptive statistics and factor analysis identified 55 items that could be deleted. The final 57-item IDEEL assesses dry eye impact constituting 3 modules: dry eye symptom-bother, dry eye impact on daily life comprising impact on daily activities, emotional impact, impact on work, and dry eye treatment satisfaction comprising satisfaction with treatment effectiveness and treatment-related bother/inconvenience. The psychometric analysis results indicated that the IDEEL met the criteria for item discriminant validity, internal consistency reliability, test-retest reliability and floor/ceiling effects. As expected, the correlations between IDEEL and the Dry Eye Questionnaire (a habitual symptom questionnaire) were higher than between IDEEL and Short-Form-36 and EuroQoL-5D, indicating concurrent validity.</p> <p>Conclusion</p> <p>The IDEEL is a reliable, valid and comprehensive questionnaire relevant to issues that are specific to dry eye patients, and meets current FDA patient-reported outcomes guidelines. The use of this questionnaire will provide assessment of the impact of dry eye on patient dry eye-related quality of life, impact of treatment on patient outcomes in clinical trials, and may aid in treatment effectiveness evaluation.</p

Pain in castration-resistant prostate cancer with bone metastases: a qualitative study

<p>Abstract</p> <p>Background</p> <p>Bone metastases are a common painful and debilitating consequence of castration-resistant prostate cancer (CPRC). Bone pain may predict patients' prognosis and there is a need to further explore CRPC patients' experiences of bone pain in the overall context of disease pathology. Due to the subjective nature of pain, assessments of pain severity, onset and progression are reliant on patient assessment. Patient reported outcome (PRO) measures, therefore, are commonly used as key endpoints for evaluating the efficacy of CRPC treatments. Evidence of the content validity of leading PRO measures of pain severity used in CRPC clinical trials is, however, limited.</p> <p>Methods</p> <p>To document patients' experience of CRPC symptoms including pain, and their impact on health-related quality of life (HRQL), semi-structured in-depth qualitative interviews were conducted with 17 patients with CRPC and bone metastases. The content validity of the Present Pain Intensity (PPI) scale from the McGill Pain Questionnaire (MPQ), and the 'Average Pain' and 'Worst Pain' items of the Brief Pain Inventory Short-Form (BPI-SF) was also assessed.</p> <p>Results</p> <p>Patients with CRPC and bone metastases present with a constellation of symptoms that can have a profound effect on HRQL. For patients in this study, bone pain was the most prominent and debilitating symptom associated with their condition. Bone pain was chronic and, despite being generally well-managed by analgesic medication, instances of breakthrough cancer pain (BTcP) were common. Cognitive debriefing of the selected PRO measures of pain severity highlighted difficulties among patients in understanding the verbal response scale (VRS) of the MPQ PPI scale. There were also some inconsistencies in the way in which the BPI-SF 'Average Pain' item was interpreted by patients. In contrast, the BPI-SF 'Worst Pain' item was well understood and interpreted consistently among patients.</p> <p>Conclusions</p> <p>Study findings support the importance of PRO measures of pain severity as key endpoints for evaluating the efficacy of treatments for CRPC, particularly for patients with bone metastases where episodes of BTcP are common. Qualitative evidence from CRPC patients supports the content validity of the BPI-SF ''Worst Pain' item and promotes use of this item for measuring pain severity in this population.</p

Exploring content and psychometric validity of newly developed assessment tools for itch and skin pain in atopic dermatitis.

BackgroundAtopic dermatitis (AD) is a common skin disorder characterized by chronic inflammation, altered skin barrier function, and inflammatory cell skin infiltration that decreases health-related quality of life (HRQoL). The study objective was to understand the patient perspective of AD burden and determine suitable patient-reported outcome (PRO) measures.MethodsThis mixed methods study involved the collection of qualitative and quantitative information from adults (≥ 18 years old) and adolescents (12 - 17 years old) with clinician-confirmed AD regarding their experiences of AD symptoms and its impact on HRQoL. The first part of the study included three stages: in-person concept elicitation (CE) interviews, a 2-week daily electronic diary (eDiary) study, and in-person cognitive debriefing (CD) interviews. An Itch numeric rating scale (NRS) (v1.0) and a Skin Pain NRS (v1.0) evaluation during CD interviews required participants to think about their 'worst' itch and 'worst' skin pain in the past 24 h. Other PRO measures allowed for psychometric testing. The second part of the study involved telephone-depth interviews (TDIs) and qualitative feedback from participants who had not participated in the CD interviews. Qualitative data were thematically analyzed. Psychometric evaluation of NRS measures was performed using eDiary data.ResultsIn the CE interviews, itch and/or itching and skin pain were the most prevalent symptoms consistently discussed by participants. Both NRS measures demonstrated strong psychometric reliability and were applicable across ages with suitable concurrent validity. During the CD interviews, some participants focused their answers on their 'average' itch/itching in the past 24 h, rather than their 'worst' itch. Some participants answered the Skin Pain NRS thinking about general pain or other types of pain, rather than skin pain specifically. Consequently, modifications to both measures addressed these issues and re-tested as paper-and-pen versions in subsequent TDIs. Itch NRS (v2.0) modifications helped participants focus on their worst itching. Most participants preferred Skin Pain NRS v2.0b, which included skin pain descriptors.ConclusionsItching and skin pain are the most important and relevant AD symptoms. The Itch NRS (v2.0) and Skin Pain NRS (v2.0b) appear to be appropriate endpoints for the assessment of itching and skin pain severity for clinical trials with adults and adolescents with AD

Development and content validity testing of a patient-reported outcomes questionnaire for the assessment of hereditary angioedema in observational studies

Background Hereditary Angioedema (HAE), a rare genetic disease, manifests as intermittent, painful attacks of angioedema. Attacks vary in frequency and severity and include skin, abdominal and life-threatening laryngeal swellings. This study aimed to develop a patient reported outcome (PRO) tool for the assessment of HAE attacks, including their management and impact on patients’ lives, for use in clinical studies, or by physicians in general practice. Methods The results of open-ended face to face concept elicitation interviews with HAE patients in Argentina (n = 10) and the US (n = 33) were used to develop the first draft questionnaire of the HAE patient reported outcomes questionnaire (HAE PRO). Subsequently, in-depth cognitive debriefing interviews were performed with HAE patients in the UK (n = 10), Brazil (n = 10), Germany (n = 11) and France (n = 12). Following input from eight multinational clinical experts further cognitive interviews were conducted in the US (n = 12) and Germany (n = 12). Patients who experienced abdominal, cutaneous or laryngeal attacks of varying severity levels were included in all rounds of interviews. Across the rounds of interviews patients discussed their HAE attack symptoms, impacts and treatments. Cognitive debriefing interviews explored patient understanding and relevance of questionnaire items. All interviews were conducted face to face following a pre-defined semi-structured interview guide in the patient’s native language. Results Patients reported a variety of HAE symptoms, attack triggers, warning signs, attack impacts and treatment options which were used to develop the HAE PRO. The HAE PRO was revised and refined following input from patients and clinical experts. The final 18-item HAE PRO provides an assessment of the HAE attack experience including symptoms, impacts, treatment requirements, healthcare resource use and loss of productivity caused by HAE attacks. Conclusions Patient and expert input has contributed to the development of a content valid questionnaire that assesses concepts important to HAE patients globally. HAE patients across cultures consider the HAE PRO a relevant and appropriate assessment of HAE attacks and treatment

Patient experiences with oily skin: The qualitative development of content for two new patient reported outcome questionnaires

<p>Abstract</p> <p>Objective</p> <p>To develop the content for two new patient reported outcome (PRO) measures to: a) assess the severity of symptoms; and b) the impact of facial skin oiliness on emotional wellbeing using qualitative data from face to face, and internet focus groups in Germany and the US.</p> <p>Methods</p> <p>Using input from initial treatment satisfaction focus groups (n = 42), a review of relevant literature and expert clinicians (n = 3), a discussion guide was developed to guide qualitative inquiry using Internet focus groups (IFGs). IFGs were conducted with German (n = 26) and US (n = 28) sufferers of oily skin. Questionnaire items were generated using coded transcript data from the focus groups. Cognitive debriefing was conducted online with 42 participants and face to face with an additional five participants to assess the comprehension of the items.</p> <p>Results</p> <p>There were equal numbers of male and female participants; mean age was 35.4 (SD 9.3) years. On average, participants had had oily skin for 15.2 years, and 74% (n = 40) reported having mild-moderate acne. Participants reported using visual, tactile and sensory (feel without touching their face) methods to evaluate the severity of facial oiliness. Oily facial skin had both an emotional and social impact, and was associated with feelings of unattractiveness, self-consciousness, embarrassment, irritation and frustration. Items were generated for a measure of oily skin severity (Oily Skin Self-Assessment Scale) and a measure of the impact of oily skin on emotional well-being (Oily Skin Impact Scale). Cognitive debriefing resulted in minor changes to the draft items and confirmed their face and content validity.</p> <p>Conclusion</p> <p>The research provides insight into the experience of having oily skin and illustrates significant difficulties associated with the condition. Item content was developed for early versions of two PRO measures of the symptoms and emotional impact of oily facial skin. The psychometric validation of these measures reported elsewhere.</p

Developing fit-for-purpose self-report instruments for assessing consumer responses to tobacco and nicotine products: the ABOUT™ Toolbox initiative [version 1; referees: 2 approved]

Background. Determining the public health impact of tobacco harm reduction strategies requires the assessment of consumer perception and behavior associated with tobacco and nicotine products (TNPs) with different exposure and risk profiles. In this context, rigorous methods to develop and validate psychometrically sound self-report instruments to measure consumers’ responses to TNPs are needed. Methods. Consistent with best practice guidelines, including the U.S. Food and Drug Administration’s “Guidance for Industry Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims,” scientifically designed, fit-for-purpose, reliable, and valid instruments are now being applied to tobacco regulatory research. Results. This brief report presents the ABOUT™ Toolbox (Assessment of Behavioral OUtcomes related to Tobacco and nicotine products) initiative. This communication: (1) describes the methodological steps followed for the development and validation of the measurement instruments included in the ABOUT™ Toolbox, (2) presents a summary of the high-priority tobacco-related domains that are currently covered in the ABOUT™ Toolbox (i.e., risk perception, dependence, product experience, health and functioning, and use history), and (3) details how the measurement instruments are made accessible to the scientific community. Conclusions. By making the ABOUT™ Toolbox available to the tobacco research and public health community, we envision a rapidly expanding knowledge base, with the goals of (1) supporting consumer perception and behavior research to allow comparisons across a wide spectrum of TNPs, (2) enabling public health and regulatory communities to make better-informed decisions for future regulation of TNPs, and (3) enhancing surveillance activities associated with the impact of TNPs on population health

The impact of iron overload and its treatment on quality of life: results from a literature review

BACKGROUND: To assess the literature for the impact of iron overload and infusion Iron Chelation Therapy (ICT) on patients' quality of life (QoL), and the availability of QoL instruments for patients undergoing infusion ICT. Also, to obtain patients' experiences of having iron overload and receiving infusion ICT, and experts' clinical opinions about the impact of treatment on patients' lives. METHODS: A search of studies published between 1966 and 2004 was conducted using Medline and the Health Economic Evaluation Database (HEED). Qualitative results from patient and expert interviews were analysed. Hand searching of relevant conference abstracts completed the search. RESULTS: Few studies measuring the impact of ICT with deferoxamine (DFO) on patients QoL were located (n = 15). QoL domains affected included: depression; fatigue; dyspnoea; physical functioning; psychological distress; decrease in QoL during hospitalization. One theme in all articles was that oral ICT should improve QoL. No iron overload or ICT-specific QoL instruments were located in the articles. Interviews revealed that the impact of ICT on patients with thalassemia, sickle cell disease, and myelodysplastic syndromes is high. CONCLUSION: A limited number of studies assessed the impact of ICT or iron overload on QoL. All literature suggested a need for easily administered, efficacious and well tolerated oral iron overload treatments, given the impact of current ICT on adherence. Poor adherence to ICT was documented to negatively impact survival. Further research is warranted to continue the qualitative and quantitative study of QoL using validated instruments in patients receiving ICT to further understanding the issues and improve patients QoL