Conceptualisation, development and validation of T-QoL© (Teenagers' Quality of Life): a patient-focused measure to assess quality of life of adolescents with skin diseases

Aim To develop and validate a dermatology-specific quality of life (QoL) instrument for adolescents with skin diseases. Methods Qualitative semi-structured interviews were conducted with adolescents with skin disease to gain in-depth understanding of how skin diseases affect their QoL. A prototype instrument based on the themes identified from content analysis of interviews was tested in several stages, using Classical Test Theory (CTT) and Item Response Theory (IRT) models to develop this new tool and conduct its psychometric evaluation. Results Thirty-three QoL issues were identified from semi-structured interviews with 50 adolescents. A questionnaire based on items derived from content analysis of interviews was subjected to Rasch analysis: factor analysis identified three domains, therefore not supporting the validity of T-QoL as a unidimensional measure. Psychometric evaluation of the final 18-item questionnaire was carried out in a cohort of 203 adolescents. Convergent validity was demonstrated by significant correlation with Skindex-Teen and CDLQI or DLQI. The T-QoL showed excellent internal consistency reliability: Cronbach's α=0.89 for total scale score and 0.85, 0.60, and 0.74 respectively for domains 1, 2 and 3. Test-retest reliability was high in stable subjects. T-QoL showed sensitivity to change in two sub-groups of patients who indicated change in their self-assessed disease severity. Conclusion Built on rich qualitative data from patients, the T-QoL is a simple and valid tool to quantify the impact of skin disease on adolescents’ QoL; it could be used as an outcome measure in both clinical practice and clinical research

Reliability and responsiveness of measures of pain in people with osteoarthritis of the knee: a psychometric evaluation

PURPOSE: To examine the fit between data from the Short Form McGill Pain Questionnaire (SF-MPQ-2) and the Rasch model, and to explore the reliability and internal responsiveness of measures of pain in people with knee osteoarthritis. METHODS: Participants with knee osteoarthritis completed the SF-MPQ-2, Intermittent and Constant Osteoarthritis Pain questionnaire (ICOAP) and painDETECT. Participants were sent the same questionnaires 3 and 6 months later. RESULTS: Fit to the Rasch model was not achieved for the SF-MPQ-2 Total scale. The Continuous subscale yielded adequate fit statistics after splitting item 10 on uniform DIF for gender, and removing item 9. The Intermittent subscale fit the Rasch model after rescoring items. The Neuropathic subscale had relatively good fit to the model. Test-retest reliability was satisfactory for most scales using both original and Rasch scoring ranging from fair to substantial. Effect sizes ranged from 0.13 to 1.79 indicating good internal responsiveness for most scales. CONCLUSIONS: These findings support the use of ICOAP subscales as reliable and responsive measure of pain in people with knee osteoarthritis. The MPQ-SF-2 subscales found to be acceptable alternatives. Implications for Rehabilitation The McGill Pain Questionnaire short version 2 is not a unidimensional scale in people with knee osteoarthritis, whereas three of the subscales are unidimensional. The McGill Pain Questionnaire short version 2 Affective subscale does not have good measurement properties for people with knee osteoarthritis. The McGill Pain Questionnaire short version 2 and the Intermittent and Constant Osteoarthritis Pain scales can be used to assess change over time. The painDETECT performs better as a screening measure than as an outcome measure

Reliability and Validity of the Telephone-Based eHealth Literacy Scale Among Older Adults: Cross-Sectional Survey

Background: Only a handful of studies have examined reliability and validity evidence of scores produced by the 8-item eHealth literacy Scale (eHEALS) among older adults. Older adults are generally more comfortable responding to survey items when asked by a real person rather than by completing self-administered paper-and-pencil or online questionnaires. However, no studies have explored the psychometrics of this scale when administered to older adults over the telephone. Objective: The objective of our study was to examine the reliability and internal structure of eHEALS data collected from older adults aged 50 years or older responding to items over the telephone. Methods: Respondents (N=283) completed eHEALS as part of a cross-sectional landline telephone survey. Exploratory structural equation modeling (E-SEM) analyses examined model fit of eHEALS scores with 1-, 2-, and 3-factor structures. Subsequent analyses based on the partial credit model explored the internal structure of eHEALS data. Results: Compared with 1- and 2-factor models, the 3-factor eHEALS structure showed the best global E-SEM model fit indices (root mean square error of approximation=.07; comparative fit index=1.0; Tucker-Lewis index=1.0). Nonetheless, the 3 factors were highly correlated (r range .36 to .65). Item analyses revealed that eHEALS items 2 through 5 were overfit to a minor degree (mean square infit/outfit values <1.0; t statistics less than –2.0), but the internal structure of Likert scale response options functioned as expected. Overfitting eHEALS items (2-5) displayed a similar degree of information for respondents at similar points on the latent continuum. Test information curves suggested that eHEALS may capture more information about older adults at the higher end of the latent continuum (ie, those with high eHealth literacy) than at the lower end of the continuum (ie, those with low eHealth literacy). Item reliability (value=.92) and item separation (value=11.31) estimates indicated that eHEALS responses were reliable and stable. Conclusions: Results support administering eHEALS over the telephone when surveying older adults regarding their use of the Internet for health information. eHEALS scores best captured 3 factors (or subscales) to measure eHealth literacy in older adults; however, statistically significant correlations between these 3 factors suggest an overarching unidimensional structure with 3 underlying dimensions. As older adults continue to use the Internet more frequently to find and evaluate health information, it will be important to consider modifying the original eHEALS to adequately measure societal shifts in online health information seeking among aging populations.Open Access Fundin

Refinement of the Child Amblyopia Treatment Questionnaire (CAT-QoL) using Rasch analysis

Aims or Purpose: The Child Amblyopia Treatment Questionnaire (CAT-QoL) was developed using a "bottom-up" methodological approach. Interviews with children with amblyopia identified items (questions) and response levels to be tested in a draft questionnaire consisting of 11 items (sad, feeling on face, hurt, doing schoolwork, cross, how other children treat you, doing things, worried, upset with family, playing with friends, happy). This study describes the refinement of the descriptive system for the CAT-QoL instrument using the application of Rasch analysis. METHODS: A multi-centre pilot study was conducted, and data collected from 342 participants. Participants were asked to self-complete the appropriate treatment version of the CAT-QoL questionnaire socio-demographic and clinical data were collected by the clinician using a standardised proforma. A "measure" of child's health was obtained from the parent by asking how they would rate their child's health over the previous week. Rasch analysis techniques were applied to refine the questionnaire. Rasch was used to examine response categories and collapse item response levels, identify poorly performing items, and explore local dependency of items. RESULTS: A total of 331 subjects were included in the study sample, however only 315 were accepted into the RUMM program as a number of subjects had missing questions responses on the CAT-QoL. RUMM also excluded a further 41 subjects as these demonstrated extreme responses. Disordered response categories were found for each item, requiring adjacent response levels to be combined. This was applied to all items, and the model fit was re-examined. Two items were found to have poor fit (cross and happy) and were removed from the measure and the model fit was re-examined. No statistically significant differential item functioning (DIF) was found for any item, using person factors of age, sex or general health. Two items showed some dependency (worried and upset with family), and the poorer fitting item was subsequently removed (upset with family). This resulted in a refined CAT-QoL instrument that consists of 8-items, each with three-level response scales. CONCLUSION: The refined CAT-QoL instrument includes the following items: sad, feeling on face, hurt, doing work at school, how other children treat you, doing things, worried and playing with friends. The CAT-QoL can be Rasch scored, with a range of 0-16 where a greater value indicates a worse quality of life (or greater impact of treatment on the individual). The CAT-QoL may be useful in determining how amblyopia treatment affects children, and offers an alternative to generic patient reported outcome measures

The development and piloting of the graduate assessment of preparedness for practice (GAPP) questionnaire

Introduction Most new dental graduates in the UK begin their professional career following a year in dental foundation training (DFT). There has been little investigation of how prepared they feel for independent general dental practice across all four domains of the General Dental Council’s curriculum ‘Preparing for practice’. This paper describes the development of the Graduate Assessment of Preparedness for Practice (GAPP) questionnaire to address this. Methodology The GAPP questionnaire was developed and piloted using a cohort of educational supervisors (ESs) and foundation dentists (FDs). The questionnaire comprised three parts, the first of which collected respondent demographic data. The second was based on Preparing for practice and was used to develop 34 ‘competence areas’ and required a tick-box response on a 7‑category Likert Scale. The third comprised free text questions in order to further explore the subject’s responses. Results Pilot feedback was positive, the statements were felt to be clear and unambiguous, allowing them sufficient scope to state their position. The pilot study informed small cosmetic changes to the GAPP questionnaire and inclusion of a ‘comments’ column for respondents to qualify their responses. The pilot results indicated that both FDs and their ESs felt that at ten months of DFT, the FDs were very well prepared for independent general dental practice. Discussion The paper describes the important considerations relating to the reliability and validity of the GAPP questionnaire. Conclusions GAPP appears to be a suitable questionnaire to measure preparedness of new graduates with a degree of reliability and validity. The instrument is designed to be simple to complete and provides a useful analytical instrument for both self-assessment of competence and for wider use within dental education

Clinimetrics in rehabilitation medicine: current issues in developing and applying measurement instruments 1

Clinimetrics in rehabilitation medicine, i.e. the field of developing, evaluating and applying measurement instruments, has undergone considerable progress. Despite this progress, however, several issues remain. These include: (i) selection of an instrument out of the wide range available; (ii) using an instrument in a variety of diagnostic groups; (iii) using an instrument in individual patients, as opposed to a group of patients; and (iv) the use of instruments in clinical practice. This paper reviews these issues, as well as current attempts at resolving them. Illustrative examples are given. It is concluded that solutions seem to be available, but considerable research effort is required to make these a reality. Clinimetrics in rehabilitation medicine remains a field with challenging opportunities for researc

Developing and testing a measure of consultation-based reassurance for people with low back pain in primary care:a cross-sectional study

BACKGROUND: Reassurance from physicians is commonly recommended in guidelines for the management of low back pain (LBP), but the process of reassurance and its impact on patients is poorly researched. We aimed to develop a valid and reliable measure of the process of reassurance during LBP consultations. METHODS: Items representing the data-gathering stage of the consultation and affective and cognitive reassurance were generated from literature on physician-patient communication and piloted with expert researchers and physicians, a Patient and Public Involvement group, and LBP patients to form a questionnaire. Patients presenting for LBP at 43 General Practice surgeries were sent the questionnaire. The questionnaire was analysed with Rasch modelling, using two samples from the same population of recent LBP consultations: the first (n = 157, follow-up n = 84) for exploratory analysis and the second (n = 162, follow-up n = 74) for confirmatory testing. Responses to the questionnaire were compared with responses to satisfaction and enablement scales to assess the external validity of the items, and participants completed the questionnaire again one-week later to assess test-retest reliability. RESULTS: The questionnaire was separated into four subscales: data-gathering, relationship-building, generic reassurance, and cognitive reassurance, each containing three items. All subscales showed good validity within the Rasch models, and good reliability based on person- and item-separations and test-retest reliability. All four subscales were significantly positively correlated with satisfaction and enablement for both samples. The final version of the questionnaire is presented here. CONCLUSIONS: Overall, the measure has demonstrated a good level of validity and generally acceptable reliability. This is the first measure to focus specifically on reassurance for LBP in primary care settings, and will enable researchers to further understanding of what is reassuring within the context of low back pain consultations, and how outcomes are affected by different types of reassurance. Additionally, the measure may provide a useful training and audit tool for physicians. The new measure requires testing in prospective cohorts, and would benefit from further validation against ethnographic observation of consultations in real time

An application of the Rasch model to reading comprehension measurement

An effective reading comprehension measurement demands robust psychometric tools that allow teachers and researchers to evaluate the educational practices and track changes in students’ performance. In this study, we illustrate how Rasch model can be used to attend such demands and improve reading comprehension measurement. We discuss the construction of two reading comprehension tests: TRC-n, with narrative texts, and TRC-e, with expository texts. Three vertically scaled forms were generated for each test (TRC-n-2, TRC-n-3, TRC-n-4; TRC-e-2, TRC-e-3 and TRC-e-4), each meant to assess Portuguese students in second, third and fourth grade of elementary school. The tests were constructed according to a nonequivalent groups with anchor test design and data were analyzed using the Rasch model. The results provided evidence for good psychometric qualities for each test form, including unidimensionality and local independence and adequate reliability. A critical view of this study and future researches are discussed.CIEC – Research Centre on Child Studies, IE, UMinho (FCT R&D unit 317), PortugalThis research was supported by Grant FCOMP-01-0124-FEDER-010733 from Fundação para a Ciência e Tecnologia (FCT) and the European Regional Development Fund (FEDER) through the European program COMPETE (Operational Program for Competitiveness Factors) under the National Strategic Reference Framework (QREN).info:eu-repo/semantics/publishedVersio

Measure of Activity Performance in the Hand (MAP-Hand) questionnaire

Background: Developed in the Norway, the Measure of Activity Performance of the Hand (MAP-Hand) assesses 18 activities performed using the hands. It was developed for people with rheumatoid arthritis (RA) using patient generated items, which are scored on a 0-3 scale and summarised into a total score range (0 to 54). This study reports the development and psychometric testing of the British English MAP-Hand in a UK population of people with RA. Methods: Recruitment took place in the National Health Service (NHS) through 17 Rheumatology outpatient clinics. Phase 1 (cross-cultural adaptation) involved: forward translation to British English; synthesis; expert panel review and cognitive debriefing interviews with people with RA. Phase 2 (psychometric testing) involved postal completion of the MAP-Hand, Health Assessment Questionnaire (HAQ), Upper Limb HAQ (ULHAQ), Short-Form 36 (SF-36v2) and Disabilities of the Arm Shoulder Hand (DASH) to measure internal consistency (Cronbach’s alpha); concurrent validity (Spearman’s correlations) and Minimal Detectable Difference (MDC95). The MAP-Hand was repeated three-weeks later to assess test-retest reliability (linear weighted kappa and Intra-Class Correlations (ICC (2,1)). Unidimensionality (internal construct validity) was assessed using (i) Confirmatory Factor Analysis (CFA) (ii) Mokken scaling and (iii) Rasch model. The RUMM2030 software was used, applying the Rasch partial credit model. Results: In Phase 1, 31 participants considered all items relevant. In Phase 2, 340 people completed Test-1 and 273 (80%) completed Test-2 questionnaires. Internal consistency was excellent (α=0.96). Test-retest reliability was good (ICC (2,1) = 0.96 (95% CI 0.94, 0.97)). The MAP-Hand correlated strongly with HAQ20 (rs=.88), ULHAQ (rs=.91), SF-36v2 Physical Functioning (PF) Score (rs=-.80) and DASH (rs=.93), indicating strong concurrent validity. CFA failed to support unidimensionality (Chi-Square 236.0 (df 120; p &lt;0.001)). However, Mokken scaling suggested a probabilistic ordering. There was differential item functioning (DIF) for gender. Four testlets were formed, resulting in much improved fit and unidimensionality. Following this, testlets were further merged in pairs where opposite bias existed. This resulted in perfect fit to the model. Conclusions: The British English version of the MAP-Hand has good validity and reliability in people with RA and can be used in both research and clinical practice. Keywords: PROMS; Patient Reported Outcome Measures; hand activity performance; hand function; hand pain; psychometric testing; Rasch analysis; validity; reliabilit

KIDMAP, a web based system for gathering patients' feedback on their doctors

<p>Abstract</p> <p>Background</p> <p>The gathering of feedback on doctors from patients after consultations is an important part of patient involvement and participation. This study first assesses the 23-item Patient Feedback Questionnaire (PFQ) designed by the Picker Institute, Europe, to determine whether these items form a single latent trait. Then, an Internet module with visual representation is developed to gather patient views about their doctors; this program then distributes the individualized results by email.</p> <p>Methods</p> <p>A total of 450 patients were randomly recruited from a 1300-bed-size medical center in Taiwan. The Rasch rating scale model was used to examine the data-fit. Differential item functioning (DIF) analysis was conducted to verify construct equivalence across the groups. An Internet module with visual representation was developed to provide doctors with the patient's online feedback.</p> <p>Results</p> <p>Twenty-one of the 23 items met the model's expectation, namely that they constitute a single construct. The test reliability was 0.94. DIF was found between ages and different kinds of disease, but not between genders and education levels. The visual approach of the KIDMAP module on the WWW seemed to be an effective approach to the assessment of patient feedback in a clinical setting.</p> <p>Conclusion</p> <p>The revised 21-item PFQ measures a single construct. Our work supports the hypothesis that the revised PFQ online version is both valid and reliable, and that the KIDMAP module is good at its designated task. Further research is needed to confirm data congruence for patients with chronic diseases.</p