Internal construct validity of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS): a Rasch analysis using data from the Scottish Health Education Population Survey

Background: The Warwick-Edinburgh Mental Well-Being Scale (WEMWBS) was developed to meet demand for instruments to measure mental well-being. It comprises 14 positively phrased Likert-style items and fulfils classic criteria for scale development. We report here the internal construct validity of WEMWBS from the perspective of the Rasch measurement model. Methods: The model was applied to data collected from 779 respondents in Wave 12 (Autumn 2006) of the Scottish Health Education Population Survey. Respondents were aged 16–74 (average 41.9) yrs. Results: Initial fit to model expectations was poor. The items 'I've been feeling good about myself', 'I've been interested in new things' and 'I've been feeling cheerful' all showed significant misfit to model expectations, and were deleted. This led to a marginal improvement in fit to the model. After further analysis, more items were deleted and a strict unidimensional seven item scale (the Short Warwick Edinburgh Mental Well-Being Scale (SWEMWBS)) was resolved. Many items deleted because of misfit with model expectations showed considerable bias for gender. Two retained items also demonstrated bias for gender but, at the scale level, cancelled out. One further retained item 'I've been feeling optimistic about the future' showed bias for age. The correlation between the 14 item and 7 item versions was 0.954. Given fit to the Rasch model, and strict unidimensionality, SWEMWBS provides an interval scale estimate of mental well-being. Conclusion: A short 7 item version of WEMWBS was found to satisfy the strict unidimensionality expectations of the Rasch model, and be largely free of bias. This scale, SWEMWBS, provides a raw score-interval scale transformation for use in parametric procedures. In terms of face validity, SWEMWBS presents a more restricted view of mental well-being than the 14 item WEMWBS, with most items representing aspects of psychological and eudemonic well-being, and few covering hedonic well-being or affect. However, robust measurement properties combined with brevity make SWEMWBS preferable to WEMWBS at present for monitoring mental well-being in populations. Where face validity is an issue there remain arguments for continuing to collect data on the full 14 item WEMWBS

Reliability, construct validity and measurement potential of the ICF comprehensive core set for osteoarthritis

<p>Abstract</p> <p>Background</p> <p>This study aimed to investigate the reliability and construct validity of the International Classification of Functioning, Disability and Health (ICF) Comprehensive Core Set for osteoarthritis (OA) in order to test its possible use as a measuring tool for functioning.</p> <p>Methods</p> <p>100 patients with OA (84 F, 16 M; mean age 63 yr) completed forms including demographic and clinical information besides the Short Form (36) Health Survey (SF-36^®) and the Western Ontario and McMaster Universities Index of Osteoarthritis (WOMAC). The ICF Comprehensive Core Set for OA was filled by health professionals. The internal construct validities of "Body Functions-Body structures" (BF-BS), "Activity" (A), "Participation" (P) and "Environmental Factors" (EF) domains were tested by Rasch analysis and reliability by internal consistency and person separation index (PSI). External construct validity was evaluated by correlating the Rasch transformed scores with SF-36 and WOMAC.</p> <p>Results</p> <p>In each scale, some items showing disordered thresholds were rescored, testlets were created to overcome the problem of local dependency and items that did not fit to the Rasch model were deleted. The internal construct validity of the four scales (BF-BS 16 items, A 8 items, P 7 items, EF 13 items) were good [mean item fit (SD) 0.138 (0.921), 0.216 (1.237), 0.759 (0.986) and -0.079 (2.200); person item fit (SD) -0.147 (0.652), -0.241 (0.894), -0.310 (1.187) and -0.491 (1.173) respectively], indicating a single underlying construct for each scale. The scales were free of differential item functioning (DIF) for age, gender, years of education and duration of disease. Reliabilities of the BF-BS, A, P, and EF scales were good with Cronbach's alphas of 0.79, 0.86, 0.88, and 0.83 and PSI's of 0.76, 0.86, 0.87, and 0.71, respectively. Rasch scores of BF-BS, A, and P showed moderate correlations with SF-36 and WOMAC scores where the EF had significant but weak correlations only with SF36-Social Functioning and SF36-Mental Health.</p> <p>Conclusion</p> <p>Since the four different scales derived from BF-BS, A, P, and EF components of the ICF core set for OA were shown to be valid and reliable through a combination of Rasch analysis and classical psychometric methods, these might be used as clinical assessment tools.</p

Factors influencing success in quality-improvement collaboratives: development and psychometric testing of an instrument

Contains fulltext : 88630.pdf (publisher's version ) (Open Access)ABSTRACT: BACKGROUND: To increase the effectiveness of quality-improvement collaboratives (QICs), it is important to explore factors that potentially influence their outcomes. For this purpose, we have developed and tested the psychometric properties of an instrument that aims to identify the features that may enhance the quality and impact of collaborative quality-improvement approaches. The instrument can be used as a measurement instrument to retrospectively collect information about perceived determinants of success. In addition, it can be prospectively applied as a checklist to guide initiators, facilitators, and participants of QICs, with information about how to perform or participate in a collaborative with theoretically optimal chances of success. Such information can be used to improve collaboratives. METHODS: We developed an instrument with content validity based on literature and the opinions of QIC experts. We collected data from 144 healthcare professionals in 44 multidisciplinary improvement teams participating in two QICs and used exploratory factor analysis to assess the construct validity. We used Cronbach's alpha to ascertain the internal consistency. RESULTS: The 50-item instrument we developed reflected expert-opinion-based determinants of success in a QIC. We deleted nine items after item reduction. On the basis of the factor analysis results, one item was dropped, which resulted in a 40-item questionnaire. Exploratory factor analysis showed that a three-factor model provided the best fit. The components were labeled 'sufficient expert team support', 'effective multidisciplinary teamwork', and 'helpful collaborative processes'. Internal consistency reliability was excellent (alphas between .85 and .89). CONCLUSIONS: This newly developed instrument seems a promising tool for providing healthcare workers and policy makers with useful information about determinants of success in QICs. The psychometric properties of the instrument are satisfactory and warrant application either as an objective measure or as a checklist

Testing and comparing two self-care-related instruments among older Chinese adults

Objectives The study aimed to test and compare the reliability and validity, including sensitivity and specificity of the two self-care-related instruments, the Self-care Ability Scale for the Elderly (SASE), and the Appraisal of Self-care Agency Scale-Revised (ASAS-R), among older adults in the Chinese context. Methods A cross-sectional design was used to conduct this study. The sample consisted of 1152 older adults. Data were collected by a questionnaire including the Chinese version of SASE (SASE-CHI), the Chinese version of ASAS-R (ASAS-R-CHI) and the Exercise of Self-Care Agency scale (ESCA). Homogeneity and stability, content, construct and concurrent validity, and sensitivity and specificity were assessed. Results The Cronbach's alpha (α) of SASE-CHI was 0.89, the item-to-total correlations ranged from r = 0.15 to r = 0.81, and the test-retest correlation coefficient (intra-class correlation coefficient, ICC) was 0.99 (95% CI, 0.99±1.00; P<0.001). The Cronbach's α of ASAS-R-CHI was 0.78, the item-to-total correlations ranged from r = 0.20 to r = 0.65, and the test-retest ICC was 0.95 (95% CI, 0.92±0.96; P<0.001). The content validity index (CVI) of SASE-CHI and ASAS-R-CHI was 0.96 and 0.97, respectively. The findings of exploratory and confirmatory factor analyses (EFA and CFA) confirmed a good construct validity of SASE-CHI and ASAS-R-CHI. The Pearson's rank correlation coefficients, as a measure of concurrent validity, between total score of SASE-CHI and ESCA and ASAS-R-CHI and ESCA were assessed to 0.65 (P<0.001) and 0.62 (P<0.001), respectively. Regarding ESCA as the criterion, the area under the receiver operator characteristic (ROC) curve for the cut-point of SASE-CHI and ASAS-R-CHI were 0.93 (95% CI, 0.91±0.94) and 0.83 (95% CI, 0.80±0.86), respectively. Conclusion There is no significant difference between the two instruments. Each has its own characteristics, but SASE-CHI is more suitable for older adults. The key point is that the users can choose the most appropriate scale according to the specific situation.publishedVersionNivå

Associations of Patient Health-Related Problem Solving with Disease Control, Emergency Department Visits, and Hospitalizations in HIV and Diabetes Clinic Samples

BACKGROUND: Patient problem solving and decision making are recognized as essential to effective self-management across multiple chronic diseases. However, a health-related problem-solving instrument that demonstrates sensitivity to disease control parameters in multiple diseases has not been established. OBJECTIVES: To determine, in two disease samples, internal consistency and associations with disease control of the Health Problem-Solving Scale (HPSS), a 50-item measure with 7 subscales assessing effective and ineffective problem-solving approaches, learning from past experiences, and motivation/orientation. DESIGN: Cross-sectional study. PARTICIPANTS: Outpatients from university-affiliated medical center HIV (N = 111) and diabetes mellitus (DM, N = 78) clinics. MEASUREMENTS: HPSS, CD4, hemoglobin A1c (HbA1c), and number of hospitalizations in the previous year and Emergency Department (ED) visits in the previous 6 months. RESULTS: Administration time for the HPSS ranged from 5 to 10 minutes. Cronbach’s alpha for the total HPSS was 0.86 and 0.89 for HIV and DM, respectively. Higher total scores (better problem solving) were associated with higher CD4 and fewer hospitalizations in HIV and lower HbA1c and fewer ED visits in DM. Health Problem-Solving Scale subscales representing negative problem-solving approaches were consistently associated with more hospitalizations (HIV, DM) and ED visits (DM). CONCLUSIONS: The HPSS may identify problem-solving difficulties with disease self-management and assess effectiveness of interventions targeting patient decision making in self-care

Development of a questionnaire to measure health-related quality of life (HRQoL) in patients with atrial fibrillation (AF-QoL)

<p>Abstract</p> <p>Background</p> <p>The Health-Related Quality of Life (HRQoL) assessment in atrial fibrillation (AF) patients has traditionally been carried out in a poorly standardised fashion, or via the use of non disease-specific HRQoL questionnaires. The development of a HRQoL questionnaire with a good measuring performance will allow for a standardised assessment of the impact of this disease on the patient's daily living.</p> <p>Methods</p> <p>A bibliography review was conducted to identify the most relevant domains of daily living in AF patients. Subsequently, a focus group was created with the aid of cardiologists, and 17 patients were interviewed to identify the most-affected HRQoL domains. A qualitative analysis of the interview answers was performed, which was used to develop a pilot questionnaire administered to a 112-patient sample. Based on patient responses, an analysis was carried out following the statistical procedures defined by the Classical Test Theory (CTT) and the Item Response Theory (IRT). Reliablility was assessed via Cronbach's coefficient alpha and item-total score correlations. A factorial analysis was performed to determine the number of domains. For each domain, a Rasch analysis was carried out, in order to reduce and stand hierarchically the questionnaire items.</p> <p>Results</p> <p>By way of the bibliography review and the expert focus group, 10 domains were identified. The patient interviews allowed for the identification of 286 items that later were downsized to 40 items. The resultant preliminary questionnaire was administered to a 112-patient sample (pilot study). The Rasch analysis led to the definition of two domains, comprising 7 and 11 items respectively, which corresponded to the psychological and physical domains (18 items total), thereby giving rise to the initial AF-QoL-18 questionnaire. Cronbach's coefficient alpha was acceptable (0.91).</p> <p>Conclusion</p> <p>An initial HRQoL questionnaire, AFQoL-18, has been developed to assess HRQoL in AF patients.</p

Reproducibility and responsiveness of the Symptom Severity Scale and the hand and finger function subscale of the Dutch arthritis impact measurement scales (Dutch-AIMS2-HFF) in primary care patients with wrist or hand problems

BACKGROUND: To determine the clinimetric properties of two questionnaires assessing symptoms (Symptom Severity Scale) and physical functioning (hand and finger function subscale of the AIMS2) in a Dutch primary care population. METHODS: The first 84 participants in a 1-year follow-up study on the diagnosis and prognosis of hand and wrist problems completed the Symptom Severity Scale and the hand and finger function subscale of the Dutch-AIMS2 twice within 1 to 2 weeks. The data were used to assess test-retest reliability (ICC) and smallest detectable change (SDC, based on the standard error of measurement (SEM)). To assess responsiveness, changes in scores between baseline and the 3 month follow-up were related to an external criterion to estimate the minimal important change (MIC). We calculated the group size needed to detect the MIC beyond measurement error. RESULTS: The ICC for the Symptom Severity Scale was 0.68 (95% CI: 0.54–0.78). The SDC was 1.00 at individual level and 0.11 at group level, both on a 5-point scale. The MIC was 0.23, exceeding the SDC at group level. The group size required to detect a MIC beyond measurement error was 19 for the Symptom Severity Scale. The ICC for the hand and finger function subscale of the Dutch-AIMS2 was 0.62 (95% CI: 0.47–0.74). The SDC was 3.80 at individual level and 0.42 at group level, both on an 11-point scale. The MIC was 0.31, which was less than the SDC at group level. The group size required to detect a MIC beyond measurement error was 150. CONCLUSION: In our heterogeneous primary care population the Symptom Severity Scale was found to be a suitable instrument to assess the severity of symptoms, whereas the hand and finger function subscale of the Dutch-AIMS2 was less suitable for the measurement of physical functioning in patients with hand and wrist problems

Factors influencing identification of and response to intimate partner violence: a survey of physicians and nurses

BACKGROUND: Intimate partner violence against women (IPV) has been identified as a serious public health problem. Although the health care system is an important site for identification and intervention, there have been challenges in determining how health care professionals can best address this issue in practice. We surveyed nurses and physicians in 2004 regarding their attitudes and behaviours with respect to IPV, including whether they routinely inquire about IPV, as well as potentially relevant barriers, facilitators, experiential, and practice-related factors. METHODS: A modified Dillman Tailored Design approach was used to survey 1000 nurses and 1000 physicians by mail in Ontario, Canada. Respondents were randomly selected from professional directories and represented practice areas pre-identified from the literature as those most likely to care for women at the point of initial IPV disclosure: family practice, obstetrics and gynecology, emergency care, maternal/newborn care, and public health. The survey instrument had a case-based scenario followed by 43 questions asking about behaviours and resources specific to woman abuse. RESULTS: In total, 931 questionnaires were returned; 597 by nurses (59.7% response rate) and 328 by physicians (32.8% response rate). Overall, 32% of nurses and 42% of physicians reported routinely initiating the topic of IPV in practice. Principal components analysis identified eight constructs related to whether routine inquiry was conducted: preparedness, self-confidence, professional supports, abuse inquiry, practitioner consequences of asking, comfort following disclosure, practitioner lack of control, and practice pressures. Each construct was analyzed according to a number of related issues, including clinician training and experience with woman abuse, area of practice, and type of health care provider. Preparedness emerged as a key construct related to whether respondents routinely initiated the topic of IPV. CONCLUSION: The present study provides new insight into the factors that facilitate and impede clinicians' decisions to address the issue of IPV with their female patients. Inadequate preparation, both educational and experiential, emerged as a key barrier to routine inquiry, as did the importance of the "real world" pressures associated with the daily context of primary care practice

An instrument to determine the technological literacy levels of upper secondary school students

In this article, an instrument for assessing upper secondary school students’ levels of technological literacy is presented. The items making up the instrument emerged from a previous study that employed a phenomenographic research approach to explore students’ conceptions of technology in terms of their understanding of the nature of technology and their interaction with technological artefacts. The instrument was validated through administration to 1,245 students on completion of their 12 years of formal schooling. A factor analysis was conducted on the data and Cronbach alpha reliability coefficients determined. The results show that a five-dimension factor structure (namely, artefact, process, direction/instruction, tinkering, and engagement) strongly supported the dimensions as developed during the original phenomenographic study. The Cronbach alpha reliability co-efficient of each dimension was satisfactory. Based on these findings, the instrument has been shown to be valid and reliable and can be used with confidence

High School Students' Proficiency and Confidence Levels in Displaying Their Understanding of Basic Electrolysis Concepts

This study was conducted with 330 Form 4 (grade 10) students (aged 15 – 16 years) who were involved in a course of instruction on electrolysis concepts. The main purposes of this study were (1) to assess high school chemistry students’ understanding of 19 major principles of electrolysis using a recently developed 2-tier multiple-choice diagnostic instrument, the Electrolysis Diagnostic Instrument (EDI), and (2) to assess students’ confidence levels in displaying their knowledge and understanding of these electrolysis concepts. Analysis of students’ responses to the EDI showed that they displayed very limited understanding of the electrolytic processes involving molten compounds and aqueous solutions of compounds, with a mean score of 6.82 (out of a possible maximum of 17). Students were found to possess content knowledge about several electrolysis processes but did not provide suitable explanations for the changes that had occurred, with less than 45 % of students displaying scientifically acceptable understandings about electrolysis. In addition, students displayed limited confidence about making the correct selections for the items; yet, in 16 of the 17 items, the percentage of students who were confident that they had selected the correct answer to an item was higher than the actual percentage of students who correctly answered the corresponding item. The findings suggest several implications for classroom instruction on the electrolysis topic that need to be addressed in order to facilitate better understanding by students of electrolysis concepts