Developing and Measuring IS Scales Using Item Response Theory

Information Systems (IS) research frequently uses survey data to measure the interplay between technological systems and human beings. Researchers have developed sophisticated procedures to build and validate multi-item scales that measure latent constructs. Most studies use classical test theory (CTT), which suffers from several theoretical shortcomings. We discuss these problems and present item response theory (IRT) as a viable alternative. Subsequently, we use the CTT approach as well as Rasch models (a class of restrictive IRT models) to develop a scale for measuring the hedonic aspects of websites. The results illustrate how IRT can not only be successfully applied in IS research but also provide improved results over CTT approaches

Measuring the relationship conditions in person-centred and experiential psychotherapies : past, present, and future

This chapter looks at measuring the relationship conditions in person-centred and experiential psychotherapie

Measuring measuring: Toward a theory of proficiency with the Constructing Measures framework

This paper is relevant to measurement educators who are interested in the variability of understanding and use of the four building blocks in the Constructing Measures framework (Wilson, 2005). It proposes a uni-dimensional structure for understanding Wilson’s framework, and explores the evidence for and against this conceptualization. Constructed and fixed choice response items are utilized to collect responses from 72 participants who range in experience and expertise with constructing measures. The data was scored by two raters and was analyzed with the Rasch partial credit model using ConQuest (1998). Guided by the 1999 Testing Standards, analyses of validity and reliability evidence provide support for the construct theory and limited uses of the instrument pending item design modifications

Measurement in marketing

We distinguish three senses of the concept of measurement (measurement as the selection of observable indicators of theoretical concepts, measurement as the collection of data from respondents, and measurement as the formulation of measurement models linking observable indicators to latent factors representing the theoretical concepts), and we review important issues related to measurement in each of these senses. With regard to measurement in the first sense, we distinguish the steps of construct definition and item generation, and we review scale development efforts reported in three major marketing journals since 2000 to illustrate these steps and derive practical guidelines. With regard to measurement in the second sense, we look at the survey process from the respondent's perspective and discuss the goals that may guide participants' behavior during a survey, the cognitive resources that respondents devote to answering survey questions, and the problems that may occur at the various steps of the survey process. Finally, with regard to measurement in the third sense, we cover both reflective and formative measurement models, and we explain how researchers can assess the quality of measurement in both types of measurement models and how they can ascertain the comparability of measurements across different populations of respondents or conditions of measurement. We also provide a detailed empirical example of measurement analysis for reflective measurement models

An adaptation of the experiences in close relationships scale-revised for use with children and adolescents

The investigation of attachment processes during middle childhood and early adolescence has been hampered by a relative lack of measures for this age group differentiating between two fundamental attachment dimensions, that is, anxiety and avoidance. The aim of this study is to develop and validate a child version of the Experiences in Close Relationships Scale-Revised (referred to as the ECR-RC), a self-report questionnaire measuring attachment anxiety and avoidance. Two studies were conducted to examine the internal structure (Study 1, N = 514 and Study 2, N = 296) and construct and predictive validity (Study 2) of the ECR-RC. The ECR-RC appears to be a promising instrument to measure the two attachment dimensions in middle childhood and early adolescence

Measuring meaning in life

The present studies addressed the need for a comprehensive, economical, and psychometrically adequate measure of existential meaning. In Study 1, principal-axis factor analysis of participants’ responses to popular meaning measures identified five latent constructs underlying them, labelled purposeful life, principled life, valued life, exciting life, and accomplished life. These dimensions resonate with the meaning in life concept as= understood by Frankl (1963) and the panoply of subsequent theoretical definitions (e.g. Battista and Almond 1973). Study 2 used these results as a foundation for developing a psychometrically satisfactory self-report questionnaire of each of these aspects of meaning in life. Confirmatory factor analysis (CFA) validated a five-factor structure, with each factor loading on a common second-order factor. Study 3 provided evidence for this new measure’s convergent validity and economic property. The final Meaningful Life Measure is reported and provides comprehensive but differentiated measurement of the meaning in life construct

Measuring Subjective Wellbeing in Developing Countries.

The paper explores the conceptual and methodological issues entailed in using subjective measures of well-being in developing countries. In the first part I define, situate and contrast subjective quality of life (QoL), subjective well-being (SWB), and well-being. I also look at the conceptual and methodological shortcomings of subjective measures of well-being and suggest ways of overcoming these by combining different approaches. I then explore how an expanded concept of subjective quality of life fits into the theoretical framework of the UK-based Well-being in Developing Countries study (or WeD), specifically how it plans to produce a new, “development-related” profile of quality of life, drawing on the methodology of the WHOQOL group (1995; 1998)

Reliability reconsidered: Cronbach's alpha and paediatric assessment in occupational therapy

Background / aim: Using reliable outcome measures is a necessity for the occupational therapy profession in enabling valid assessments of clients. Although Cronbach’s alpha is the most widely applied index of internal consistency reliability, there are misconceptions about its use and interpretation. This paper aims to guide assessment developers in paediatric occupational therapy, as well as practitioners who are evaluating outcome measures in using and interpreting the Cronbach’s alpha estimates appropriately. This will enable them to decide on the tools’ clinical value and incorporate them into their practice with children. Method: Previously published papers reporting on internal consistency issues of outcome measures in paediatric occupational therapy were searched through the Allied and Complementary Medicine database. These papers were used as a basis to discuss possible reasons for reporting of low internal consistency. Results: The analysis demonstrates that Cronbach’s alpha reports are not always interpreted in a sound way. The paper emphasises that one should be cautious about judging estimates of internal consistency. Low size of the coefficient alpha might not always indicate problems with the construction of the tool; whereas large sizes do not always suggest adequate reliability. Instead, these reports might be related to the data characteristics of the construct. Conclusion: In judging an outcome measure’s internal consistency , researchers and practitioners in occupational therapy should report and consider the nature of data, the scale’s length and width, the linearity and the normality of response distribution, the central response tendency, the sample response variability and the sample size