Measures of New Constructs or Old Ones? The Case of Organizational Commitment and Job Satisfaction

The construct validity of organizational commitment has recently been investigated in several studies. The authors of these studies have concluded that organizational commitment is a valid construct, sufficiently distinct from job satisfaction. Our re-analysis of data reported in these studies, however, suggests that the construct validity evidence is unconvincing. Analysis of meta-analytic results cast further doubt on the discriminant validity of organizational commitment as typically measured. Based on these findings, suggestions for future research are offered

Anchoring vignettes can they make adolescent self-reports of social-emotional skills more reliable, discriminant, and criterion-valid?

Individuals differ in the way they use rating scales to describe themselves, and these differences are particularly pronounced in children and early adolescents. One promising remedy is to correct (or "anchor'') an individual's responses according to the way they use the scale when they rate an anchoring vignette (a set of hypothetical targets differing on the attribute of interest). Studying adolescents' self-reports of their socio-emotional attributes, we compared traditional self-report scores with vignette-corrected scores in terms of reliability (internal consistency), discriminant validity (scale intercorrelations), and criterion validity (predicting achievement test scores in language and math). A large and representative sample of 12th grade Brazilian students (N = 8,582, 62% female, mean age 18.2) were administered a Portuguese-language self-report inventory assessing social-emotional skills related to the Big Five personality dimensions. Correcting scores according to vignette ratings led to increases in the reliability of scales measuring Conscientiousness and Openness, but discriminant validity and criterion validity increased only when each scale was corrected using its own corresponding vignette set. Moreover, accuracy in rating the vignettes was correlated with language achievement test scores, suggesting that verbal factors play a role in providing both normative vignette ratings of others and self-reports that are reliable and valid

Life satisfaction questionnaire (Lisat-9): reliability and validity for patients with acquired brain injury

The aim of this study was to determine the reliability and discriminant validity of the Dutch version of the life satisfaction questionnaire (Lisat-9 DV) to assess patients with an acquired brain injury. The reliability study used a test-retest design, and the validity study used a cross-sectional design. The setting was the general rehabilitation centre. There were 159 patients over 18 years of age, with an acquired brain injury, in the chronic phase. The main outcome measures were weighted kappa of test and retest data on the nine questions of the Lisat-9 DV and significance levels of differences between subgroups of patients who are expected to differ in terms of Lisat-9 scores, on the basis of other instruments. The results were as follows: the reliability was moderate, with the weighted kappa ranging from 0.41 to 0.64. In terms of validity, subgroups of patients who were expected to differ in terms of the Lisat-9 domains did indeed differ significantly, except for the difference in the Lisat score for 'contact with friends and acquaintances' between subgroups defined by higher or lower scores on the corresponding domain of the Frenchay Activities Index. As there was a plausible explanation for not finding a significant difference between subgroups defined by one of the Frenchay Activities Index domains and significant differences were found between the subgroups defined by other instruments corresponding to the same domain, we conclude that the discriminant validity is good. The reliability was not clearly affected by cognitive disorder or aphasia. The conclusions were that the reliability of the Lisat-9 DV for patients with an acquired brain injury was moderate; the discriminant validity was good

The Basic Psychological Needs in Exercise Scale: Translation and Evidence for Cross-Cultural Validity

The present study reports on the psychometric evaluation and cross-cultural validity of the Basic Psychological Needs in Exercise Scale (BPNES; Vlachopoulos & Michailidou, 2006) translated from Greek into English. The data obtained from 346 British exercise participants supported the hypothesized 3-factor structure,showed satisfactory internal reliability coefficients, and offered evidence for the factor concurrent, discriminant, and nomological validity of the translated scale.Cross-cultural validity analyses across British and Greek participants supported configural invariance and partial metric, partial strong, and partial strict factorial invariance of the BPNES responses. The findings provide promising evidence for the validity and reliability of the translated BPNES and support the use of the scale in single-culture and cross-culture exercise-related motivational research within the self-determination theory framework

Innovative Work Behaviour: Measurement and Validation

Although both scientists and practitioners emphasize the importance of innovative work behavior (IWB) of individual employees for organizational success, the measurement of employees' IWB is still in evolution. Here, we present two multi-source studies that aimed to develop and validate a measure of IWB. Four related dimensions of IWB are distinguished: opportunity exploration, idea generation, championing and application. We derived a tenitem measure of these IWB dimensions from a pilot survey among matched dyads of 81 professionals in a research institute and their supervisors. Next, a survey among a matching sample of 703 knowledge workers and their supervisors from 94 different firms was done. We used confirmatory factor analyses to examine convergent and discriminant validity, and hierarchical multilevel regression to test hypothesized relationships of IWB with participative leadership, external work contacts and innovative output (proposed as an initial nomological network). Results demonstrate strong convergent validity of the IWB measure as all four dimensions contribute to an overall measure of IWB. Support for discriminant validity is weaker as correlations between some dimensions are relatively high. Finally, IWB is positively related with participative leadership, external work contacts and innovative output, providing first evidence for nomological validity.

Construct validity of multiple achievement goals: A multitrait-multimethod approach

The aim of this study was to examine three different instruments which have been used in research conducted in the physical domain to measure mastery, performance-approach, and performance-avoidance goals. The construct validity of the assessment tools, including a determination of their convergent and discriminant validity as well as a method effect, was tested via several confirmatory factor analyses. Four hundred and fifty athletes from different sport clubs were involved in the present study. Participants were asked to fill out three different multiple achievement goal instruments as well as two external criteria scales. The results based on CFA showed that all of the three instruments measured the same latent construct of multiple achievement goals. The convergent validity as well as the discriminant validity was supported. Evidence for a limited method effect in terms of the different measures was also provided

Measuring time perspective in adolescents : can you get the right answer by asking the wrong questions?

Time perspective continues to evolve as a psychological construct. The extant literature suggests that higher future orientation and lower present orientation are associated with better developmental outcomes. However, the extant literature also suggests that issues remain with the measurement of the construct. Recently, a 25-item version of the Zimbardo Time Perspective Inventory (ZTPI-25) was suggested for use based on high internal consistency estimates and good discriminant validity of scores in a sample of Italian adolescents. However, the genesis of this scale is uncertain. The present study examined the factorial validity, reliability, and concurrent validity of ZTPI-25 scores in Slovenian, American, and British adolescents. Results revealed satisfactory concurrent validity based on correlations with measures used in the development of the full ZTPI. However, internal consistency and factorial validity of scores were unsatisfactory. The present study questions the use of the ZTPI-25 with adolescents in the context of conceptual and measurement issues more broadly

Multi-scale Discriminant Saliency with Wavelet-based Hidden Markov Tree Modelling

The bottom-up saliency, an early stage of humans' visual attention, can be considered as a binary classification problem between centre and surround classes. Discriminant power of features for the classification is measured as mutual information between distributions of image features and corresponding classes . As the estimated discrepancy very much depends on considered scale level, multi-scale structure and discriminant power are integrated by employing discrete wavelet features and Hidden Markov Tree (HMT). With wavelet coefficients and Hidden Markov Tree parameters, quad-tree like label structures are constructed and utilized in maximum a posterior probability (MAP) of hidden class variables at corresponding dyadic sub-squares. Then, a saliency value for each square block at each scale level is computed with discriminant power principle. Finally, across multiple scales is integrated the final saliency map by an information maximization rule. Both standard quantitative tools such as NSS, LCC, AUC and qualitative assessments are used for evaluating the proposed multi-scale discriminant saliency (MDIS) method against the well-know information based approach AIM on its released image collection with eye-tracking data. Simulation results are presented and analysed to verify the validity of MDIS as well as point out its limitation for further research direction.Comment: arXiv admin note: substantial text overlap with arXiv:1301.396

Community Policing and Intelligence-Led Policing: An Examination of Convergent or Discriminant Validity

Purpose Despite increased scholarly inquiry regarding intelligence-led policing (ILP) and popularity among law enforcement agencies around the globe, ambiguity remains regarding the conceptual foundation and appropriate measurement of ILP. Although most scholars agree that ILP is indeed a unique policing philosophy, there is less consensus regarding the relationship between ILP and the ever-present model of community-oriented policing (COP). Consequently, there is a clear need to study the empirical distinctions and overlaps in these policing philosophies as implemented by US law enforcement agencies. The paper aims to discuss these issues. Design/methodology/approach Data were gleaned from the 2007 LEMAS and 2009 NIJ Intelligence surveys. A total of 227 unique police agencies in the USA are included. A series of bivariate, exploratory factor analyses and structural models are used to determine discriminatory or convergent validity across COP and ILP constructs. Findings The goal was to answer the question: are these two policing philosophies are being implemented as separate and distinct strategies? Results of our exploratory and structural models indicate that COP and ILP loaded on unique latent constructs. This affirms the results of the bivariate correlations, and indicates that COP and ILP have discriminant measurement validity. In other words, COP and ILP are conceptually distinct, even when implemented in police departments across the USA. Implications of these findings and suggestions for future research are discussed. Originality/value This is the first study to empirically test the discriminant or convergent validity of COP and ILP

Properties of patient-reported outcome measures in individuals following acute whiplash injury

Background: The aim of this study was to assess the acceptability, reliability, validity and responsiveness of the Short-Form Health Survey (SF-12) and its preference-based derivative (SF-6D), the EQ-5D and the Neck Disability Index (NDI) in patients recovering from acute whiplash injury. Methods: Data from the Managing Injuries of the Neck Trial of 3,851 patients with acute whiplash injury formed the basis of this empirical investigation. The EQ-5D and SF-12 were collected at baseline, and all three outcome measures were then collected at 4 months, 8 months and 12 months post-randomisation. The measures were assessed for their acceptability (response rates), internal consistency, validity (known groups validity and discriminant validity) and their internal and external responsiveness. Results: Response rates were broadly similar across the measures, with evidence of a floor effect for the NDI and a ceiling effect for the EQ-5D utility measure. All measures had Cronbach’s α statistics of greater than 0.7, indicating acceptable internal consistency. The NDI and EQ-5D utility score correlated more strongly with the physical component scale of the SF-12 than the mental component scale, whilst this was reversed for the SF-6D utility score. The smaller standard deviations in SF-6D utility scores meant there were larger effect sizes for differences in utility score between patients with different injury severity at baseline than for the EQ-5D utility measure. However, the EQ-5D utility measure and NDI were both more responsive to longitudinal changes in health status than the SF-6D. Conclusions: There was no evidence of differences between the EQ-5D utility measure and NDI in terms of their construct validity, discriminant validity or responsiveness in patients with acute whiplash injury. However, both demonstrated superior responsiveness to longitudinal health changes than the SF-6D