Construct validity of the Nepalese school leaving english reading test

There has been a steady interest in investigating the validity of language tests in the last decades. Despite numerous studies on construct validity in language testing, there are not many studies examining the construct validity of a reading test. This paper reports on a study that explored the construct validity of the English reading test in the Nepalese school leaving examination. Eight students were asked to take the test and think-aloud, followed by retrospective interviews. Additionally, seven experts were asked to make judgments regarding the skills tested by the test. The findings provide grounded insights into students’ response behaviors prompted by the reading tasks, and indicate some threats to the construct validity of the test. Additionally, the study reports a low level of agreement among the experts, and a big gap between the skills used by the students and the skills that the experts thought were being examined by the test

The reliability and validity of the SF-8 with a conflict-affected population in northern Uganda.

BACKGROUND: The SF-8 is a health-related quality of life instrument that could provide a useful means of assessing general physical and mental health amongst populations affected by conflict. The purpose of this study was to test the validity and reliability of the SF-8 with a conflict-affected population in northern Uganda. METHODS: A cross-sectional multi-staged, random cluster survey was conducted with 1206 adults in camps for internally displaced persons in Gulu and Amuru districts of northern Uganda. Data quality was assessed by analysing the number of incomplete responses to SF-8 items. Response distribution was analysed using aggregate endorsement frequency. Test-retest reliability was assessed in a separate smaller survey using the intraclass correlation test. Construct validity was measured using principal component analysis, and the Pearson Correlation test for item-summary score correlation and inter-instrument correlations. Known groups validity was assessed using a two sample t-test to evaluates the ability of the SF-8 to discriminate between groups known to have, and not have, physical and mental health problems. RESULTS: The SF-8 showed excellent data quality. It showed acceptable item response distribution based upon analysis of aggregate endorsement frequencies. Test-retest showed a good intraclass correlation of 0.61 for PCS and 0.68 for MCS. The principal component analysis indicated strong construct validity and concurred with the results of the validity tests by the SF-8 developers. The SF-8 also showed strong construct validity between the 8 items and PCS and MCS summary score, moderate inter-instrument validity, and strong known groups validity. CONCLUSION: This study provides evidence on the reliability and validity of the SF-8 amongst IDPs in northern Uganda

The reliability and validity of a field hockey skill test

High test retest reliability is essential in tests used for both scientific research and to monitor athletic performance. Thirty-nine (20 male and 19 female) well-trained university field hockey players volunteered to participate in the study. The reliability of the in house designed test was determined by repeating the test (3-14 days later) following full familiarisation. The validity was assessed by comparing coaches ranks of players with ranked performance on the skill test. The mean difference and confidence limits in overall skill test performance was 0.0 ± 1.0% and the standard error (confidence limits) was 2.1% (1.7 to 2.8%). The mean difference and confidence limits for the ‘decision making’ time was 0.0 ± 1.0% and the standard error (confidence limits) was 4.5% (3.6 to 6.2%). The validity correlation (Pearson) was r = 0.83 and r= 0.73 for female players and r = 0.61 and r = 0.70 for male players for overall time and ‘decision making’ time respectively. We conclude that the field hockey skill test is a reliable measure of skill performance and that it is valid as a predictor of coach assessed hockey performance, but the validity is greater for female players

An alternative test to check the validity of convergence results

This paper presents a simple method for identifying distributional dynamic properties of economies using the ideas of concordance and discordance. It can be employed to examine the strength and validity of the results of other methods. The method has the advantage of comparing distributions at two points without relying on intermediary data between the two time points. We present results that suggest there is more ‘strong-divergence’ than ‘strong-convergence’ in GDP between countries over the time period 1960-2000 although the distribution exhibits both convergent and divergent characteristics

The impact of job complexity and study design on situational and behavior description interview validity

The primary purpose of this investigation was to test two key characteristics hypothesized to influence the validity of situational (SI) and behavior description (BDI) structured interviews. A meta-analysis of 54 studies with a total sample size of 5536 suggested that job complexity influences the validity of SIs, with decreased validity for high-complexity jobs, but does not influence the validity of BDIs. And, results indicated a main effect for study design across both SIs and BDIs, with predictive studies having 0.10 lower validity on average than concurrent studies. Directions for future research are discussed

Standards of Validity and the Validity of Standards in Behavioral Software Engineering Research: The Perspective of Psychological Test Theory

Background. There are some publications in software engineering research that aim at guiding researchers in assessing validity threats to their studies. Still, many researchers fail to address many aspects of validity that are essential to quantitative research on human factors. Goal. This paper has the goal of triggering a change of mindset in what types of studies are the most valuable to the behavioral software engineering field, and also provide more details of what construct validity is. Method. The approach is based on psychological test theory and draws upon methods used in psychology in relation to construct validity. Results. In this paper, I suggest a different approach to validity threats than what is commonplace in behavioral software engineering research. Conclusions. While this paper focuses on behavioral software engineering, I believe other types of software engineering research might also benefit from an increased focus on construct validity.Comment: ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM), Oulu, Finland, October 11-12, 2018. 4 page

Pengaruh Kualitas Produk, Store Atmosphere, Dan Lokasi Terhadap Keputusan Pembelian Untuk Produk Fashion Pada Distro Di Kota Palembang

This study was conducted to determine the effect of product quality, store atmosphere, and the location of the purchasing decision for fashion products in the city of Palembang. This type of research is done by using a field study / survey. The population in this study are all consumers who never make purchases in the distribution of fashion products. Used as a sample of 100 respondents and using purposive sampling technique. Hypothesis testing using multiple regression method with SPSS ver. 17.0. Data analysis techniques used are validity, reliability test, classic assumption test, multiple regression analysis, t test and F test validity test results showed all the data is valid, reliability testing showed all the data is reliable. The results of multiple regression test showed the quality products, store atmosphere and the location has a positive and significant impact on purchasing decisions

Assessment of physical activity in older Belgian adults : validity and reliability of an adapted interview version of the long International Physical Activity Questionnaire (IPAQ-L)

Background: Adequate monitoring of older adults’ physical activity (PA) is essential to develop effective health promotion programs. The present study examined criterion validity and test-retest reliability of the long International Physical Activity Questionnaire (IPAQ-L), adapted for Belgian, community-dwelling older adults (65y and older). Methods: Participants (n = 434) completed the last seven days version of IPAQ-L, modified for the Belgian population of community-dwelling older adults. This elderly-adapted version of IPAQ-L combined vigorous and moderate activities, and questions on gait speed and recreational cycling were added. Furthermore, participants wore an ActiGraph GT3X(+) accelerometer for at least five days. Criterion validity was determined by comparing self-reported weekly minutes of moderate-to-vigorous physical activity (MVPA) and weekly minutes of total PA with accelerometer data, defined by two different cut points (Freedson vs. Copeland). To examine test-retest reliability, a subsample of 29 participants completed IPAQ-L for a second time within a ten day interval. Results: IPAQ-L showed moderate criterion validity for measuring weekly minutes of MVPA and total PA (Spearman’s ρ range 0.33–0.40). However, plots on agreement between self-reported and accelerometer PA showed a systematic over-reporting of IPAQ-L for MVPA. In contrast, plots indicated that IPAQ-L under-estimated levels of total PA, however, this under-estimation of total PA was substantially lower than the observed over-reporting of MVPA. Test-retest reliability was moderate-to-good for work-related PA, domestic PA, MVPA and total PA (ICC range 0.52–0.81), but poorer for transportation and recreational PA (ICC 0.44 and 0.43, respectively). Conclusions: Criterion validity results suggest that IPAQ-L is more valid to measure older adults’ weeklyminutes of total PA than weekly MVPA minutes. Moreover, results might imply that content validity of IPAQ-L can be improved if specific light-intensity PA items are incorporated into IPAQ-L. Test-retest reliability of IPAQ-L was moderate to good, except for weekly minutes of transportation and recreational PA, probably due to week-to-week variability of these behaviors

The Validity Evidence of Toefl Test as Placement Test

This study is aimed at evaluating the validity of TOEFL test as instrument for placement test. The three sections of the test including listening, structure, reading, and vocabulary were used to measure 96 freshmen basic competences in English, before attending courses. Based on the result of TOEFL test, students were classified into four classes from the highest to the lowest competency levels, namely A, B, C, and D. To measure the correlation level, the two sets of score were compared by using Pearson product moment correlation, the TOEFL score and students' achievement score. The score of students' achievement was derived from the final test of Integrated Course. There were 2 language skills and 2 language components that were tested: listening, reading, grammar and vocabulary. The medium positive and significant correlation level (0.41) indicated that TOEFL test was quiet valid to be used as instrument for placement test. However, students' characteristics and background should be considered to achieve the high and significant correlation level