A longitudinal approach to understanding course evaluations

Accessed 16,892 times on https://pareonline.net from April 13, 2005 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right

Assessing Content Knowledge and Changes in Confidence and Anxiety Related to Economic Literacy in a Professional Development Program for History Teachers

The purpose of this study was to determine the impact of a Teaching American History professional development program on content knowledge, and confidence and anxiety associated with teaching economic literacy. Two content assessments and a confidence and anxiety instrument were administered to teachers prior to and immediately following a two-week Summer Institute. Statistically significant findings included an increase in economics content knowledge and an increase in confidence combined with a decrease in anxiety. The scale and measurement model employed to examine status and subsequent change should be useful for similar professional development initiatives and evaluations

An Enhancement to the Theory and Measurement of Purpose

Development of purpose is an important goal of post-secondary education. This study advances the measurement of purpose by (a) enriching the construct through incorporating the facet of horizon; (b) providing a framework for Rasch/Guttman Scenario score interpretation; and (c) providing evidence of convergent, divergent, and known groups validity

Teacher Test Accountability.

Given the high stakes of teacher testing, there is no doubt that every teacher test should meet the industry guidelines set forth in the Standards for Educational and Psychological Testing. Unfortunately, however, there is no public or private business or governmental agency that serves to certify or in any other formal way declare that any teacher test does, in fact, meet the psychometric recommendations stipulated in the Standards. Consequently, there are no legislated penalties for faulty products (tests) nor are there opportunities for test takers simply to raise questions about a test and to have their questions taken seriously by an impartial panel. The purpose of this article is to highlight some of the psychometric results reported by National Evaluation Systems (NES) in their 1999 Massachusetts Educator Certification Test (MECT) Technical Report, and more specifically, to identify those technical characteristics of the MECT that are inconsistent with the Standards. A second purpose of this article is to call for the establishment of a standing test auditing organization with investigation and sanctioning power. The significance of the present analysis is twofold: a) psychometric results for the MECT are similar in nature to psychometric results presented as evidence of test development flaws in an Alabama class-action lawsuit dealing with teacher certification (an NES-designed testing system); and b) there was no impartial enforcement agency to whom complaints about the Alabama tests could be brought, other than the court, nor is there any such agency to whom complaints about the Massachusetts tests can be brought. I begin by reviewing NES's role in Allen v. Alabama State Board of Education, 81-697-N. Next I explain the purpose and interpretation of standard item analysis procedures and statistics. Finally, I present results taken directly from the 1999 MECT Technical Report and compare them to procedures, results, and consequences of procedures followed by NES in Alabama

Construct Invariance of the Survey of Knowledge of Internet Risk and Internet Behavior Knowledge Scale

The wide use of the Internet has potential for students to become victims of Internet predators or other students who engage in inappropriate cyberbullying. Educational programming efforts targeted for students, teachers and parents need instrumentation that provides meaningful and reliable data assessing students\u27 knowledge of Internet risk and their actual Internet behaviors. Construct invariance of the Survey of Knowledge of Internet Risk and Internet Behavior Knowledge scale regarding gender and grade level is examined for N=2621 middle school and N=1594 high school students using multi-group confirmatory factor analysis and Rasch rating scale modeling. Implications for score interpretations are discussed

Besieged Institutions and the Massachusetts Teacher Tests

Teacher testing was inaugurated in Massachusetts in 1998 and a 59% failure rate among test-takers led to public shaming of the teacher candidates and their colleges and universities in the media. Within a two-year time period, low-performing teacher education programs in Massachusetts initiated a wide range of test preparatory activities which led to a dramatic increase in their students' pass rates. The authors separate colleges and universities into three categories and examine their differentiated responses to teacher testing. Their finding that institutions of higher education have responded effectively to teacher testing does not preclude critique of teacher testing as currently practiced in Massachusetts