Demands on Users for Interpretation of Achievement Test Scores: Implications for the Evaluation Profession

Background:  Professional standards for validity of achievement tests have long reflected a consensus that validity is the degree to which evidence and theory support interpretations of test scores entailed by the intended uses of tests.  Yet there are convincing lines of evidence that the standards are not adequately followed in practice, that standards alone are not sufficient guides to action, and that reviewers of tests do not call attention to important kinds of validity evidence that might support the demanding process of making sense of test scores or reasoning from test scores. Purpose: The intent of this article is to make more transparent the demands of achievement test interpretation on users in instructional contexts and to open up a dialogue on implications for the evaluation profession for improvement of practice along lines already set out by evaluation theorists. Setting:  Not applicable. Intervention: Not applicable. Research Design: Not applicable. Data Collection and Analysis: Review of current practice. Findings:  The article makes transparent the lack of attention to validation of achievement tests to support inferences relevant to intended uses in instruction and project evaluation. Elements of a model for the process of reasoning from test scores are articulated. The cognitive demands on the test score user are illustrated in achievement test contexts in writing, science, and mathematics. Implications are drawn for deliberation on issues and for the development of casebooks to guide practice. Keywords:  assessment; test validation; test users; test interpretation&nbsp

Toward a Dialogue: Following Professional Standards on Education Achievement Testing

The authors describe challenges of following professional standards for educational achievement testing due to the complexity of gathering appropriate evidence to support demanding test interpretation and use. Validity evidence has been found to be low for some individual testing standards, leading to the possibility of faulty or impoverished test interpretation and use. In response to this context, measurement professionals have called for a theory of action including behavior changes of multiple agents involved in the testing process. Also, changing roles have been seen for a broad range of agents including test developers, those who influence testing, and those influenced by testing. Some of these roles are discussed and others illustrated with examples from practice. A sociocultural theory of action noted in the literature is proposed as a thematic guide to practice. The paper concludes with a call for dialogue and two research and development tasks that might advance practice

Demands on Users for Interpretation of Achievement Test Scores: Implications for the Evaluation Profession

Background:  Professional standards for validity of achievement tests have long reflected a consensus that validity is the degree to which evidence and theory support interpretations of test scores entailed by the intended uses of tests.  Yet there are convincing lines of evidence that the standards are not adequately followed in practice, that standards alone are not sufficient guides to action, and that reviewers of tests do not call attention to important kinds of validity evidence that might support the demanding process of making sense of test scores or reasoning from test scores. Purpose: The intent of this article is to make more transparent the demands of achievement test interpretation on users in instructional contexts and to open up a dialogue on implications for the evaluation profession for improvement of practice along lines already set out by evaluation theorists. Setting:  Not applicable. Intervention: Not applicable. Research Design: Not applicable. Data Collection and Analysis: Review of current practice. Findings:  The article makes transparent the lack of attention to validation of achievement tests to support inferences relevant to intended uses in instruction and project evaluation. Elements of a model for the process of reasoning from test scores are articulated. The cognitive demands on the test score user are illustrated in achievement test contexts in writing, science, and mathematics. Implications are drawn for deliberation on issues and for the development of casebooks to guide practice. Keywords:  assessment; test validation; test users; test interpretation&nbsp

Two Experimental Feedback Procedures: A Comparison of Their Effects on the Learning of Concepts

88 p.Thesis (Ph.D.)--University of Illinois at Urbana-Champaign, 1956.U of I OnlyRestricted to the U of I community idenfinitely during batch ingest of legacy ETD