Skip to main content
Article thumbnail
Location of Repository

Content Validity and Comparability of the Lebanese National Examinations in Chemistry: An Attempt to Use the Webb Alignment Model in Lebanon

By Zeina Hajo

Abstract

Currently, test validity is the extent to which several kinds of validity evidence can support the appropriateness of the proposed interpretations and uses of test scores. To validate the use of scores of the Lebanese National Examinations (LNE) in Chemistry for student certification, this study investigated content and substantive evidence of validity of the LNE in Chemistry for Grade 12 Life Sciences section over three years. To collect the two types of validity evidence needed, the degree of alignment in content and cognitive demands between the first sessions of the 2004, 2005 and 2006 of the Chemistry National Exams (CNE) and the Grade 12 Chemistry Curriculum (G12CC) were evaluated.\ud The scores of the LNE are also used interchangeably; so that failing students can retake the exams. To evaluate the appropriateness of using the scores of the CNE interchangeably, evidence of comparability was collected by investigating the consistency of CNE in content and cognitive demands over a three-year period, from 2004 to 2006.\ud The Webb alignment model was employed in the study. Nine experts in Chemistry reviewed the G12CC and the three CNE to judge their alignment. Both quantitative and qualitative data were gathered in this document-based research study where expert review and survey questionnaires were used to collect data.\ud The results of the study have shown that the Webb alignment model is not appropriate for Lebanon and some European countries (e.g. France and England), the CNE do not measure the content of the G12CC adequately enough, the G12CC does not specify the cognitive processes or thinking skills that the CNE should measure, and the CNE are not consistent in their cognitive demands from year to year

Publisher: University of Leicester
Year: 2010
OAI identifier: oai:lra.le.ac.uk:2381/8321

Suggested articles

Citations

  1. (2000)Mail and Internet surveys: The tailored design method, 2nd ed.
  2. (2001a) Educational assessments of students (3rd Ed.), Upper Saddle River,
  3. (1994). A model for curriculum-driven criterion-referenced and normreferenced national examinations for certification and selection of students, A paper presented at the International conference on educational evaluation and assessment,
  4. (1994). A plan for educational reform
  5. (2002). a) Balance of scientific literacy theme in science curricula: the case of Lebanon,
  6. (2003). Achieving alignment,
  7. (2004). al-manahej al-jadida: ma laha wa ma alayh, al-majala al-tarbawiya [New curricula: Advantages and disadvantages,
  8. (2004). Aligning curriculum, standards, and assessments: Fulfilling the promise of school reform,
  9. (2003). Aligning tests with states’ content standards: Methods and issues, Educational Measurements: Issues and practice,
  10. (2004). Alignment in educational assessment, Sant Antonio: Harcourt assessment,
  11. (2005). Alignment of alternate assessments using the Webb system,
  12. (2005). Alignment of an alternate assessment with state academic standards: Evidence for the content validity of the Wisconsin alternate assessment,
  13. (2007). Alignment study: Oregon’s extended assessments in reading, writing, mathematics, and science,
  14. (2007). Alternative conceptions of comparability, In
  15. (1992). An Argument-Based Approach to Validity,
  16. (2001). An overview of the relationship between assessment and the curriculum,
  17. (1993). Approaches to social enquiry,
  18. (1937). Aptitudes and aptitude testing (quoted in
  19. (2005). AQA (Assessment and Qualifications Alliance)
  20. (2003). Assessment
  21. (1997). Assessment and learning: Primary and secondary,
  22. (1995). Assessment in the service of learning
  23. (1998). Assessment manager course booklet, Capital education services Ltd.
  24. (2001). Assessment: A guide for lecturers,
  25. (1997). Assessment: A teacher’s guide to the issue (3rd Ed),
  26. (2000). Assessment: The engine of systemic curricular reform? Curriculum studies,
  27. (1993). Association for the Advancement of Science
  28. (2007). Awarding examination grades: Current processes and their evolution, In
  29. (1973). Behavioural objectives: A critical review,
  30. (1971). Bloom’s taxonomy: a philosophical critique (1),
  31. (1971). Bloom’s taxonomy: a philosophical critique (2),
  32. (2002). Boujaoude (2002b) Evaluating learning in science and chemistry,
  33. (2005). Classroom assessment: what teachers need to know (2nd Ed.), London: Allyn and Bacon.
  34. (1999). Classroom assessment: what teachers need to know, London: Allyn and Bacon.
  35. (1996). Cognition and Learning,
  36. (1985). Combining qualitative and quantitative methodologies, in
  37. (1978). Comparability of grading standards in science subjects at GCE A level: A study of two examination boards
  38. (1998). Competency-based education and training: Myths and realitie,
  39. (1994). Competing paradigms in qualitative research,
  40. (1991). Complex, performance-based assessment: Expectations and validation criteria,
  41. (2001). Conceptual frameworks to accommodate the validation of rapidly changing requirements for assessments, In
  42. (1988). Conducting educational research (3rd ed.),
  43. (1955). Construct validity in psychological tests,
  44. (2002). Constructivism and science education: A further appraisal,
  45. (1998). Constructivism in science education: a philosophical examination,
  46. (1996). Constructivism: Theory, perspectives and practice,
  47. (2006). Content-related validity evidence in test development,
  48. (2007). Contextualizing the comparability of examination standards, In
  49. (1980). Criterion-referenced measurement: The state of the art, London: The Johns Hopkins
  50. (2000). Current concerns in validity theory, A paper presented at the annual meeting of the American Educational Research Association,
  51. (1996). Curriculum and Assessment Authority
  52. (2006). Curriculum leadership,
  53. (1992). Curriculum stability and change, in P.W. Jackson (Ed.) Handbook of Research on
  54. (2000). Curriculum: An integrative introduction (2nd Ed),
  55. (2001). decree number 5697 Nizam al-imtihanat alrasmiya
  56. (1981). Defining public examination standards, School council research studies,
  57. (2003). Digging deeper: Where does the public stand on standards-based education? Aurora: Mid-continent regional educational lab.
  58. (1993). Do middle school Life Sciences textbooks provide a balance of scientific literacy themes?
  59. (1993). Doing your research project: A guide for first-time researchers in education and social science (2nd Ed).
  60. (1987). Doing your research project: A guide for first-time researchers in education and social science. Milton Keynes:
  61. (1980). Domain specification strategies, In
  62. (1980). Domain-referenced versus mastery conceptualization of criterionreferenced measurement: A classification, Paper presented at the annual meeting of the American educational research association,
  63. (1975). Educational evaluation,
  64. (1999). Educational Research Association (AERA),
  65. (2000). Ethical principles
  66. (1978). Ethics in social and bevahioral research (quoted in
  67. (2002). Ethics of research in educations, In
  68. (1993). Evaluating Test Validity, in L. Darling-Hammon (Ed.),
  69. (1975). Evaluation: Evolution (Evaluation as Evolution), ERIC microfiche system.
  70. (2003). Evatuation of the chemistry curriculum
  71. (2005). for alignment standards and assessments,
  72. (2001). Formative assessment and curriculum consequences in
  73. (2008). GCSE, GCE and AEA code of practice,
  74. (2002). Ground rules for good research: A10 point guide for social researchers, London:
  75. (2001). How grades 1 – 7 teachers assess Mathematics and how they use the assessment data,
  76. (1993). How to design and evaluate research in education (2nd Ed),
  77. (1995). How to write and use instructional objectives (5th Ed.), Upper Saddle River, NJ:
  78. (2000). Inquiry and the national science education standards: a guide for teaching and learning,
  79. (2003). Instructional objectives in
  80. (1986). Introduction to classical and modern test theory.
  81. (1998). Introduction to social research: Quantitative and qualitative approaches.
  82. (2007). Language testing and assessment: An advanced resource book,
  83. (2006). linking and equating,
  84. (2002). Maintaining GCE A levels standards: The findings of an independent panel of experts,
  85. (2003). Major issues and controversies in the use of mixed methods in social and behavioral sciences,
  86. (1998). Making a curriculum: Some principle of curriculum building
  87. (1989). Meaning and values in test validation: The science and ethics of assessment,
  88. (1996). Meanings and consequences: A basis for distinguishing formative and summative functions of assessment,
  89. (2007). Measurement issues in the alignment of standards and assessments: A case study,
  90. (2003). Measurement practices: Methods for developing content-valid student examinations,
  91. (2002). Measuring the content of instruction: Used in research and practice,
  92. (2001). Measuring up-a commissioned report on education assessments forMinnesota,Washington, DC:
  93. (1998). methodology: Combining qualitative and quantitative approaches,
  94. (2002). Models for alignment analysis and assistance to states, Paper presented by the Council of Chief Stat Officers.
  95. (2001). Models of curriculum organization
  96. (2001). New tools for analysing teaching, curriculum and standards in mathematics and science: report from survey of enacted curriculum project, Final report,
  97. of Education (2000)Maryland science content standards,
  98. (2001). Official order 735/m Tawsif mawad alimtihanat arrasmiia
  99. (1962). Preparing instructional objectives,
  100. (1998). Public examinations
  101. (2006). QCA’s review of standards: Description of the program,
  102. (2009). Qualifications Alliance) (online retrieved April,
  103. (1994). Qualitative data analysis (2nd Ed.), London: Sage publications.
  104. (1990). Qualitative evaluation and research methods,
  105. (2001). Qualitative research methods for the social sciences (4th Ed.),
  106. (1999). Qualitative research Vol I, London:
  107. (2003). Questioning skills in
  108. (1996). research council
  109. (2003). Research design: Qualitative, quantitative, and mixed methods approaches (2nd Ed.).
  110. (2005). Research Ethics Framework, Swindon: Economic and Social Research Council
  111. (1997). Research in education: Epistemological issues, In Keeves,
  112. (1994). Research on goals for the science curriculum
  113. (2003). Rethinking issues of alignment under No Child Left Behind,
  114. (2007). Review and other views: “Alignment” as a psychometric issue, Applied measurement in education,
  115. (2000). Science Content Standards for California Public Schools: Kindergarten through Grade Twelve,
  116. (1998). Science curriculum: Transforming goals to practice,
  117. (1999). Science: The National Curriculum for England www.nc.uk.net, Key stage 1-4,
  118. (1997). Shaping the college curriculum: Academic plans in action,
  119. (1996). Shift and convergence in science learning and instruction
  120. (2001). Social research methods,
  121. (2000). Social research methods: Qualitative and quantitative approaches,
  122. (1997). Social research: Quantitative and qualitative approaches,
  123. (2009). Source: http://www.ciea.org.uk/knowledge_centre/articles_speeches/general_articles/developing_ specifications.aspx
  124. (2006). Standards
  125. (2007). Standards setting: A guide to establishing and evaluating performance standards on tests,
  126. (2002). Standards-based education,
  127. (2000). State standards and state assessment systems: A guide to alignment,
  128. (1975). Strategies of social research: The methodological imagination (quoted in
  129. (2002). Takiim Nizam attakiim [Evaluation of student assessment schemes],
  130. (1956). Taxonomy of educational objectives: the classification of educational goals: Handbook 1. The cognitive domain.
  131. (2005). Teacher-candidates’ exposure to formative assessment in educational psychology textbooks: A content analysis,
  132. (1990). Teachers and students: Constructivists forging connections,
  133. (2005). Teachers’ summative practices and assessment for learning – tensions and synergies,
  134. (1955). Technical recommendations for achievement tests (quoted
  135. (1980). Test score validity and standard-setting methods,
  136. (1971). Test validation in Thorndike;
  137. (2004). The curriculum: theory and practice (5th Ed),
  138. (2007). The demands of examination syllabuses and question papers, In
  139. (1988). The once and future issues of validity: Assessing the meaning and consequences of measurement,
  140. (1998). The science curriculum: between ideas and outcomes
  141. (2006). The standards for educational and psychological testing: Guidance in test development,
  142. (2004). The student assessment handbook: New directions in traditional and online assessment, London: Routledge Falmer.
  143. (1994). The validity and value of national vocational qualifications,
  144. (1989). toward a conceptual framework for mixed-method evaluation design, Educational evaluation and policy analysis,
  145. (1994). Triangulation in educational research,
  146. (2006). Twelve steps for effective test development,
  147. (2000). Understanding assessment: Purpose, perceptions, practice,
  148. (1995). Using assessment to improve learning,
  149. (2002). Validating high-stakes testing programs, Educational measurement:
  150. (2002). Validation of the uses and interpretations of results of state assessments and accountability systems,
  151. (2004). Validity of high-stakes assessment: are students engaged in complex thinking,
  152. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning,
  153. (1988). Validity: an evolving concept,
  154. (1983). Ward educational consulting
  155. (2005). Web alignment tool (WAT): Training manual,Wisconsin: Council of Chief Stat Officers and Wisconsin Centre for Education Research
  156. (1997). When do I tell them the right answer?
  157. (2009). Wisconsin's Model Academic Standards for Science, Source: http://dpi.wi.gov/standards/scid12.html
  158. (2002). Word education encyclopedia: A survey of educational systems Worldwide (2nd Ed),

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.