Use of Assessments in College Chemistry Courses: Examining Students\u27 Prior Conceptual Knowledge, Chemistry Self-efficacy, and Attitude

Students\u27 retention in STEM-related careers is of great concern for educators and researchers, especially the retention of underrepresented groups such as females, Hispanics, and Blacks in these careers. Therefore it is important to study factors that could potentially influence students\u27 decision to stay in STEM. The work described in this dissertation involved three research studies where assessments have been used in college chemistry courses to assess students\u27 prior content knowledge, chemistry-self-efficacy, and attitude toward science. These three factors have been suggested to have an influence on students\u27 performance in a course and could eventually be a retention factor. The first research study involved the development and use of an instrument to measure biochemistry prior knowledge of foundational concepts from chemistry and biology that are considered important for biochemistry learning. This instrument was developed with a parallel structure where three items were used to measure a concept and common incorrect ideas were used as distractors. The specific structure of this instrument allows the identification of common incorrect ideas that students have when entering biochemistry and that can hinder students\u27 learning of biochemistry concepts. This instrument was given as pre/posttest to students enrolled in introductory biochemistry courses. The findings indicated that some incorrect ideas are persistent even after instruction, as is the case for bond energy and the structure of the alpha helix concepts. This study highlights the importance of measuring prior conceptual knowledge; so that instructors can plan interventions to help students overcome their incorrect ideas. For the second research study, students\u27 chemistry self-efficacy was measured five times during a semester of preparatory college chemistry. Chemistry self-efficacy beliefs have been linked to students\u27 achievement, and students with stronger self-efficacy are more likely to try challenging tasks and persist in them, which will help them to stay in STEM. Using multilevel modeling analysis to examine potential differences in students\u27 self-efficacy beliefs by sex and race/ethnicity, it was found that there were some differences in the trends by race/ethnicity. In particular, we found that for Hispanic and Black males the trends were negative when compared with White males. This study highlights the importance of measuring self-efficacy at different time points in the semester and for instructors to be aware of potential differences in their students\u27 confidence when working on a chemistry task. The third research study involves the use of the Test of Science Related Attitudes (TOSRA) in an introductory chemistry course. A shortened version of the instrument that includes three scales, normality of scientists, attitude toward inquiry, and career interest in science was used. The first purpose of this study was to gather validity evidence for the internal structure of the instrument with college chemistry students. Using measurement invariance analysis by sex and race/ethnicity, it was found that the internal structure holds by sex, but it did not hold for Blacks in our sample. Further analysis revealed problems with the normality scales for Blacks. The second purpose was to examine the relationship between the scales of TOSRA, achievement in chemistry, and math prior knowledge. Using Structural Equation Modeling (SEM) it was found that two of the TOSRA scales, attitude toward inquiry and career interest in science, have a small but significant influence on students\u27 achievement in chemistry. This study highlights the importance of examining if the scores apply similarly for different group of students in a population, since the scores on these assessments could be used to make decisions that will affect student. The research studies presented in this work are a step forward with our intention to understand better the factors that can influence students\u27 decisions to stay or leave STEM-related careers. Each study has provided psychometric evidence for the use of three different assessments in college chemistry courses. Instructors can use these assessments in large and small lecture classrooms. Information obtained from these assessments can then be used to make target interventions to help students learn and/or be more confident on a given task. Also, it highlights the importance to look at different group of students, such as the underrepresented groups, since response trends may be different. Being aware of students\u27 diverse needs will help us to understand some of the challenges that student face in the chemistry classroom. Understanding some of these challenges will help instructors be more prepared for teaching

Development of a Certification Exam to Assess Undergraduate Students\u27 Proficiency in Biochemistry and Molecular Biology Core Concepts

With support from the American Society for Biochemistry and Molecular Biology (ASBMB), a community of biochemistry and molecular biology (BMB) scientist-educators has developed and administered an assessment instrument designed to evaluate student competence across four core concept and skill areas fundamental to BMB. The four areas encompass energy and metabolism; information storage and transfer; macromolecular structure, function, and assembly; and skills including analytical and quantitative reasoning. First offered in 2014, the exam has now been administered to nearly 4000 students in ASBMB-accredited programs at more than 70 colleges and universities. Here, we describe the development and continued maturation of the exam program, including the organic role of faculty volunteers as drivers and stewards of all facets: content and format selection, question development, and scoring