Mixed Student Ideas about Mechanisms of Human Weight Loss

Recent calls for college biology education reform have identified “pathways and transformations of matter and energy” as a big idea in biology crucial for students to learn. Previous work has been conducted on how college students think about such matter-transforming processes; however, little research has investigated how students connect these ideas. Here, we probe student thinking about matter transformations in the familiar context of human weight loss. Our analysis of 1192 student constructed responses revealed three scientific (which we label “Normative”) and five less scientific (which we label “Developing”) ideas that students use to explain weight loss. Additionally, students combine these ideas in their responses, with an average number of 2.19 ± 1.07 ideas per response, and 74.4% of responses containing two or more ideas. These results highlight the extent to which students hold multiple (both correct and incorrect) ideas about complex biological processes. We described student responses as conforming to either Scientific, Mixed, or Developing descriptive models, which had an average of 1.9 ± 0.6, 3.1 ± 0.9, and 1.7 ± 0.8 ideas per response, respectively. Such heterogeneous student thinking is characteristic of difficulties in both conceptual change and early expertise development and will require careful instructional intervention for lasting learning gains

Introductory biology undergraduate students\u27 mixed ideas about genetic information flow

The core concept of genetic information flow was identified in recent calls to improve undergraduate biology education. Previous work shows that students have difficulty differentiating between the three processes of the Central Dogma (CD; replication, transcription, and translation). We built upon this work by developing and applying an analytic coding rubric to 1050 student written responses to a three‐question item about the CD. Each response was previously coded only for correctness using a holistic rubric. Our rubric captures subtleties of student conceptual understanding of each process that previous work has not yet captured at a large scale. Regardless of holistic correctness scores, student responses included five or six distinct ideas. By analyzing common co‐occurring rubric categories in student responses, we found a common pair representing two normative ideas about the molecules produced by each CD process. By applying analytic coding to student responses preinstruction and postinstruction, we found student thinking about the processes involved was most prone to change. The combined strengths of analytic and holistic rubrics allow us to reveal mixed ideas about the CD processes and provide a detailed picture of which conceptual ideas students draw upon when explaining each CD process

Deconstruction of Holistic Rubrics into Analytic Rubrics for Large-Scale Assessments of Students’ Reasoning of Complex Science Concepts

Constructed responses can be used to assess the complexity of student thinking and can be evaluated using rubrics. The two most typical rubric types used are holistic and analytic. Holistic rubrics may be difficult to use with expert-level reasoning that has additive or overlapping language. In an attempt to unpack complexity in holistic rubrics at a large scale, we have developed a systematic approach called deconstruction. We define deconstruction as the process of converting a holistic rubric into defining individual conceptual components that can be used for analytic rubric development and application. These individual components can then be recombined into the holistic score which keeps true to the holistic rubric purpose, while maximizing the benefits and minimizing the shortcomings of each rubric type. This paper outlines the deconstruction process and presents a case study that shows defined concept definitions for a hierarchical holistic rubric developed for an undergraduate physiology-content reasoning context. These methods can be used as one way for assessment developers to unpack complex student reasoning, which may ultimately improve reliability and validation of assessments that are targeted at uncovering large-scale complex scientific reasoning. Accessed 398 times on https://pareonline.net from September 05, 2019 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right

Characterizing college science instruction: The Three-Dimensional Learning Observation Protocol

The importance of improving STEM education is of perennial interest, and to this end, the education community needs ways to characterize transformation efforts. Three-dimensional learning (3DL) is one such approach to transformation, in which core ideas of the discipline, scientific practices, and crosscutting concepts are combined to support student development of disciplinary expertise. We have previously reported on an approach to the characterization of assessments, the Three-Dimensional Learning Assessment Protocol (3D-LAP), that can be used to identify whether assessments have the potential to engage students in 3DL. Here we present the development of a companion, the Three-Dimensional Learning Observation Protocol (3D-LOP), an observation protocol that can reliably distinguish between instruction that has potential for engagement with 3DL and instruction that does not. The 3D-LOP goes beyond other observation protocols, because it is intended not only to characterize the pedagogical approaches being used in the instructional environment, but also to identify whether students are being asked to engage with scientific practices, core ideas, and crosscutting concepts. We demonstrate herein that the 3D-LOP can be used reliably to code for the presence of 3DL; further, we present data that show the utility of the 3D-LOP in differentiating between instruction that has the potential to promote 3DL from instruction that does not. Our team plans to continue using this protocol to evaluate outcomes of instructional transformation projects. We also propose that the 3D-LOP can be used to support practitioners in developing curricular materials and selecting instructional strategies to promote engagement in three-dimensional instruction

Measuring Teachers’ Learning from a Problem-Based Learning Approach to Professional Development in Science Education

In this study we measured changes in science teachers’ conceptual science understanding (content knowledge) and pedagogical content knowledge (PCK) while participating in a problem-based learning (PBL) model of professional development. Teachers participated in a two-week long workshop followed by nine monthly meetings during one academic year that focused on deepening their content understanding and their teaching practices. We analyzed teachers’ short writings and concept map depictions of their understanding, and found teachers significantly developed components of pedagogical content knowledge and clinical reasoning, such as knowledge of assessment. Gains on conceptual understanding of science, however, were limited to one group of teachers. We conclude that this PBL approach to professional development advanced components of science teachers’ strategic pedagogical content knowledge and discuss the ongoing challenges in measuring changes in teachers’ understanding in the context of an evolving PBL model of professional development

IF YOU BUILD IT, WHY WILL THEY COME BACK? - MOTIVATION OF TEACHERS TO REENROLL IN A PROFESSIONAL DEVELOPMENT PROJECT Problem-Based Learning Project for Teachers Michigan State University

Abstract This qualitative study was conducted to understand teacher motivation to re-enroll in an extended professional development program. Data were collected from interviews with four teachers. We found that teachers made decisions to reenroll based on their perceived utility value of learning in this professional development, and that teachers were intrinsically motivated to explore their inquiry. We also found that providing teachers with autonomy to select learning issues and constructing extended learning communities could enhance teachers' perceived utility value of engagement and provoke teachers to generate new inquiry. Other factors, such as extrinsic incentives and an encouraging school culture also played a positive role on teachers' re-enrollment. Additionally, teachers had little concern about their capabilities to achieve learning tasks during their participation