Student Understanding of Control of Variables: Deciding Whether or Not a Variable Influences the Behavior of a System

The ability of adult students to reason on the basis of the control of variables was the subject of an extended investigation. This paper describes the part of the study that focused on the reasoning required to decide whether or not a given variable influences the behavior of a system. The participants were undergraduates taking introductory Physics and K-8 teachers studying physics and physical science in inservice institutes and workshops. Although most of the students recognized the need to control variables, many had significant difficulty with the underlying reasoning. The results indicate serious shortcomings in the preparation of future scientists and in the education of a scientifically literate citizenry. There are also strong implications for the professional development of teachers, many of whom are expected to teach control of variables to young students

Designing research-based instructional materials that leverage dual-process theories of reasoning: Insights from testing one specific, theory-driven intervention

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] Research in physics education has contributed substantively to improvements in the learning and teaching of university physics by informing the development of research-based instructional materials for physics courses. Reports on the design of these materials have tended to focus on overall improvements in student performance, while the role of theory in informing the development, refinement, and assessment of the materials is often not clearly articulated. In this article, we illustrate how dual-process theories of reasoning and decision making have guided the ongoing development, testing, and analysis of an instructional intervention, implemented at three different institutions, designed to build consistency in student reasoning about the application of Newton’s 2nd law to objects at rest. By employing constructs from cognitive science associated with dual-process theories of reasoning (such as mindware and cognitive reflection), we were able not only to examine the overall improvement in student performance but also to investigate the impact of the intervention on two aspects of productive reasoning—mindware and cognitive reflection. Our analysis showed that the intervention strengthened students’ mindware such that students were able to apply it as a criterion while checking the validity of their intuitive responses. Moreover, logistic regression revealed that the success of our intervention was mediated by the students’ cognitive reflection skills. Indeed, for students with comparable mindware, those who demonstrated a weaker tendency toward cognitive reflection were less likely to initiate conflict detection and therefore never had the opportunity to utilize their mindware. We believe that this kind of integrated, theory-driven approach to intervention design and testing represents an important first step in efforts to both account for and leverage domain-general reasoning phenomena in the learning and teaching of physics

Abstracts from the NIHR INVOLVE Conference 2017

n/

Effect of lecture instruction on student performance on qualitative questions

The impact of lecture instruction on student conceptual understanding in physics has been the subject of research for several decades. Most studies have reported disappointingly small improvements in student performance on conceptual questions despite direct instruction on the relevant topics. These results have spurred a number of attempts to improve learning in physics courses through new curricula and instructional techniques. This paper contributes to the research base through a retrospective analysis of 20 randomly selected qualitative questions on topics in kinematics, dynamics, electrostatics, waves, and physical optics that have been given in introductory calculus-based physics at the University of Washington over a period of 15 years. In some classes, questions were administered after relevant lecture instruction had been completed; in others, it had yet to begin. Simple statistical tests indicate that the average performance of the “after lecture” classes was significantly better than that of the “before lecture” classes for 11 questions, significantly worse for two questions, and indistinguishable for the remaining seven. However, the classes had not been randomly assigned to be tested before or after lecture instruction. Multiple linear regression was therefore conducted with variables (such as class size) that could plausibly lead to systematic differences in performance and thus obscure (or artificially enhance) the effect of lecture instruction. The regression models support the results of the simple tests for all but four questions. In those cases, the effect of lecture instruction was reduced to a nonsignificant level, or increased to a significant, negative level when other variables were considered. Thus the results provide robust evidence that instruction in lecture can increase student ability to give correct answers to conceptual questions but does not necessarily do so; in some cases it can even lead to a decrease

Probing student reasoning approaches through the lens of dual-process theories: A case study in buoyancy

A growing body of scholarly work indicates that student performance on physics problems stems from many factors, including relevant conceptual understanding. However, in contexts in which significant conceptual difficulties have been documented via research, it can be difficult to pinpoint and isolate such factors because students’ written and interview responses rarely reveal the full richness of their conscious and, perhaps more importantly, subconscious reasoning paths. In this investigation, informed by dual-process theories of reasoning and decision making as well as the theoretical construct of accessibility, we conducted a series of experiments in order to gain greater insight into the factors impacting student performance on the “five-block problem,” which has been used in the literature to probe student thinking about buoyancy. In particular, we examined both the impact of problem design (including salient features and cueing) and the impact of targeted instruction focused on density-based arguments for sinking and floating and on neutral buoyancy. The investigation found that instructional modifications designed to remove the strong intuitive appeal of the first-available response led to significantly improved performance, without improving student conceptual understanding of the requisite buoyancy concepts. As such, our findings represent an important first step in identifying systematic strategies for using theories from cognitive science to guide the development and refinement of research-based instructional materials

Student conceptual resources for understanding mechanical wave propagation

Much of the literature contributing to physics instructors’ knowledge of student ideas (KSI) reports common patterns of reasoning that are framed as discontinuous with canonical concepts. Our work contributes new KSI about mechanical wave propagation from a resources perspective, framing student thinking in terms of context-sensitive pieces of knowledge that are continuous with canonical physics concepts. The intent of this work is to inform instruction on mechanical waves by identifying and illustrating some of the conceptual resources that instructors might expect their students to use. To support instructor predictions about student thinking, we identify resources that are common across multiple samples and questions. Our data include written responses to three versions of a conceptual question about mechanical pulse propagation. We use an emergent coding scheme to characterize a total of 851 written responses from 6 universities in the United States. Our analysis reveals three common conceptual resources: (i) properties of the medium either impede or facilitate the motion of the pulse, (ii) the speed or duration of transverse motion affects pulse speed, and (iii) the speed of the pulse is affected by its kinetic energy. We show how each of these resources can be viewed as continuous with formal understandings of pulse propagation