Investigating the role of model-based reasoning while troubleshooting an electric circuit

We explore the overlap of two nationally-recognized learning outcomes for physics lab courses, namely, the ability to model experimental systems and the ability to troubleshoot a malfunctioning apparatus. Modeling and troubleshooting are both nonlinear, recursive processes that involve using models to inform revisions to an apparatus. To probe the overlap of modeling and troubleshooting, we collected audiovisual data from think-aloud activities in which eight pairs of students from two institutions attempted to diagnose and repair a malfunctioning electrical circuit. We characterize the cognitive tasks and model-based reasoning that students employed during this activity. In doing so, we demonstrate that troubleshooting engages students in the core scientific practice of modeling.Comment: 20 pages, 6 figures, 4 tables; Submitted to Physical Review PE

The role of metacognition in troubleshooting: an example from electronics

Students in physics laboratory courses, particularly at the upper division, are often expected to engage in troubleshooting. Although there are numerous ways in which students may proceed when diagnosing a problem, not all approaches are equivalent in terms of providing meaningful insight. It is reasonable to believe that metacognition, by assisting students in making informed decisions, is an integral component of effective troubleshooting. We report on an investigation of authentic student troubleshooting in the context of junior-level electronics courses at two institutions. Think-aloud interviews were conducted with pairs of students as they attempted to repair a malfunctioning operational-amplifier circuit. Video data from the interviews have been analyzed to examine the relationship between each group's troubleshooting activities and instances of socially mediated metacognition. We present an analysis of a short episode from one interview.Comment: 4 pages, 1 figure; Submitted to 2015 PERC Proceeding

Designing research-based instructional materials that leverage dual-process theories of reasoning: Insights from testing one specific, theory-driven intervention

[This paper is part of the Focused Collection on Curriculum Development: Theory into Design.] Research in physics education has contributed substantively to improvements in the learning and teaching of university physics by informing the development of research-based instructional materials for physics courses. Reports on the design of these materials have tended to focus on overall improvements in student performance, while the role of theory in informing the development, refinement, and assessment of the materials is often not clearly articulated. In this article, we illustrate how dual-process theories of reasoning and decision making have guided the ongoing development, testing, and analysis of an instructional intervention, implemented at three different institutions, designed to build consistency in student reasoning about the application of Newton’s 2nd law to objects at rest. By employing constructs from cognitive science associated with dual-process theories of reasoning (such as mindware and cognitive reflection), we were able not only to examine the overall improvement in student performance but also to investigate the impact of the intervention on two aspects of productive reasoning—mindware and cognitive reflection. Our analysis showed that the intervention strengthened students’ mindware such that students were able to apply it as a criterion while checking the validity of their intuitive responses. Moreover, logistic regression revealed that the success of our intervention was mediated by the students’ cognitive reflection skills. Indeed, for students with comparable mindware, those who demonstrated a weaker tendency toward cognitive reflection were less likely to initiate conflict detection and therefore never had the opportunity to utilize their mindware. We believe that this kind of integrated, theory-driven approach to intervention design and testing represents an important first step in efforts to both account for and leverage domain-general reasoning phenomena in the learning and teaching of physics

Anatomy of STEM Teaching in American Universities: A Snapshot from a Large-Scale Observation Study

National and local initiatives focused on the transformation of STEM teaching in higher education have multiplied over the last decade. These initiatives often focus on measuring change in instructional practices, but it is difficult to monitor such change without a national picture of STEM educational practices, especially as characterized by common observational instruments. We characterized a snapshot of this landscape by conducting the first large scale observation-based study. We found that lecturing was prominent throughout the undergraduate STEM curriculum, even in classrooms with infrastructure designed to support active learning, indicating that further work is required to reform STEM education. Additionally, we established that STEM faculty’s instructional practices can vary substantially within a course, invalidating the commonly-used teaching evaluations based on a one-time observation

Answer first: Applying the heuristic-analytic theory of reasoning to examine student intuitive thinking in the context of physics

We have applied the heuristic-analytic theory of reasoning to interpret inconsistencies in student reasoning approaches to physics problems. This study was motivated by an emerging body of evidence that suggests that student conceptual and reasoning competence demonstrated on one task often fails to be exhibited on another. Indeed, even after instruction specifically designed to address student conceptual and reasoning difficulties identified by rigorous research, many undergraduate physics students fail to build reasoning chains from fundamental principles even though they possess the required knowledge and skills to do so. Instead, they often rely on a variety of intuitive reasoning strategies. In this study, we developed and employed a methodology that allowed for the disentanglement of student conceptual understanding and reasoning approaches through the use of sequences of related questions. We have shown that the heuristic-analytic theory of reasoning can be used to account for, in a mechanistic fashion, the observed inconsistencies in student responses. In particular, we found that students tended to apply their correct ideas in a selective manner that supported a specific and likely anticipated conclusion while neglecting to employ the same ideas to refute an erroneous intuitive conclusion. The observed reasoning patterns were consistent with the heuristic-analytic theory, according to which reasoners develop a “first-impression” mental model and then construct an argument in support of the answer suggested by this model. We discuss implications for instruction and argue that efforts to improve student metacognition, which serves to regulate the interaction between intuitive and analytical reasoning, is likely to lead to improved student reasoning

Student difficulties measuring distances in terms of wavelength: Lack of basic skills or failure to transfer?

In a previous paper that focused on the transmission of periodic waves at the boundary between two media, we documented difficulties with the basic concepts of wavelength, frequency, and propagation speed, and with the relationship v=fλ. In this paper, we report on student attempts to apply this relationship in problems involving two-source and thin-film interference. In both cases, interference arises from differences in the path lengths traveled by two waves. We found that some students (up to 40% on certain questions) had difficulty with a task that is fundamental to understanding these phenomena: expressing a physical distance, such as the separation between two sources, in terms of the wavelength of a periodic wave. We administered a series of questions to try to identify factors that influence student performance. We concluded that most incorrect responses stemmed from erroneous judgment about the type of reasoning required, not an inability to do said reasoning. A number of students do not seem to treat the spacing of moving wave fronts as analogous to immutable measurement tools (e.g., rulers)

Investigating student understanding of bipolar junction transistor circuits

The research reported in this article represents a systematic, multiyear investigation of student understanding of the behavior of bipolar junction transistor circuits using a variety of different tasks to isolate and probe key aspects of transistor circuit behavior. The participants in this study were undergraduates enrolled in upper-division physics electronics courses at three institutions, as well as undergraduates in upper-division engineering electronics courses at one of the institutions. Findings from this research indicate that many students have not developed a robust conceptual understanding of the functionality of bipolar junction transistors circuits even after all relevant instruction. Most notably, when asked to analyze the impact of a transistor circuit on input signals, students frequently applied reasoning appropriate for an analysis of the circuit’s dc bias behavior. However, students often displayed knowledge of fundamental transistor behavior when responding to more targeted questions. This article provides insight into student thinking about transistor circuits, describing the most prevalent conceptual and reasoning difficulties identified and discussing some important implications for instruction