A Systematic Review of Formative Assessment to Support Students Learning Computer Programming

Formative assessment aims to increase student understanding, instructor instruction, and learning by providing feedback on students\u27 progress. The goal of this systematic review is to discover trends on formative assessment techniques used to support computer programming learners by synthesizing literature published between 2013 and 2023. 17 articles that were peer-reviewed and published in journals were examined from the initial search of 197 studies. According to the findings, all the studies were conducted at the higher education level and only a small number at the secondary school level. Overall, most studies found that motivation, scaffolding, and engagement were the three main goals of feedback, with less research finding that metacognitive goals were the intended outcomes. The two techniques for facilitating formative feedback that were used most frequently were compiler or testing based error messages and customised error messages. The importance of formative feedback is highlighted in the reviewed articles, supporting the contention that assessments used in programming courses should place a heavy emphasis on motivating students to increase their level of proficiency. This study also suggests a formative assessment that employs an adaptive strategy to evaluate the ability level of the novice students and motivate them to learn programming to acquire the necessary knowledge

What Do We Think We Think We Are Doing?: Metacognition and Self-Regulation in Programming

Metacognition and self-regulation are popular areas of interest in programming education, and they have been extensively researched outside of computing. While computing education researchers should draw upon this prior work, programming education is unique enough that we should explore the extent to which prior work applies to our context. The goal of this systematic review is to support research on metacognition and self-regulation in programming education by synthesizing relevant theories, measurements, and prior work on these topics. By reviewing papers that mention metacognition or self-regulation in the context of programming, we aim to provide a benchmark of our current progress towards understanding these topics and recommendations for future research. In our results, we discuss eight common theories that are widely used outside of computing education research, half of which are commonly used in computing education research. We also highlight 11 theories on related constructs (e.g., self-efficacy) that have been used successfully to understand programming education. Towards measuring metacognition and self-regulation in learners, we discuss seven instruments and protocols that have been used and highlight their strengths and weaknesses. To benchmark the current state of research, we examined papers that primarily studied metacognition and self-regulation in programming education and synthesize the reported interventions used and results from that research. While the primary intended contribution of this paper is to support research, readers will also learn about developing and supporting metacognition and self-regulation of students in programming courses

Exploring The Impact Of Cognitive Awareness Scaffolding For Debugging In An Introductory Computer Science Class

Debugging is a significant part of programming. However, a lot of introductory pro- gramming classes tend to focus on writing and reading code than on debugging. They utilize programming assignments that are designed in ways such that students learn debugging by completing these assignments which makes debugging more of an im- plicit goal. In this thesis, we propose a cognitive awareness scaffolding in debugging to help students self-regulate their debugging process. We validate its effectiveness by conducting experiments with students in four sections of a Data Structures course, which is one of the introductory computer science classes at California Polytechnic State University, San Luis Obispo. In this form, students identified the debugging stage, described the bugs in their own words, and tracked their attempts to fix them. The exit survey responses that students filled out at the end of the quarter indi- cate that students seemed to find the debugging form helpful with self-regulation in debugging process. For further investigation, we attempt to measure students’ under- standing of the bugs explained on the form. Additionally, we also discuss potential improvements for the debugging form

Applying science of learning in education: Infusing psychological science into the curriculum

The field of specialization known as the science of learning is not, in fact, one field. Science of learning is a term that serves as an umbrella for many lines of research, theory, and application. A term with an even wider reach is Learning Sciences (Sawyer, 2006). The present book represents a sliver, albeit a substantial one, of the scholarship on the science of learning and its application in educational settings (Science of Instruction, Mayer 2011). Although much, but not all, of what is presented in this book is focused on learning in college and university settings, teachers of all academic levels may find the recommendations made by chapter authors of service. The overarching theme of this book is on the interplay between the science of learning, the science of instruction, and the science of assessment (Mayer, 2011). The science of learning is a systematic and empirical approach to understanding how people learn. More formally, Mayer (2011) defined the science of learning as the “scientific study of how people learn” (p. 3). The science of instruction (Mayer 2011), informed in part by the science of learning, is also on display throughout the book. Mayer defined the science of instruction as the “scientific study of how to help people learn” (p. 3). Finally, the assessment of student learning (e.g., learning, remembering, transferring knowledge) during and after instruction helps us determine the effectiveness of our instructional methods. Mayer defined the science of assessment as the “scientific study of how to determine what people know” (p.3). Most of the research and applications presented in this book are completed within a science of learning framework. Researchers first conducted research to understand how people learn in certain controlled contexts (i.e., in the laboratory) and then they, or others, began to consider how these understandings could be applied in educational settings. Work on the cognitive load theory of learning, which is discussed in depth in several chapters of this book (e.g., Chew; Lee and Kalyuga; Mayer; Renkl), provides an excellent example that documents how science of learning has led to valuable work on the science of instruction. Most of the work described in this book is based on theory and research in cognitive psychology. We might have selected other topics (and, thus, other authors) that have their research base in behavior analysis, computational modeling and computer science, neuroscience, etc. We made the selections we did because the work of our authors ties together nicely and seemed to us to have direct applicability in academic settings

Self-regulated learning in higher education : strategies adopted by computer programming students

Trabalho apresentado em PAEE/ALE’2016, 8th International Symposium on Project Approaches in Engineering Education (PAEE) and 14th Active Learning in Engineering Education Workshop (ALE)To help students overcome their learning difficulties in the transition from entry-level to advanced computer programming, developing an appropriate set of learning strategies, the SimProgramming teaching approach has been adopted at the University of Trás-os-Montes e Alto Douro (Portugal). This approach is based on four conceptual foundations: businesslike learning environment, self-regulated learning, co-regulated learning, and formative assessment. In this approach the students develop an activity based on problem-based learning, with a specific set of tasks based on those four conceptual foundations. The approach was implemented in two courses from the second and third curricular years of the bachelor programmes in Informatics Engineering and Information & Communication Technologies. We conducted semi-structured interviews with students (n=32) at the end of the courses, to try to identify the students’ strategies for self-regulation of learning in the activity developed within the SimProgramming approach. The main strategies identified were: organization, planning, time management, identification of difficulties, resolution of the difficulties encountered, work review, identification of the factors that influenced their motivation, and structure of the environment. The factors influencing the motivation most often identified by students were the impact of the assessment in the final course grade, the completion of the course, learning, skills development, and teamwork. Generally, students applied strategies to solve the difficulties, in particular by searching for social help and information search. Procrastination was also often identified by students. Strategies of time management, transformation of information, in-depth review, self-reflection, and self-evaluation were referenced scantily. We found that students changed some of their strategies from one course edition to the next. We conclude by recommending the development of educational practices to help students review their work, treat and process the information they find, conduct self-reflection and self-evaluation of their performance during tasks, adopt concentration strategies, and become aware of their specific difficulties

Combatting the war against machines : an innovative hands-on approach to coding

Abstract: The 21st century is an era of technological advances that has surpassed previous decades. This is largely due to the level of innovation in the fields of artificial intelligence, robotics and automation. However, learners are often reluctant to choose computer programming (coding) as a subject due to it’s perceived difficulty. Nevertheless, it is also well known that learners that are introduced to computer programming at a young age become the computer science university graduates of tomorrow

Beyond Automated Assessment: Building Metacognitive Awareness in Novice Programmers in CS1

The primary task of learning to program in introductory computer science courses (CS1) cognitively overloads novices and must be better supported. Several recent studies have attempted to address this problem by understanding the role of metacognitive awareness in novices learning programming. These studies have focused on teaching metacognitive awareness to students by helping them understand the six stages of learning so students can know where they are in the problem-solving process, but these approaches are not scalable. One way to address scalability is to implement features in an automated assessment tool (AAT) that build metacognitive awareness in novice programmers. Currently, AATs that provide feedback messages to students can be said to implement the fifth and sixth learning stages integral to metacognitive awareness: implement solution (compilation) and evaluate implemented solution (test cases). The computer science education (CSed) community is actively engaged in research on the efficacy of compile error messages (CEMs) and how best to enhance them to maximize student learning and it is currently heavily disputed whether or not enhanced compile error messages (ECEMs) in AATs actually improve student learning. The discussion on the effectiveness of ECEMs in AATs remains focused on only one learning stage critical to metacognitive awareness in novices: implement solution. This research carries out an ethnomethodologically-informed study of CS1 students via think-aloud studies and interviews in order to propose a framework for designing an AAT that builds metacognitive awareness by supporting novices through all six stages of learning. The results of this study provide two important contributions. The first is the confirmation that ECEMs that are designed from a human-factors approach are more helpful for students than standard compiler error messages. The second important contribution is that the results from the observations and post-assessment interviews revealed the difficulties novice programmers often face to developing metacognitive awareness when using an AAT. Understanding these barriers revealed concrete ways to help novice programmers through all six stages of the problem-solving process. This was presented above as a framework of features, which when implemented properly, provides a scalable way to implicitly produce metacognitive awareness in novice programmers

Computer Self-Efficacy, Cognitive Actions, and Metacognitive Strategies of High School Students While Engaged in Interactive Learning Modules

The purpose of this research was to investigate high school students’ computer self-efficacy, cognitive actions, and metacognitive strategies in a self-regulated learning (SRL) framework while utilizing an interactive learning module. The researcher hypothesized that computer self-efficacy is correlated positively with cognitive actions and metacognitive strategies while the students are engaged with interactive learning modules. This research used a mixed-methods approach to answer the research questions. Two research questions guided this research: (1) How is students’ computer self-efficacy related to cognitive actions and metacognitive strategies while using interactive learning modules?; and (2) How do students plan monitor their cognitive actions, and regulate their monitoring strategies during learning with interactive learning modules?This study utilized self-regulated learning framework that covered self-efficacy, cognitive, and metacognitive components. While self-efficacy was represented by computer self-efficacy, the metacognitive component was represented by planning, monitoring, and regulating strategies. Cognitive actions represent contextual activities while using interactive learning modules. One hundred and thirteen students from two high schools in Northern Utah, USA(i.e., InTech Collegiate High School and Logan High School) participated in this study. Each student worked on three modules: Boolean Logic, Minimum Spanning Tree, and Modeling Using Graphs. Due to the differences in class schedules between both schools, students at InTech Collegiate High School and Logan High School completed the activities within 2 and 4 days, respectively. Three different forms of data were gathered for analysis. These data included questionnaires, screen captured videos, and audio recordings of the interviews. The students completed three questionnaires: demographic, computer self-efficacy, and self-regulated computer-based learning questionnaires.The findings of the study revealed that while computer self-efficacy was not positively correlated with cognitive actions, it was positively correlated with metacognitive strategies. Specifically, the findings revealed a significant positive correlation between computer self-efficacy and planning strategies. Screen-captured video analyses showed that there were different profiles of cognitive actions and metacognitive strategies between high and low computer self-efficacy groups. The findings were confirmed by issues from interview analyses between the groups

A Study of Metacognitive Skill as Influenced by Expressive Writing in College Introductory Algebra Classes.

The quality of mathematics education has become a major concern to mathematics educators. As a result, increased attention is being given to identifying the abilities that underlie competent performance. An outcome of this effort is an increasing belief that the development of metacognitive skills is an essential component of proficient mathematics performance. Writing, because it promotes reflective thinking, is believed to be the vehicle for this development. Writing in the mathematics classroom has previously received anecdotal support for its benefits to the learner and to the instructor, and limited quantitative benefits in problem-solving ability toward mathematics. This study examined the effect of expressive writing on self-awareness and would suggest quantitative support that writing is beneficial in promoting student ability to assess the correctness of work. If metacognitive skills are a necessary condition for successful mathematics performance, the use of writing may provide the process for attaining these essential skills. Further research in the benefits of writing is warranted by this study