Putting Pedagogy in the driving seat with Open Comment: an open source formative assessment feedback and guidance tool for History Students

One of the more challenging aspects in the current e-assessment milieu is to provide a set of electronic interactive tasks that will allow students more free text entry and provide immediate feedback to them. The specific objective of the project was to construct some simple tools in the form of Moodle extensions that allow a Moodle author to ask free-text response questions that can provide a degree of interactive formative feedback to students. In parallel with this was the aim to begin to develop a methodology for constructing such questions and their feedback effectively, together with techniques for constructing decision rules for giving feedback. Open Comment is a formative feedback technology designed to be integrated in the Moodle virtual learning environment. Put simply, it provides a simple system allowing questions to be written in Moodle, and for students' free text responses to these questions to be analysed and used to provide individually customised formative feedback

Ten Good Reasons to Adopt an Automated Formative Assessment Model for Learning and Teaching Mathematics and Scientific Disciplines

Abstract This paper will analyze an educational model for automated formative assessment developed at the Department of Mathematics of University of Turin for learning and teaching Mathematics and scientific disciplines. The model is provided through an automated grading system which, empowered by the engine of an advanced computing environment, allows the creation of algorithmic variables and open mathematical answers, recognized in all their equivalent forms. The adoption of automated formative assessment brings many advantages to learning. Easily available assignments, immediate feedback, adaptivity, the chance of learning from mistakes turn assessment into a fundamental enhancement in education; the intrinsic "rigidity" of technology can also have positive results on students' path to knowledge. Automated assessment brings innovation into teaching: time saved in grading can be used to improve materials and activities, teachers easily get information about students' learning, they need to change their approach and to attend trainings; sharing and collaboration among teachers are facilitated. Results obtained by the application of automated formative assessment in several class experiences are discussed and data about emerged satisfaction and criticisms are shown

MILO: Models of innovation in learning online at Key Stage 3 and 14-19: Final report

The report presents and analyses eight case studies, which reflect a wide range of models of online learning, each of which has been developed for specific reasons, largely in relation to visions of how technology can transform learning, but also to solve practical problems such as re-engaging disaffected learners and coping with rising pupil numbers

Semi-automated assessment of programming languages for novice programmers

There has recently been an increased emphasis on the importance of learning programming languages, not only in higher education but also in secondary schools. Students of a variety of departments such as physics, mathematics and engineering have also started learning programming languages as part of their academic courses. Assessment of students programming solutions is therefore important for developing their programming skills. Many Computer Based Assessment (CBA) systems utilise multiple-choice questions (MCQ) to evaluate students performance. However, MCQs lack the ability to comprehensively assess students knowledge. Thus, other forms of programming solutions are required to assess students knowledge. This research aims to develop a semi-automated assessment framework for novice programmers, utilising a computer to support the marking process. The research also focuses on ensuring the consistency of feedback. A novel marking process model is developed based on the semi-automated assessment approach which supports a new way of marking, termed segmented marking . A study is carried out to investigate and demonstrate the feasibility of the segmented marking technique. In addition, the new marking process model is developed based on the results of the feasibility study, and two novel marking process models are presented based on segmented marking, namely the full-marking and partial-marking process models. The Case-Based Reasoning (CBR) cycle is adopted in the marking process models in order to ensure the consistency of feedback. User interfaces of the prototype marking tools (full and partial) are designed and developed based on the marking process models and the user interface design requirements. The experimental results show that the full and partial marking techniques are feasible for use in formative assessment. Furthermore, the results also highlight that the tools are capable of providing consistent and personalised feedback and that they considerably reduce markers workload

The Impact of Formative Assessment Cycles on Students\u27 Attitudes and Achievement in a Large-Enrollment Undergraduate Introductory Statistics Course

This study aimed to investigate the impact of student attitudes toward statistics and student achievement after engaging in large-enrollment introductory statistics course curriculum using continuous formative assessments with feedback and reassessment opportunities. This framework, called Formative Assessment Cycles (FACs) was implanted, providing students formative assessments both in and out of the classroom, with feedback and reassessment. A quasi-experimental, quantitative research design allowed for the investigation of course achievement from pre-FACs to FACs semesters using regression discontinuity methodology. Changes in attitudes from pre- to post-survey in semesters using a curriculum with FACs were analyzed by multilevel regression techniques. Course achievement improved in the co-requisite introductory statistics course using FACs for those who have less mathematical knowledge, suggesting the need for co-requisite courses and formative feedback and reassessment to provide students successful pathways to achieve their quantitative literacy requirement. Additionally, students with higher course achievement had significantly better attitudes towards statistics than their peers with lower final course grades. These students experienced more appreciation for the course and the science of statistics in their field of study, improved feelings of competence to do statistical calculations, and believed the course was less confusing and easier than they first believed at pre-survey. These attitudes exhibited in this study were higher than previous studies on students’ attitudes toward statistics, suggesting that students who have opportunities to learn from their mistakes enjoy their introductory statistics class better and feel empowered by their newfound understanding

Supporting graduate teaching assistants in two STEM areas

No abstract available

Developing e-assessment using the quiz activity within Moodle: empowering student learning

Using formative assessment within Moodle has been shown to encourage self-directed learning (Bromham & Oprandi, 2006). Our experience of using formative assessment quizzes as stand alone entities, as well as within Moodle lessons, has been used to introduce Moodle assessment quizzes over the past year in Level 1 and Level 2 Life Sciences courses. This experience has been distilled to inform the content of this workshop. Some advantages of incorporating assessments in the form of Moodle quizzes are that they allow for quick, reproducible and flexible assessment with a relatively small initial set-up cost, and substantial long-term staff and administration savings. One significant advantage is that staff and room pressures can be reduced as students can attempt the assessment at a time and location of their choice within a specified time period. This flexibility can help to reduce student stress associated with completion of a continuous assessment for their course. It is also a relatively simple process to account for students entitled to extra time during assessments. Providing clear instructions beforehand and at the start of the quiz ensures that students understand their responsibilities for completion of this assessment and ultimately the course. There are some disadvantages and limitations to the system as it currently exists, for example there is the perceived ability for students to “cheat” by completing the assessment as a group, accessing books and the internet. Strategies to account for these can be put in place and will be discussed in detail during the workshop. This workshop aims to take the participants through the initial set up of a quiz, highlighting the various question types and how these can be used to create a challenging assessment that can be quickly graded and prove informative for staff and course development. Reference Bromham L. & Oprandi P. (2006) Evolution online: developing active and blended learning by using a virtual learning environment in an introductory biology course. Journal of Biological Education 41 (1): 21-25

Expansive Framing as Pragmatic Theory for Online and Hybrid Instructional Design

This article explores the complex question of how instruction should be framed (i.e., contextualized). Reports from the US National Research Council reveal a broad consensus among experts that most instruction should be framed with problems, examples, cases, and illustrations. Such framing is assumed to help learners connect new knowledge to broader “real world” knowledge, motivate continued engagement, and ensure that learners can transfer their new knowledge to subsequent contexts. However, different theories of learning lead to different assumptions about when such frames should be introduced and how such frames should be created. This article shows how contemporary situative theories of learning argue that frames should be (a) introduced before instructional content, (b) generated by learners themselves, (c) used to make connections with people, places, topics, and times beyond the boundaries of the course, and (d) used to position learners as authors who hold themselves and their peers accountable for their participation in disciplinary discourse. This expansive approach to framing promises to support engagement with disciplinary content that is productive (i.e., increasingly sophisticated, raising new questions, recognizing confusion, making new connections, etc.) and generative (i.e., supporting transferable learning that is likely to be useful and used in a wide range of subsequent educational, professional, achievement, and personal contexts). A framework called Participatory Learning and Assessment (PLA) is presented that embeds expansively framed engagement within multiple levels of increasing formal assessments. This paper first summarizes PLA as theory-laden design principles. It then presents PLA as fourteen more prescriptive steps that some may find easier to implement and to learn as they go. Examples are presented from several courses from an extended program of design-based research using this approach in online and hybrid secondary, undergraduate, graduate, and technical courses.Indiana University Office of the Vice Provost of Information Technolog