A hybrid method for the analysis of learner behaviour in active learning environments

Software-mediated learning requires adjustments in the teaching and learning process. In particular active learning facilitated through interactive learning software differs from traditional instructor-oriented, classroom-based teaching. We present behaviour analysis techniques for Web-mediated learning. Motivation, acceptance of the learning approach and technology, learning organisation and actual tool usage are aspects of behaviour that require different analysis techniques to be used. A hybrid method based on a combination of survey methods and Web usage mining techniques can provide accurate and comprehensive analysis results. These techniques allow us to evaluate active learning approaches implemented in form of Web tutorials

Scoping a vision for formative e-assessment: a project report for JISC

Assessment is an integral part of teaching and learning. If the relationship between teaching and learning were causal, i. e. if students always mastered the intended learning outcomes of a particular sequence of instruction, assessment would be superfluous. Experience and research suggest this is not the case: what is learnt can often be quite different from what is taught. Formative assessment is motivated by a concern with the elicitation of relevant information about student understanding and / or achievement, its interpretation and an exploration of how it can lead to actions that result in better learning. In the context of a policy drive towards technology-enhanced approaches to teaching and learning, the question of the role of digital technologies is key and it is the latter on which this project particularly focuses. The project and its deliverables have been informed by recent and relevant literature, in particular recent work by Black andIn this work, they put forward a framework which suggests that assessment for learning their term for formative assessment can be conceptualised as consisting of a number of aspects and five keystrategies. The key aspects revolve around the where the learner is going, where the learner is right now and how she can get there and examines the role played by the teacher, peers and the learner. Language: English Keywords: assessments, case studies, design patterns, e-assessmen

Unravelling peer assessment: Methodological, functional, and conceptual developments

Peer assessment is an educational arrangement where students judge a peer’s performance quantitatively and/or qualitatively and which stimulates students to reflect, discuss and collaborate. However, empirical evidence for peer assessment effects on learning is scarce, mostly based on student self-reports or involving comparison of peers’ and teachers’ ratings or anecdotal evidence from case studies. Systematic investigation of learning effects necessitates methodological, functional, and conceptual development in peer assessment research. This implies sound (quasi-)experimental studies, the definition of specific peer assessment mechanisms, and affiliations with other research domains. The articles in this special issue address these three needs and offer new directions for research

Using an online formative assessment framework to enhance student engagement: a learning outcomes approach

Students learn best when they are fully engaged in the learning process, are motivated to test their current level of learning against known standards, and are offered targeted and timely support to help address subsequent personal learning needs. The most usual way to do this is through the use of assessment, but this in itself can act as an overbearing influence on what and how students learn, rather than providing an holistic support mechanism that encourages continuous reflective learning. Summative assessment provides a quantitative measure of learning at specific points in time, but may not encourage students to focus on specific strengths and weaknesses in need of attention. Formative assessment can provide specific reflective and feed-forward support, but given the time-poor nature of many students, is this perceived as a useful part of the learning process? This paper presents an overview of work in progress (funded by Centre for Open Learning in Maths, Science, Computing and Technology CETL at The Open University), on the development and implementation of an online interactive formative assessment framework, that has designed from a constructivist perspective, to promote student engagement and understanding of academic progression, using an learning outcomes approach. The framework specifically aims to enhance student awareness, understanding and recognition of competency levels, and to allow testing of ongoing academic progress at predetermined and self-selected points throughout the year. Each assessment makes explicit links to other components of the course including the summative assessment strategy, as a means of providing an integrated approach to learning. By working through the formative assessments it is hoped that students will become more self-directed and confident in their learning skills and abilities, which in turn should improve retention. The framework uses OpenMark (a web-based system developed within the Open University) in which students have up to three attempts to correctly answer each question, and are offered instantaneous and targeted feedback after each incorrect attempt. The system collects information on the answers submitted, and the time taken to complete each question, offering valuable insight into how (and which) students are engaging with the assessment and course materials. This data permits new targeted feedback to be added in response to common errors, as well as additional support mechanisms to be incorporated in response to specific skills or content that is poorly demonstrated. All feedback in the framework is formative, commenting on how well each of the learning outcomes tested over a period of study has been demonstrated, as well as the overall level of academic competency attained at that point in time. At present, the framework encompasses seven interactive assessments (linked to fortnightly periods of study), consisting of ten variable-format questions (set at two levels of academic complexity). A planned eighth assessment will randomly select questions from preceding assessments, offering an instantaneous interactive revision tool. Preliminary results indicate that students not only rate the assessments as enjoyable, but are revisiting specific assessments as a means of enhancing previous outcomes and checking their progression on aspects they previously had difficulties with

Accelerating the assessment agenda: thinking outside the black box

Over the last 10 years, learning and teaching in higher education have benefited from advances in social constructivist and situated learning research (Laurillard, 1993). In contrast, assessment has remained largely transmission orientated in both conception and in practice (see Knight & Yorke, 2003). This paper examines a number of recent developments, which exhibit innovation in electronic assessment developed at the UK's Open University. This paper argues for the development of new forms of e-assessment where the main driver is that of sound pedagogy rather than state of the art technological know-how and where open source products can move the field forward

Using design-based research to develop a Mobile Learning Framework for Assessment Feedback

Students’ lack of engagement with their assessment feedback and the lack of dialogue and communication for feedback are some of the issues that affect educational institutions. Despite the affordance that mobile technologies could bring in terms of assessment feedback, research in this area is scarce. The main obstacle for research on mobile learning assessment feedback is the lack of a cohesive and unified mobile learning framework. This paper thus presents a Mobile Learning Framework for Assessment Feedback (MLFAF), developed using a design-based research approach. The framework emerged from the observation of, and reflection upon, the different stages of a research project that investigated the use of a mobile web application for summative and formative assessment feedback. MLFAF can be used as a foundation to study the requirements when developing and implementing wide-scale mobile learning initiatives that underpin longitudinal practices, as opposed to short-term practices. The paper also provides design considerations and implementation guidelines for the use of mobile technology in assessment feedback to increase student engagement and foster dialogic feedback communication channels