Using reflective self-assessments in a learning management system to promote student engagement and academic success

Conference ProceedingLearning management systems have the capabilities of creating, fostering, delivering, and facilitating learning at anytime and anywhere, allowing students to engage in online discussion and collaborative activities. However, many researchers feel that the online space essentially remains a repository for content. However, the fact that some academics use such systems as a content dumping site cannot be generalized. No, such a blanket statement would be a grave injustice to those few academics that are trying to improve the teaching and learning process, especially through reflective practice. The purpose of this paper is to highlight how an academic in electrical engineering has effectively used BlackboardTM to promote student engagement and academic success through online reflective self-assessments. An ex-post facto study is used with descriptive statistics of the quantitative data. Two groups of students enrolled for different electronic communication modules were asked to complete biweekly online reflective self-assessments via BlackboardTM. Results indicate that those who completed more than 50% of these self-assessments were almost twice as likely to achieve academic success as compared to those who completed less than 50% of them. These results tend to suggest that some academics are using educational technology more effectively than other academics, to the benefit of students and higher educational institutions

Using an online formative assessment framework to enhance student engagement: a learning outcomes approach

Students learn best when they are fully engaged in the learning process, are motivated to test their current level of learning against known standards, and are offered targeted and timely support to help address subsequent personal learning needs. The most usual way to do this is through the use of assessment, but this in itself can act as an overbearing influence on what and how students learn, rather than providing an holistic support mechanism that encourages continuous reflective learning. Summative assessment provides a quantitative measure of learning at specific points in time, but may not encourage students to focus on specific strengths and weaknesses in need of attention. Formative assessment can provide specific reflective and feed-forward support, but given the time-poor nature of many students, is this perceived as a useful part of the learning process? This paper presents an overview of work in progress (funded by Centre for Open Learning in Maths, Science, Computing and Technology CETL at The Open University), on the development and implementation of an online interactive formative assessment framework, that has designed from a constructivist perspective, to promote student engagement and understanding of academic progression, using an learning outcomes approach. The framework specifically aims to enhance student awareness, understanding and recognition of competency levels, and to allow testing of ongoing academic progress at predetermined and self-selected points throughout the year. Each assessment makes explicit links to other components of the course including the summative assessment strategy, as a means of providing an integrated approach to learning. By working through the formative assessments it is hoped that students will become more self-directed and confident in their learning skills and abilities, which in turn should improve retention. The framework uses OpenMark (a web-based system developed within the Open University) in which students have up to three attempts to correctly answer each question, and are offered instantaneous and targeted feedback after each incorrect attempt. The system collects information on the answers submitted, and the time taken to complete each question, offering valuable insight into how (and which) students are engaging with the assessment and course materials. This data permits new targeted feedback to be added in response to common errors, as well as additional support mechanisms to be incorporated in response to specific skills or content that is poorly demonstrated. All feedback in the framework is formative, commenting on how well each of the learning outcomes tested over a period of study has been demonstrated, as well as the overall level of academic competency attained at that point in time. At present, the framework encompasses seven interactive assessments (linked to fortnightly periods of study), consisting of ten variable-format questions (set at two levels of academic complexity). A planned eighth assessment will randomly select questions from preceding assessments, offering an instantaneous interactive revision tool. Preliminary results indicate that students not only rate the assessments as enjoyable, but are revisiting specific assessments as a means of enhancing previous outcomes and checking their progression on aspects they previously had difficulties with

A new framework for the design and evaluation of a learning institution’s student engagement activities

In this article we explore the potential for attempts to encourage student engagement to be conceptualised as behaviour change activity, and specifically whether a new framework to guide such activity has potential value for the Higher Education (HE) sector. The Behaviour Change Wheel (BCW) (Michie, Susan, Maartje M van Stralen, and Robert West. 2011. “The Behaviour Change Wheel: A New Method for Characterising and Designing Behaviour Change Interventions.” Implementation Science : IS 6 (1): 42. doi:10.1186/1748-5908-6-42) is a framework for the systematic design and development of behaviour change interventions. It has yet to be applied to the domain of student engagement. This article explores its potential, by assessing whether the BCW comprehensively aligns with the state of student engagement as currently presented in the HE literature. This work achieves two things. It firstly allows a prima facie assessment of whether student engagement activity can be readily aligned with the BCW framework. It also highlights omissions and prevalence of activity types in the HE sector, compared with other sectors where behaviour change practice is being successfully applied

Developing e-assessment using the quiz activity within Moodle: empowering student learning

Using formative assessment within Moodle has been shown to encourage self-directed learning (Bromham & Oprandi, 2006). Our experience of using formative assessment quizzes as stand alone entities, as well as within Moodle lessons, has been used to introduce Moodle assessment quizzes over the past year in Level 1 and Level 2 Life Sciences courses. This experience has been distilled to inform the content of this workshop. Some advantages of incorporating assessments in the form of Moodle quizzes are that they allow for quick, reproducible and flexible assessment with a relatively small initial set-up cost, and substantial long-term staff and administration savings. One significant advantage is that staff and room pressures can be reduced as students can attempt the assessment at a time and location of their choice within a specified time period. This flexibility can help to reduce student stress associated with completion of a continuous assessment for their course. It is also a relatively simple process to account for students entitled to extra time during assessments. Providing clear instructions beforehand and at the start of the quiz ensures that students understand their responsibilities for completion of this assessment and ultimately the course. There are some disadvantages and limitations to the system as it currently exists, for example there is the perceived ability for students to “cheat” by completing the assessment as a group, accessing books and the internet. Strategies to account for these can be put in place and will be discussed in detail during the workshop. This workshop aims to take the participants through the initial set up of a quiz, highlighting the various question types and how these can be used to create a challenging assessment that can be quickly graded and prove informative for staff and course development. Reference Bromham L. & Oprandi P. (2006) Evolution online: developing active and blended learning by using a virtual learning environment in an introductory biology course. Journal of Biological Education 41 (1): 21-25

Supporting graduate teaching assistants in two STEM areas

No abstract available

The First-Year Gateway Experience: A Groundbreaking Model

Based on calls for a paradigm shift in higher education, which have appeared in the literature for years (Barr &Tagg, 1995; Tagg, 2003, Bryant University transformed its first-year experience into an innovative model, The First-Year Gateway). Informed by research from The Carnegie Foundation for the Advancement of Teaching’s Rethinking Undergraduate Business Education, the Association of American Colleges & Universities’ Liberal Education for America’s Promise, and the Wabash National Study, a group identified five learning outcomes: effective communication, critical thinking, ethical reasoning, diversity awareness, and information literacy. Key to this undertaking was faculty development, and utilizing assessment data to improve curricular design and learning outcomes. The result is an interdisciplinary 13 credit first-year program developed to foster a successful transition into Bryant University. Launched in fall 2012, assessment data was gathered to determine whether common learning outcomes were achieved. Faculty embedded student success goals into their courses, which are designed to foster purposeful adjustment to higher education. Preliminary assessment indicates institutional gains in retention, academic standing, and student and faculty engagement during the implementation year. The new model, based on Wenger’s community of practice (COP), created opportunities to discuss pedagogy. Most importantly, the model fostered faculty’s deeper understanding of first-year transitions