Layered evaluation of interactive adaptive systems : framework and formative methods

Peer reviewedPostprin

Examining the designs of computer-based assessment and its impact on student engagement, satisfaction, and pass rates

Many researchers who study the impact of computer-based assessment (CBA) focus on the affordances or complexities of CBA approaches in comparison to traditional assessment methods. This study examines how CBA approaches were configured within and between modules, and the impact of assessment design on students’ engagement, satisfaction, and pass rates. The analysis was conducted using a combination of longitudinal visualisations, correlational analysis, and fixed-effect models on 74 undergraduate modules and their 72,377 students. Our findings indicate that educators designed very different assessment strategies, which significantly influenced student engagement as measured by time spent in the virtual learning environment (VLE). Weekly analyses indicated that assessment activities were balanced with other learning activities, which suggests that educators tended to aim for a consistent workload when designing assessment strategies. Since most of the assessments were computer-based, students spent more time on the VLE during assessment weeks. By controlling for heterogeneity within and between modules, learning design could explain up to 69% of the variability in students’ time spent on the VLE. Furthermore, assessment activities were significantly related to pass rates, but no clear relation with satisfaction was found. Our findings highlight the importance of CBA and learning design to how students learn online

Review of research and evaluation on improving adult literacy and numeracy skills

The purposes of this literature review are threefold. First, this review summarises findings of the research from the last decade in six fields identified by the Department for Business, Innovation and Skills (BIS) as critical to its forward planning: (1) the economic, personal and social returns to learning; (2) the quality and effectiveness of provision; (3) the number of learning hours needed for skills gain; (4) learner persistence; (5) the retention and loss of skills over time; (6) the literacy and numeracy skills that are needed. Second, this review assesses this evidence base in terms of its quality and robustness, identifying gaps and recommending ways in which the evidence base can be extended and improved. Thirdly, this review attempts to interpret the evidence base to suggest, where possible, how returns to ALN learning for individuals, employers and wider society might be increased through effective and cost-effective interventions

Factors that Influence Empowerment in Adjunct Faculty Members

To offset the cost and meet the demand for high quality nursing graduates, adjunct faculty members are hired to educate students in the practice settings. Adjunct faculty may not have access to the resources allocated to full-time faculty and may not feel empowered to provide the most effective educational experiences for the students. The purpose of this quantitative study was to measure factors that influence empowerment in adjunct faculty members teaching in an associate degree nursing program at a community college located in the Midwestern United States. The study also examined whether there is a difference in the empowerment of novice faculty, defined as instructors who were employed 2 years or less at this institution, and expert faculty who were classified based on their employment 3 years or more. Kanter\u27s theory of structural empowerment and Knowles\u27s principles of adult learning provided the theoretical base for the study. The Conditions of Work Effectiveness Questionnaire-II, which was designed to measure 4 empowerment factors of the workplace, was administered to a convenience sample of 53 adjunct faculty members (20 novice and 33 expert faculty). The Mann-Whitney U test found no significant difference in total survey scores between novice and expert adjunct faculty members. The mean subscale scores identified that limited access to information and support were the 2 factors most influencing empowerment in this sample. Based on the results, a faculty development/mentoring program was developed to provide the adjunct faculty with the resources needed for empowerment. Future research on other factors associated with faculty effectiveness should be explored. Social change can occur by empowering the adjunct faculty members, thereby improving the quality of education afforded to nursing students in this associate degree nursing program

Engaging and empowering first-year students through curriculum design: perspectives from the literature

There is an increasing value being placed on engaging and empowering first-year students and first-year curriculum design is a key driver and opportunity to ensure early enculturation into successful learning at university. This paper summarises the literature on first-year curriculum design linked to student engagement and empowerment. We present conceptualisations of ‘curriculum’ and examples from first-year curriculum design. We also note the limited literature where students have been involved in designing first-year curricula. The results of the literature review suggest that key characteristics of engaging first-year curricula include active learning, timely feedback, relevance and challenge. The literature also points to the importance of identifying students' abilities on entry to university as well as being clear about desired graduate attributes and developmental goals. Acknowledging realities and constraints, we present a framework for the first-year curriculum design process based on the literature

Personalised Learning: Developing a Vygotskian Framework for E-learning

Personalisation has emerged as a central feature of recent educational strategies in the UK and abroad. At the heart of this is a vision to empower learners to take more ownership of their learning and develop autonomy. While the introduction of digital technologies is not enough to effect this change, embedding the affordances of new technologies is expected to offer new routes for creating personalised learning environments. The approach is not unique to education, with consumer technologies offering a 'personalised' relationship which is both engaging and dynamic, however the challenge remains for learning providers to capture and transpose this to educational contexts. As learners begin to utilise a range of tools to pursue communicative and collaborative actions, the first part of this paper will use analysis of activity logs to uncover interesting trends for maturing e-learning platforms across over 100 UK learning providers. While personalisation appeals to marketing theories this paper will argue that if learning is to become personalised one must ask what the optimal instruction for any particular learner is? For Vygotsky this is based in the zone of proximal development, a way of understanding the causal-dynamics of development that allow appropriate pedagogical interventions. The second part of this paper will interpret personalised learning as the organising principle for a sense-making framework for e-learning. In this approach personalised learning provides the context for assessing the capabilities of e-learning using Vygotsky’s zone of proximal development as the framework for assessing learner potential and development