Squaring the circle: a new alternative to alternative-assessment

Many quality assurance systems rely on high-stakes assessment for course certification. Such methods are not as objective as they might appear; they can have detrimental effects on student motivation and may lack relevance to the needs of degree courses increasingly oriented to vocational utility. Alternative assessment methods can show greater formative and motivational value for students but are not well suited to the demands of course certification. The widespread use of virtual learning environments and electronic portfolios generates substantial learner activity data to enable new ways of monitoring and assessing students through Learning Analytics. These emerging practices have the potential to square the circle by generating objective, summative reports for course certification while at the same time providing formative assessment to personalise the student experience. This paper introduces conceptual models of assessment to explore how traditional reliance on numbers and grades might be displaced by new forms of evidence-intensive student profiling and engagement

Assessing Online Collaborative Discourse

This qualitative study using transcript analysis was undertaken to clarify the value of Harasim’s Online Collaborative Learning Theory as a way to assess the collaborative process within nursing education. The theory incorporated three phases: (1) idea generating; (2) idea organizing; and (3) intellectual convergence. The transcripts of asynchronous discussions from a two-week module about disaster nursing using a virtual community were analyzed and formed the data for this study. This study supports the use of Online Collaborative Learning Theory as a framework for assessing online collaborative discourse. Individual or group outcomes were required for the students to move through all three phases of the theory. The phases of the Online Collaborative Learning Theory could be used to evaluate the student’s ability to collaborate. It is recommended that group process skills, which have more to do with interpersonal skills, be evaluated separately from collaborative learning, which has more to do with cognitive skills. Both are required for practicing nurses. When evaluated separately, the student learning needs are more clearly delineated

Non‐hierarchical learning: sharing knowledge, power and outcomes

Arguing that every student has the capacity to succeed and that every student must be provided with the opportunity to reach their full potential, this article introduces a new pedagogic approach that draws on a wide range of influences. Linking theoretical practices from sociology, pedagogy, social and educational psychology, and cultural studies, the approach posits that teaching and learning should be conducted in non‐hierarchical classrooms where all members are equal and working towards shared objectives. A theoretical frame is outlined and the factors that helped shape it are reflected on. A conceptual framework which covers the goals of instruction, instructional materials, classroom management, instructional methods, and assessment is also presented. It is hoped that educators will consider the concepts included in this article and, if possible, incorporate them into their teaching practices

Service-oriented flexible and interoperable assessment: towards a standardised e-assessment system

Free-text answers assessment has been a field of interest during the last 50 years. Several free-text answers assessment tools underpinned by different techniques have been developed. In most cases, the complexity of the underpinned techniques has caused those tools to be designed and developed as stand-alone tools. The rationales behind using computers to assist learning assessment are mainly to save time and cost, as well as to reduce staff workload. However, utilising free-text answers assessment tools separately form the learning environment may increase the staff workload and increase the complexity of the assessment process. Therefore, free-text answers scorers have to have a flexible design to be integrated within the context of the e-assessment system architectures taking advantages of software-as-a-service architecture. Moreover, flexible and interoperable e-assessment architecture has to be utilised in order to facilitate this integration. This paper discusses the importance of flexible and interoperable e-assessment. Moreover, it proposes a service-oriented flexible and interoperable architecture for futuristic e-assessment systems. Nevertheless, it shows how such architecture can foster the e-assessment process in general and the free-text answers assessment in particular

‘Economics with training wheels’: Using blogs in teaching and assessing introductory economics

Blogs provide a dynamic interactive medium for online discussion, consistent with communal constructivist pedagogy. This paper explores the use of blogs in the teaching and assessment of a small (40-60 students) introductory economics paper. The role of blogs as a teaching, learning and assessment tool are discussed. Using qualitative and quantitative data collected across four semesters, students’ participation in the blog assessment is found to be associated with student ability, gender, and whether they are distance learners. Importantly, students with past economics experience do not appear to crowd out novice economics students. Student performance in tests and examinations does not appear to be associated with blog participation after controlling for student ability. However, students generally report overall positive experiences with the blog assessment

Exploring Feedback and Gamification in a Data Modeling Learning Tool

Data modeling is an essential part of IT studies. Learning how to design and structure a database is important when storing data in a relational database and is common practice in the IT industry. Most students need much practice and tutoring to master the skill of data modeling and database design. When a student is in a learning process, feedback is important. As class sizes grow and teaching is no longer campus based only, providing feedback to each individual student may be difficult. Our study proposes a tool to use when introducing database modeling to students. We have developed a web-based tool named LearnER to teach basic data modeling skills, in a collaborative project between the University of South-Eastern Norway (USN) and Kristiania University College (KUC). The tool has been used in six different courses over a period of four academic years. In LearnER, the student solves modeling assignments with different levels of difficulty. When they are done, or they need help, they receive automated feedback including visual cues. To increase the motivation for solving many assignments, LearnER also includes gamifying elements. Each assignment has a maximum score. When students ask for help, points are deducted from the score. When students manage to solve many assignments with little help, they may end up at a leaderboard. This paper tries to summarize how the students use and experience LearnER. We look to see if the students find the exercises interesting, useful and of reasonable difficulty. Further, we investigate if the automated feedback is valuable, and if the gamifying elements contribute to their learning. As we have made additions and refinements to LearnER over several years, we also compare student responses on surveys and interviews during these years. In addition, we analyze usage data extracted from the application to learn more about student activity. The results are promising. We find that student activity increases in newer versions of LearnER. Most students report that the received feedback helps them to correct mistakes when solving modeling assignments. The gamifying elements are also well received. Based on LearnER usage data, we find and describe typical errors the students do and what types of assignments they prefer to solve.publishedVersio

Exploring the landscape of reflection

open4noopenFrison, Daniela; Fedeli, Monica; Tino, Concetta; Minnoni, ErikaFrison, Daniela; Fedeli, Monica; Tino, Concetta; Minnoni, Erik

Teachers' Perspectives on Second Language Task Difficulty: Insights From Think-Alouds and Eye Tracking

The majority of empirical studies that have so far investigated task features in order to inform task grading and sequencing decisions have been grounded in hypothesis-testing research. Few studies have attempted to adopt a bottom-up approach in order to explore what task factors might contribute to task difficulty. The aim of this study was to help fill this gap by eliciting teachers’ perspectives on sources of task difficulty. We asked 16 English as a second language (ESL) teachers to judge the linguistic ability required to carry out four pedagogic tasks and consider how they would manipulate the tasks to suit the abilities of learners at lower and higher proficiency. While contemplating the tasks, the teachers thought aloud, and we also tracked their eye movements. The majority of teachers’ think-aloud comments revealed that they were primarily concerned with linguistic factors when assessing task difficulty. Conceptual demands were most frequently proposed as a way to increase task difficulty, whereas both linguistic and conceptual factors were suggested by teachers when considering modifications to decrease task difficulty. The eye-movement data, overall, were aligned with the teachers’ think-aloud comments. These findings are discussed with respect to existing task taxonomies and future research directions

Quality in MOOCs: Surveying the Terrain

The purpose of this review is to identify quality measures and to highlight some of the tensions surrounding notions of quality, as well as the need for new ways of thinking about and approaching quality in MOOCs. It draws on the literature on both MOOCs and quality in education more generally in order to provide a framework for thinking about quality and the different variables and questions that must be considered when conceptualising quality in MOOCs. The review adopts a relativist approach, positioning quality as a measure for a specific purpose. The review draws upon Biggs’s (1993) 3P model to explore notions and dimensions of quality in relation to MOOCs — presage, process and product variables — which correspond to an input–environment–output model. The review brings together literature examining how quality should be interpreted and assessed in MOOCs at a more general and theoretical level, as well as empirical research studies that explore how these ideas about quality can be operationalised, including the measures and instruments that can be employed. What emerges from the literature are the complexities involved in interpreting and measuring quality in MOOCs and the importance of both context and perspective to discussions of quality