Teaching and learning in information retrieval

A literature review of pedagogical methods for teaching and learning information retrieval is presented. From the analysis of the literature a taxonomy was built and it is used to structure the paper. Information Retrieval (IR) is presented from different points of view: technical levels, educational goals, teaching and learning methods, assessment and curricula. The review is organized around two levels of abstraction which form a taxonomy that deals with the different aspects of pedagogy as applied to information retrieval. The first level looks at the technical level of delivering information retrieval concepts, and at the educational goals as articulated by the two main subject domains where IR is delivered: computer science (CS) and library and information science (LIS). The second level focuses on pedagogical issues, such as teaching and learning methods, delivery modes (classroom, online or e-learning), use of IR systems for teaching, assessment and feedback, and curricula design. The survey, and its bibliography, provides an overview of the pedagogical research carried out in the field of IR. It also provides a guide for educators on approaches that can be applied to improving the student learning experiences

A review of ten years of implementation and research in aligning learning design with learning analytics at the Open University UK

There is an increased recognition that learning design drives both student learning experience and quality enhancements of teaching and learning. The Open University UK (OU) has been one of few institutions that have explicitly and systematically captured the designs for learning at a large scale. By applying advanced analytical techniques on large and fine-grained datasets, the OU has been unpacking the complexity of instructional practices, as well as providing conceptual and empirical evidence of how learning design influences student behaviour, satisfaction, and performance. This study discusses the implementation of learning design at the OU in the last ten years, and critically reviews empirical evidence from eight recent large-scale studies that have linked learning design with learning analytics. Four future research themes are identified to support future adoptions of learning design approaches

Learning Design for Student Retention

Student retention is an issue of increasing interest to higher education institutions, educators and students. Much of the work in this area focuses on identifying and improving interventions that occur during the presentation of a course. This paper suggests that these represent only one set of factors that can influence student withdrawal, and equally important are design based factors that can aid retention throughout the course. The main research question addressed by the paper is what design-related factors impact on student retention. An analysis of student withdrawal at the UK Open University conducted by the researchers produced a synthesis of seven key factors in the design phase that can influence retention. These factors have been given the ICEBERG acronym: Integrated, Collaborative, Engaging, Balanced, Economical, Reflective and Gradual. Examples of how these factors can be implemented are provided, and conclusions focus on how the model has been embedded in the module production process at the Open University

Quality in MOOCs: Surveying the Terrain

The purpose of this review is to identify quality measures and to highlight some of the tensions surrounding notions of quality, as well as the need for new ways of thinking about and approaching quality in MOOCs. It draws on the literature on both MOOCs and quality in education more generally in order to provide a framework for thinking about quality and the different variables and questions that must be considered when conceptualising quality in MOOCs. The review adopts a relativist approach, positioning quality as a measure for a specific purpose. The review draws upon Biggs’s (1993) 3P model to explore notions and dimensions of quality in relation to MOOCs — presage, process and product variables — which correspond to an input–environment–output model. The review brings together literature examining how quality should be interpreted and assessed in MOOCs at a more general and theoretical level, as well as empirical research studies that explore how these ideas about quality can be operationalised, including the measures and instruments that can be employed. What emerges from the literature are the complexities involved in interpreting and measuring quality in MOOCs and the importance of both context and perspective to discussions of quality

Using evaluation to inform the development of a user-focused assessment engine

This paper reports on the evaluation of a new assessment system, Technologies for Online Interoperability (TOIA). TOIA was built from a user-focussed specification of an assessment system. The formative evaluation of the project complemented this initial specification by ensuring that user feedback on the development and use of the system was iteratively fed back into the development process. The paper begins by summarising some of the key barriers and enablers to the use of assessment systems and the uptake of Computer-Assisted Assessment (CAA). It goes on to provide a critique of the impact of technology on assessment and considers whether innovative uses of information and communication technology (ICT) might result in new e-pedagogies and practices in assessment. The paper then reports on the findings of the TOIA evaluation and discusses how these were used to inform the development of the system

Introductory programming: a systematic literature review

As computing becomes a mainstream discipline embedded in the school curriculum and acts as an enabler for an increasing range of academic disciplines in higher education, the literature on introductory programming is growing. Although there have been several reviews that focus on specific aspects of introductory programming, there has been no broad overview of the literature exploring recent trends across the breadth of introductory programming. This paper is the report of an ITiCSE working group that conducted a systematic review in order to gain an overview of the introductory programming literature. Partitioning the literature into papers addressing the student, teaching, the curriculum, and assessment, we explore trends, highlight advances in knowledge over the past 15 years, and indicate possible directions for future research

Maximising the potential of ICT to provide authentic summative assessment opportunities

This paper reports on elements of a study that was conducted in Western Australia to explore the potential of various forms of digitally based external assessments for senior secondary school courses. One problem that needed addressing was how to provide students with authentic assessment opportunities, particularly in subjects in which performance is an integral component. Traditionally, assessment in many of these subjects was by way of a three-hour paper examination. This established a dichotomy for teachers in which the pedagogy of the subject was very different from the method of assessment. In wanting to maximise their student’s potential for success, many teachers taught to the examination, consequently sacrificing a practical performance approach to the subject for a more theoretical form of delivery

On-line assessment for e-learning: options and opportunities

The desire to produce educational multi-media packages of ever greater sophistication is such that other, more problematic, elements of e- or on- line learning receive less attention by academics and courseware developers alike. One such problematic area is that of assessment, which is surprising, as e-learning assessment procedures are more critical in defining the learning that takes place. However, because e-learning can create a much richer, more varied active learning experience than would normally occur via the passive didactic teaching mode currently utilised in most universities and centred on the use of the lecture, it also has the potential to provide new and innovative assessments modes and systems. The extent to which the potential of innovatory assessment is realised via e-learning depends on two factors. First, the level of computer component and interactivity utilised in elearning. Second, the attitude of academic staff towards their teaching role, and, more specifically, how they operate within an elearning environment. The speed of the development in online technologies and techniques is such that the information given here will not provide all the answers, it should, nevertheless, enable some of the correct questions to be pose