An evaluation of pedagogically informed parameterised questions for self assessment

Self-assessment is a crucial component of learning. Learners can learn by asking themselves questions and attempting to answer them. However, creating effective questions is time-consuming because it may require considerable resources and the skill of critical thinking. Questions need careful construction to accurately represent the intended learning outcome and the subject matter involved. There are very few systems currently available which generate questions automatically, and these are confined to specific domains. This paper presents a system for automatically generating questions from a competency framework, based on a sound pedagogical and technological approach. This makes it possible to guide learners in developing questions for themselves, and to provide authoring templates which speed the creation of new questions for self-assessment. This novel design and implementation involves an ontological database that represents the intended learning outcome to be assessed across a number of dimensions, including level of cognitive ability and subject matter. The system generates a list of all the questions that are possible from a given learning outcome, which may then be used to test for understanding, and so could determine the degree to which learners actually acquire the desired knowledge. The way in which the system has been designed and evaluated is discussed, along with its educational benefits

Pulling all the pedagogic pieces together to provide good electronic feedback: an example from science education

The aim of Nefreduca project was to develop digital science materials for chronically ill children and to assist them to cope more rationally with their illness. The Nefreduca system was developed in 2 stages.The first was a teaching-learning sequence about nutrition and kidney function, which was tested with the students and their teachers from the hospital school. The second phase was the construction of an automatic feedback system for Nefreduca. This paper reports the findings from both phases and makes the case that good feedback models must build upon on a good learning design that addresses students' misconceptions and introduces well structured e-activitie

Proceedings of QG2010: The Third Workshop on Question Generation

These are the peer-reviewed proceedings of "QG2010, The Third Workshop on Question Generation". The workshop included a special track for "QGSTEC2010: The First Question Generation Shared Task and Evaluation Challenge". QG2010 was held as part of The Tenth International Conference on Intelligent Tutoring Systems (ITS2010)

A new framework for the design and evaluation of a learning institution’s student engagement activities

In this article we explore the potential for attempts to encourage student engagement to be conceptualised as behaviour change activity, and specifically whether a new framework to guide such activity has potential value for the Higher Education (HE) sector. The Behaviour Change Wheel (BCW) (Michie, Susan, Maartje M van Stralen, and Robert West. 2011. “The Behaviour Change Wheel: A New Method for Characterising and Designing Behaviour Change Interventions.” Implementation Science : IS 6 (1): 42. doi:10.1186/1748-5908-6-42) is a framework for the systematic design and development of behaviour change interventions. It has yet to be applied to the domain of student engagement. This article explores its potential, by assessing whether the BCW comprehensively aligns with the state of student engagement as currently presented in the HE literature. This work achieves two things. It firstly allows a prima facie assessment of whether student engagement activity can be readily aligned with the BCW framework. It also highlights omissions and prevalence of activity types in the HE sector, compared with other sectors where behaviour change practice is being successfully applied

Investigating the feasibility of a distributed, mapping-based, approach to solving subject interoperability problems in a multi-scheme, cross-service, retrieval environment

The HILT project is researching the problems of facilitating interoperability of subject descriptions in a distributed multi-scheme environment. HILT Phase I found a UK community consensus in favour of utilising an inter-scheme mapping service to improve interoperability. HILT Phase II investigated the approach by building a pilot server, and identified a range of issues that would have to be tackled if an operational service was to be successful. HILT Phase III will implement a centralised version of an M2M pilot, but will aim to design it so that the possibility of a move to a distributed service remains open. This aim will impact on likely future research concerns in Phase III and beyond. Wide adoption of a distributed approach to the problem could lead to the creation of a framework within which regional, national, and international efforts in the area can be harmonised and co-ordinated

Reading at risk: why effective literacy practice is not effective.

The gap between high and low achievers in reading is wide in New Zealand compared to other countries as shown in PIRLS (Progress in International Reading Literacy Study) 2001 and 2006 studies. Students of minority backgrounds and low socio-economic status are over-represented in the low achieving category. As the primary response to reduce the achievement gap, the Government developed and distributed the literacy teaching reference Effective Literacy Practice in Years 1 to 4. This article examines Effective Literacy Practice against current scientificbased international research in the teaching of reading, with particular emphasis on the teaching of reading to students at risk. Research evidence shows that an explicit and systematic approach to teaching reading is critical to the success of reading achievement with at-risk students. With a heavy leaning towards incidental learning, Effective Literacy Practice fails to provide teachers with the necessary knowledge to effectively teach the critical components of reading

A lightweight web video model with content and context descriptions for integration with linked data

The rapid increase of video data on the Web has warranted an urgent need for effective representation, management and retrieval of web videos. Recently, many studies have been carried out for ontological representation of videos, either using domain dependent or generic schemas such as MPEG-7, MPEG-4, and COMM. In spite of their extensive coverage and sound theoretical grounding, they are yet to be widely used by users. Two main possible reasons are the complexities involved and a lack of tool support. We propose a lightweight video content model for content-context description and integration. The uniqueness of the model is that it tries to model the emerging social context to describe and interpret the video. Our approach is grounded on exploiting easily extractable evolving contextual metadata and on the availability of existing data on the Web. This enables representational homogeneity and a firm basis for information integration among semantically-enabled data sources. The model uses many existing schemas to describe various ontology classes and shows the scope of interlinking with the Linked Data cloud

BlogForever D2.6: Data Extraction Methodology

This report outlines an inquiry into the area of web data extraction, conducted within the context of blog preservation. The report reviews theoretical advances and practical developments for implementing data extraction. The inquiry is extended through an experiment that demonstrates the effectiveness and feasibility of implementing some of the suggested approaches. More specifically, the report discusses an approach based on unsupervised machine learning that employs the RSS feeds and HTML representations of blogs. It outlines the possibilities of extracting semantics available in blogs and demonstrates the benefits of exploiting available standards such as microformats and microdata. The report proceeds to propose a methodology for extracting and processing blog data to further inform the design and development of the BlogForever platform

Assessment for learning in architectural design programmes

This paper compares the learning and teaching strategies practised in the programmes of the Architectural Subject Group at the University of Northumbria with best practices of assessment (‘Assessment for Learning’) as promoted by the Centre for Excellence in Learning in the same University. These best practices are grouped under the umbrella concepts of ‘Assessment for Learning’ and comprise six key criteria which can be paraphrased as; authenticity and complexity in methods of assessment; use of summative assessment as the main driver for learning; extensive opportunities to develop and demonstrate learning; rich in formal feedback; rich in informal feedback; developing students’ abilities to direct their own learning, evaluate their own progress, and support the learning of others