Scoping a vision for formative e-assessment: a project report for JISC

Assessment is an integral part of teaching and learning. If the relationship between teaching and learning were causal, i. e. if students always mastered the intended learning outcomes of a particular sequence of instruction, assessment would be superfluous. Experience and research suggest this is not the case: what is learnt can often be quite different from what is taught. Formative assessment is motivated by a concern with the elicitation of relevant information about student understanding and / or achievement, its interpretation and an exploration of how it can lead to actions that result in better learning. In the context of a policy drive towards technology-enhanced approaches to teaching and learning, the question of the role of digital technologies is key and it is the latter on which this project particularly focuses. The project and its deliverables have been informed by recent and relevant literature, in particular recent work by Black andIn this work, they put forward a framework which suggests that assessment for learning their term for formative assessment can be conceptualised as consisting of a number of aspects and five keystrategies. The key aspects revolve around the where the learner is going, where the learner is right now and how she can get there and examines the role played by the teacher, peers and the learner. Language: English Keywords: assessments, case studies, design patterns, e-assessmen

A literature review of the use of Web 2.0 tools in Higher Education

This review focuses on the use of Web 2.0 tools in Higher Education. It provides a synthesis of the research literature in the field and a series of illustrative examples of how these tools are being used in learning and teaching. It draws out the perceived benefits that these new technologies appear to offer, and highlights some of the challenges and issues surrounding their use. The review forms the basis for a HE Academy funded project, ‘Peals in the Cloud’, which is exploring how Web 2.0 tools can be used to support evidence-based practices in learning and teaching. The project has also produced two in-depth case studies, which are reported elsewhere (Galley et al., 2010, Alevizou et al., 2010). The case studies focus on evaluation of a recently developed site for learning and teaching, Cloudworks, which harnesses Web 2.0 functionality to facilitate the sharing and discussion of educational practice. The case studies aim to explore to what extent the Web 2.0 affordances of the site are successfully promoting the sharing of ideas, as well as scholarly reflections, on learning and teaching

A Guide to Authentic e-Learning

Part of the groundbreaking Connecting with e-Learning series, A Guide to Authentic e-Learning provides effective, working examples to engage learners with authentic tasks in online settings. As technology continues to open up possibilities for innovative and effective teaching and learning opportunities, students and teachers are no longer content to accept familiar classroom or lecture-based pedagogies that rely on information delivery and little else. Situated and constructivist theories advocate that learning is best achieved in circumstances resembling the real-life application of knowledge. While there are multiple learning design models that share similar foundations, authentic e-learning tasks go beyond process to become complex, sustained activities that draw on realistic situations to produce realistic outcomes

Authoring Example-based Tutors for Procedural Tasks

Researchers who have worked on authoring systems for intelligent tutoring systems (ITSs) have examined how examples may form the basis for authoring. In this chapter, we describe several such systems, consider their commonalities and differences, and reflect on the merit of such an approach. It is not surprising perhaps that several tutor developers have explored how examples can be used in the authoring process. In a broader context, educators and researchers have long known the power of examples in learning new material. Students can gather much information by poring over a worked example, applying what they learn to novel problems. Often these worked examples prove more powerful than direct instruction in the domain. For example, Reed and Bolstad (1991) found that students learning solely by worked examples exhibited much greater learning than those learning instruction based on procedures. By extension then, since tutor authoring can be considered to be teaching a tabula rasa tutor, tutor authoring by use of examples may be as powerful as directly programming the instruction, while being easier to do

Youth and Digital Media: From Credibility to Information Quality

Building upon a process-and context-oriented information quality framework, this paper seeks to map and explore what we know about the ways in which young users of age 18 and under search for information online, how they evaluate information, and how their related practices of content creation, levels of new literacies, general digital media usage, and social patterns affect these activities. A review of selected literature at the intersection of digital media, youth, and information quality -- primarily works from library and information science, sociology, education, and selected ethnographic studies -- reveals patterns in youth's information-seeking behavior, but also highlights the importance of contextual and demographic factors both for search and evaluation. Looking at the phenomenon from an information-learning and educational perspective, the literature shows that youth develop competencies for personal goals that sometimes do not transfer to school, and are sometimes not appropriate for school. Thus far, educational initiatives to educate youth about search, evaluation, or creation have depended greatly on the local circumstances for their success or failure

Authentic learning in interactive multimedia environments

The instructional technology community is in the midst of a philosophical shift from a behaviourist to a constructivist framework, a move that may begin to address the growing rift between formal school learning and real-life learning. One theory of learning which has the capacity to promote authentic learning is that of situated learning. The purpose of the study was to investigate the way students learn from an interactive multimedia package and learning environment based on a situated learning model. To do this, it was necessary to identify the critical characteristics of a situated learning model based on the extensive literature on the subject. An interactive multimedia learning environment for university level students was then designed according to these characteristics of a situated learning model. The learning environment comprised an interactive multimedia program on assessment in mathematics, together with recommended implementation conditions in the classroom. Specifically, the research sought to investigate the way preservice teachers used interactive multimedia based on a situated learning model, how they responded to the critical elements of the situated learning environment, what types of higher-order thinking they used as they worked with the program, and whether learning transferred to their professional teaching practice in schools. The research took the form of an interpretive, qualitative study. The major methods of data collection were videotaping of preservice teachers using the interactive multimedia program, observation, and interviews with both the preservice teachers and their supervising teachers in schools. Data was analysed using techniques of qualitative analysis recommended by Eisner (1991) and Miles and Huberman (1994). Findings suggest that the use of the situated learning model was a successful alternative to the system models frequently used for the development of interactive multimedia, and one that enabled students to freely navigate a complex resource. When implemented with all the characteristics defined in the model, it appeared to provide an effective framework for the design of an environment for the acquisition of advanced know ledge. Students used a substantial amount of higher-order thinking, relatively little social and lower order talk, and a moderate amount of procedural talk as they worked with the assessment program. While on their professional practice in schools, the students used a variety of assessment techniques to assess children\u27s learning, and they were able to speak knowledgably and confidently about the issue of assessment, supporting the view that they had incorporated their learning deeply into their cognitive structures. According to the beliefs of the students themselves, the multimedia program appeared to influence the types of strategies they employed and their thinking about assessment as they taught mathematics and other classes during their professional practice. The major implication of the research is that new learning theory can inform the instructional design of interactive multimedia. For implementation in contexts of advanced knowledge acquisition, an instructional design model based on situated learning is an effective substitute for the traditional instructional systems model. Further implications are that excessive intervention by the developer in providing interaction between the program and the learner is not necessary, and that multimedia materials are best designed and implemented socially, not as independent instruction for individual learners. At the conclusion of the thesis, extensive recommendations for further research, both systemic and analytic, are provided

Learning to communicate computationally with Flip: a bi-modal programming language for game creation

Teaching basic computational concepts and skills to school children is currently a curricular focus in many countries. Running parallel to this trend are advances in programming environments and teaching methods which aim to make computer science more accessible, and more motivating. In this paper, we describe the design and evaluation of Flip, a programming language that aims to help 11–15 year olds develop computational skills through creating their own 3D role-playing games. Flip has two main components: 1) a visual language (based on an interlocking blocks design common to many current visual languages), and 2) a dynamically updating natural language version of the script under creation. This programming-language/natural-language pairing is a unique feature of Flip, designed to allow learners to draw upon their familiarity with natural language to “decode the code”. Flip aims to support young people in developing an understanding of computational concepts as well as the skills to use and communicate these concepts effectively. This paper investigates the extent to which Flip can be used by young people to create working scripts, and examines improvements in their expression of computational rules and concepts after using the tool. We provide an overview of the design and implementation of Flip before describing an evaluation study carried out with 12–13 year olds in a naturalistic setting. Over the course of 8 weeks, the majority of students were able to use Flip to write small programs to bring about interactive behaviours in the games they created. Furthermore, there was a significant improvement in their computational communication after using Flip (as measured by a pre/post-test). An additional finding was that girls wrote more, and more complex, scripts than did boys, and there was a trend for girls to show greater learning gains relative to the boys

Using the organizational and narrative thread structures in an e-book to support comprehension.

Stories, themes, concepts and references are organized structurally and purposefully in most books. A person reading a book needs to understand themes and concepts within the context. Schanks Dynamic Memory theory suggested that building on existing memory structures is essential to cognition and learning. Pirolli and Card emphasized the need to provide people with an independent and improved ability to access and understand information in their information seeking activities. Through a review of users reading behaviours and of existing e-Book user interfaces, we found that current e-Book browsers provide minimal support for comprehending the content of large and complex books. Readers of an e-Book need user interfaces that present and relate the organizational and narrative structures, and moreover, reveal the thematic structures. This thesis addresses the problem of providing readers with effective scaffolding of multiple structures of an e-Book in the user interface to support reading for comprehension. Recognising a story or topic as the basic unit in a book, we developed novel story segmentation techniques for discovering narrative segments, and adapted story linking techniques for linking narrative threads in semi-structured linear texts of an e-Book. We then designed an e-Book user interface to present the complex structures of the e-Book, as well as to assist the reader to discover these structures. We designed and developed evaluation methodologies to investigate reading and comprehension in e-Books, in order to assess the effectiveness of this user interface. We designed semi-directed reading tasks using a Story-Theme Map, and a set of corresponding measurements for the answers. We conducted user evaluations with book readers. Participants were asked to read stories, to browse and link related stories, and to identify major themes of stories in an e-Book. This thesis reports the experimental design and results in detail. The results confirmed that the e-Book interface helped readers perform reading tasks more effectively. The most important and interesting finding is that the interface proved to be more helpful to novice readers who had little background knowledge of the book. In addition, each component that supported the user interface was evaluated separately in a laboratory setting and, these results too are reported in the thesis

The experience of flow and learning by designing interactive multimedia software

As computer technology is increasingly adopted in education, some students continue to have little context for its use. This is particularly true of tertiary drama education students, of whom many still remain computer illiterate. Constructivist pedagogy proposes that a learner constructs knowledge through active participation in their learning. An approach that is gaining currency which applies this principle is learning by designing. This approach was adopted for this study, with the premise that the process of designing multimedia software for their peers would not only motivate these students to use computers but could also lead to a deepening of their understanding of the subject matter. Questions that arise in response to this hypothesis include: what do students learn from designing multimedia software; and what motivates their engagement in this task? These questions where addressed by a project which spanned a two week period at a university. Five university drama education students participated in designing multimedia software which aimed to elucidate the process of devising plays for their peers. The data this activity generated provided the foundation for five case studies which document the students\u27 engagement and learning processes. The findings indicate that the learning by design approach paved an effective learning approach. Also, the use of flow theory as a theoretical framework was helpful in developing an understanding of each person\u27s individual process of engagement. The thesis comments on this theoretical framework and suggests a number of hypotheses for further testing by education professionals