Creating Reusable Educational Components: Lessons from DLESE

Reuse of educational materials is integral to many educator tasks, from designing a course to preparing for a lab or class. This article describes a study on the reuse of educational materials in the context of the Digital Library for Earth System Education (DLESE), a community-owned and governed facility offering high-quality teaching and learning resources for Earth system education. The study noted that educational resource designers often do not develop components with reuse in mind, making it more difficult or impossible for other educators to find and use their material, and that the 'findability' and reusability of community-created digital educational resources is highly dependent on the presentational and structural design of the resources themselves. The authors recommend that all resources clearly state the creator's name and contact information, relevant copyright restrictions, the most significant date for the resource (specifying creation or revision), and the intended grade level. Educational levels: Graduate or professional, Graduate or professional, Graduate or professional

Usability Evaluation in Virtual Environments: Classification and Comparison of Methods

Virtual environments (VEs) are a relatively new type of human-computer interface in which users perceive and act in a three-dimensional world. The designers of such systems cannot rely solely on design guidelines for traditional two-dimensional interfaces, so usability evaluation is crucial for VEs. We present an overview of VE usability evaluation. First, we discuss some of the issues that differentiate VE usability evaluation from evaluation of traditional user interfaces such as GUIs. We also present a review of VE evaluation methods currently in use, and discuss a simple classification space for VE usability evaluation methods. This classification space provides a structured means for comparing evaluation methods according to three key characteristics: involvement of representative users, context of evaluation, and types of results produced. To illustrate these concepts, we compare two existing evaluation approaches: testbed evaluation [Bowman, Johnson, & Hodges, 1999], and sequential evaluation [Gabbard, Hix, & Swan, 1999]. We conclude by presenting novel ways to effectively link these two approaches to VE usability evaluation

Evaluation in a project life‐cycle: The hypermedia CAMILLE project

In the CAL literature, the issue of integrating evaluation into the life‐cycle of a project has often been recommended but less frequently reported, at least for large‐scale hypermedia environments. Indeed, CAL developers face a difficult problem because effective evaluation needs to satisfy the potentially conflicting demands of a variety of audiences (teachers, administrators, the research community, sponsors, etc.). This paper first examines some of the various forms of evaluation adopted by different kinds of audiences. It then reports on evaluations, formative as well as summative, set up by the European CAMILLE project teams in four countries during a large‐scale courseware development project. It stresses the advantages, despite drawbacks and pitfalls, for CAL developers to systematically undertake evaluation. Lastly, it points out some general outcomes concerning learning issues of interest to teachers, trainers and educational advisers. These include topics such as the impact of multimedia, of learner variability and learner autonomy on the effectiveness of learning with respect to language skills

Scoping a vision for formative e-assessment: a project report for JISC

Assessment is an integral part of teaching and learning. If the relationship between teaching and learning were causal, i. e. if students always mastered the intended learning outcomes of a particular sequence of instruction, assessment would be superfluous. Experience and research suggest this is not the case: what is learnt can often be quite different from what is taught. Formative assessment is motivated by a concern with the elicitation of relevant information about student understanding and / or achievement, its interpretation and an exploration of how it can lead to actions that result in better learning. In the context of a policy drive towards technology-enhanced approaches to teaching and learning, the question of the role of digital technologies is key and it is the latter on which this project particularly focuses. The project and its deliverables have been informed by recent and relevant literature, in particular recent work by Black andIn this work, they put forward a framework which suggests that assessment for learning their term for formative assessment can be conceptualised as consisting of a number of aspects and five keystrategies. The key aspects revolve around the where the learner is going, where the learner is right now and how she can get there and examines the role played by the teacher, peers and the learner. Language: English Keywords: assessments, case studies, design patterns, e-assessmen

Evaluating complex digital resources

Squires (1999) discussed the gap between HCI (Human Computer Interaction) and the educational computing communities in their very different approaches to evaluating educational software. This paper revisits that issue in the context of evaluating digital resources, focusing on two approaches to evaluation: an HCI and an educational perspective. Squires and Preece's HCI evaluation model is a predictive model ‐ it helps teachers decide whether or not to use educational software ‐ whilst our own concern is in evaluating the use of learning technologies. It is suggested that in part the different approaches of the two communities relate to the different focus that each takes: in HCI the focus is typically on development and hence usability, whilst in education the concern is with the learner and teacher use

Layered evaluation of interactive adaptive systems : framework and formative methods

Peer reviewedPostprin

Tone from the Top in Risk Management: A Complementarity Perspective on How Control Systems Influence Risk Awareness

Prompted by the weaknesses of standardized risk management approaches in the aftermath of the 2008 financial crisis, scholars, regulators, and practitioners alike emphasize the importance of creating a risk-aware culture in organizations. Recent insights highlight the special role of tone from the top as crucial driver of risk awareness. In this study, we take a systems-perspective on control system design to investigate the role of tone from the top in creating risk awareness. In particular, we argue that both interactive and diagnostic use of budgets and performance measures interact with tone from the top in managing risk awareness. Our results show that interactive control strengthens the effect of tone from the top on risk awareness, while tone from the top and diagnostic control are, on average, not interrelated with regard to creating risk awareness. To shed light on the boundary conditions of the proposed interdependencies, we further investigate whether the predicted interdependencies are sensitive to the level of perceived environmental uncertainty. We find that the effect of tone from the top and interactive control becomes significantly stronger in a situation of high perceived environmental uncertainty. Most interestingly, tone from the top and diagnostic control are complements with regard to risk awareness in settings of low perceived environmental uncertainty and substitutes at high levels of perceived environmental uncertainty.Series: Department of Strategy and Innovation Working Paper Serie