Quality Assessment for E-learning: a Benchmarking Approach (Third edition)

The primary purpose of this manual is to provide a set of benchmarks, quality criteria and notes for guidance against which e-learning programmes and their support systems may be judged. The manual should therefore be seen primarily as a reference tool for the assessment or review of e-learning programmes and the systems which support them. However, the manual should also prove to be useful to staff in institutions concerned with the design, development, teaching, assessment and support of e-learning programmes. It is hoped that course developers, teachers and other stakeholders will see the manual as a useful development and/or improvement tool for incorporation in their own institutional systems of monitoring, evaluation and enhancement

Systemic intervention for computer-supported collaborative learning

This paper presents a systemic intervention approach as a means to overcome the methodological challenges involved in research into computer-supported collaborative learning applied to the promotion of mathematical problem-solving (CSCL-MPS) skills in schools. These challenges include how to develop an integrated analysis of several aspects of the learning process; and how to reflect on learning purposes, the context of application and participants' identities. The focus of systemic intervention is on processes for thinking through whose views and what issues and values should be considered pertinent in an analysis. Systemic intervention also advocates mixing methods from different traditions to address the purposes of multiple stakeholders. Consequently, a design for CSCL-MPS research is presented that includes several methods. This methodological design is used to analyse and reflect upon both a CSCL-MPS project with Colombian schools, and the identities of the participants in that project

The Learning Edge: Supporting Student Success in a Competency-Based Learning Environment

State by state, our country is revamping our education system to ensure that each and every one of our young people is college and career ready. Over two-thirds of our states have adopted policies that enable credits to be awarded based on proficiency in a subject, rather than the one-size-fits-all seat-time in a classroom. Now states such as Maine and New Hampshire are taking the next step in establishing competency based diplomas in which students are expected to demonstrate that they can apply their skills and knowledge. To ensure high-quality competency education, in 2011 one hundred innovators created a working definition to guide the field. This paper delves into the fourth element of the definition: Students receive timely, differentiated support based on their individual learning needs. Through a series of interviews and site visits, an understanding of how support in a competency-based school differs from traditional approaches emerged. Learning in a competency-based environment means pushing students and adults to the edge of their comfort zone and competence -- the learning edge. Common themes that were drawn from the wide variety of ways schools support students became the basis for the design principles introduced here. It is essential to pause and understand the importance of timely, differentiated support. Our commitment to prepare all of our young people for college and careers demands that we be intentional in designing schools to effectively meet the needs of students of all races, classes, and cultures. It also demands our vigilance in challenging inequity. There is a risk in competency education -- a risk that learning at one's own pace could become the new achievement gap and that learning anywhere/anytime could become the new opportunity gap. Therefore, our goal in writing this paper is to provide ideas and guidance so that innovators in competency education can put into place powerful systems of supports for students in order to eradicate, not replicate, the inequities and variability in quality and outcomes that exist in our current system. Please consider this paper as an initial exploration into what it means to provide support for the individual learning needs of students. It is designed to generate reflection, analysis, and feedback

Early Learning Innovation Fund Evaluation Final Report

This is a formative evaluation of the Hewlett Foundation's Early Learning Innovation Fund that began in 2011 as part of the Quality Education in Developing Countries (QEDC) initiative.  The Fund has four overarching objectives, which are to: promote promising approaches to improve children's learning; strengthen the capacity of organizations implementing those approaches; strengthen those organizations' networks and ownership; and grow 20 percent of implementing organizations into significant players in the education sector. The Fund's original design was to create a "pipeline" of innovative approaches to improve learning outcomes, with the assumption that donors and partners would adopt the most successful ones. A defining feature of the Fund was that it delivered assistance through two intermediary support organizations (ISOs), rather than providing funds directly to implementing organizations. Through an open solicitation process, the Hewlett Foundation selected Firelight Foundation and TrustAfrica to manage the Fund. Firelight Foundation, based in California, was founded in 1999 with a mission to channel resources to community-based organizations (CBOs) working to improve the lives of vulnerable children and families in Africa. It supports 12 implementing organizations in Tanzania for the Fund. TrustAfrica, based in Dakar, Senegal, is a convener that seeks to strengthen African-led initiatives addressing some of the continent's most difficult challenges. The Fund was its first experience working specifically with early learning and childhood development organizations. Under the Fund, it supported 16 such organizations: one in Mali and five each in Senegal, Uganda and Kenya. At the end of 2014, the Hewlett Foundation commissioned Management Systems International (MSI) to conduct a mid-term evaluation assessing the implementation of the Fund exploring the extent to which it achieved intended outcomes and any factors that had limited or enabled its achievements. It analyzed the support that the ISOs provided to their implementing organizations, with specific focus on monitoring and evaluation (M&E). The evaluation included an audit of the implementing organizations' M&E systems and a review of the feasibility of compiling data collected to support an impact evaluation. Finally, the Foundation and the ISOs hoped that this evaluation would reveal the most promising innovations and inform planning for Phase II of the Fund. The evaluation findings sought to inform the Hewlett Foundation and other donors interested in supporting intermediary grant-makers, early learning innovations and the expansion of innovations. TrustAfrica and Firelight Foundation provided input to the evaluation's scope of work. Mid-term evaluation reports for each ISO provided findings about their management of the Fund's Phase I and recommendations for Phase II. This final evaluation report will inform donors, ISOs and other implementing organizations about the best approaches to support promising early learning innovations and their expansion. The full report outlines findings common across both ISOs' experience and includes recommendations in four key areas: adequate time; appropriate capacity building; advocacy and scaling up; and evaluating and documenting innovations. Overall, both Firelight Foundation and TrustAfrica supported a number of effective innovations working through committed and largely competent implementing organizations. The program's open-ended nature avoided being prescriptive in its approach, but based on the lessons learned in this evaluation and the broader literature, the Hewlett Foundation and other donors could have offered more guidance to ISOs to avoid the need to continually relearn some lessons. For example, over the evaluation period, it became increasingly evident that the current context demands more focused advance planning to measure impact on beneficiaries and other stakeholders and a more concrete approach to promoting and resourcing potential scale-up. The main findings from the evaluation and recommendations are summarized here

Technology-enhanced Personalised Learning: Untangling the Evidence

Technology-enhanced personalised learning is not yet common in Germany, which is why we have tasked scientists with summarising the current status of international research on the matter. This study demonstrates the great potential of technology in implementing effective personalised learning. Nevertheless, it has not been assessed yet whether the practical implementation actually works: Even in countries such as the U.S., which lead the way in using techology in classroom settings, hardly any evaluation studies have been done to prove the effectiveness of technology-enhanced personalised learning. In the light of the above, the authors make recommendations for actions to be taken in Germany to make best use of the potential of technology in providing individual support and guidance to students

Teaching and learning in virtual worlds: is it worth the effort?

Educators have been quick to spot the enormous potential afforded by virtual worlds for situated and authentic learning, practising tasks with potentially serious consequences in the real world and for bringing geographically dispersed faculty and students together in the same space (Gee, 2007; Johnson and Levine, 2008). Though this potential has largely been realised, it generally isn’t without cost in terms of lack of institutional buy-in, steep learning curves for all participants, and lack of a sound theoretical framework to support learning activities (Campbell, 2009; Cheal, 2007; Kluge & Riley, 2008). This symposium will explore the affordances and issues associated with teaching and learning in virtual worlds, all the time considering the question: is it worth the effort

Designing an e-tutoring system for large classes: mixed-method research

This study aimed at assessing the perceptions of 167 teachers about the tutoring system adopted in an online training course involving teachers from 20 Schools of Sesimbra, Setúbal and Palmela counties. The course, called “Distributed Knowledge with Web 2.0”, was officially certified as a blended learning modality, with the duration of 50 hours, 41 of which occurred online in two editions, the first in February and the second in July of 2012, each one of them involving respectively 82 and 85 teachers, divided in four classes with about 20 trainees each. This blended learning course was designed at producing educational materials in digital format, and included autonomous and group activities, knowledge sharing and reflection. A learning environment, supported by the Ning platform, was set up. At the end of the course, the trainees answered to a pencil and paper survey, in order to evaluate the adopted online tutoring strategy. Additionally the trainees’ final reports contained evidence of how the trainees assessed the tutoring model component of the course; both the survey and the reports were the basis for this research. The results show that the teachers who attended the two course editions disclosed very positive perceptions about online learning, a modality they consider adequate to their current professional status and conditions. The trainees also showed their intention of, in the future, opting for blended training arrangements. Future developments of this study involve a content analysis of the tutor’s posts, in order to understand more accurately the tutor’s messages characteristics, in their social and cognitive dimensions

Transforming pre-service teacher curriculum: observation through a TPACK lens

This paper will discuss an international online collaborative learning experience through the lens of the Technological Pedagogical Content Knowledge (TPACK) framework. The teacher knowledge required to effectively provide transformative learning experiences for 21st century learners in a digital world is complex, situated and changing. The discussion looks beyond the opportunity for knowledge development of content, pedagogy and technology as components of TPACK towards the interaction between those three components. Implications for practice are also discussed. In today’s technology infused classrooms it is within the realms of teacher educators, practising teaching and pre-service teachers explore and address effective practices using technology to enhance learning