Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies

A systematic search of the research literature from 1996 through July 2008 identified more than a thousand empirical studies of online learning. Analysts screened these studies to find those that (a) contrasted an online to a face-to-face condition, (b) measured student learning outcomes, (c) used a rigorous research design, and (d) provided adequate information to calculate an effect size. As a result of this screening, 51 independent effects were identified that could be subjected to meta-analysis. The meta-analysis found that, on average, students in online learning conditions performed better than those receiving face-to-face instruction. The difference between student outcomes for online and face-to-face classes—measured as the difference between treatment and control means, divided by the pooled standard deviation—was larger in those studies contrasting conditions that blended elements of online and face-to-face instruction with conditions taught entirely face-to-face. Analysts noted that these blended conditions often included additional learning time and instructional elements not received by students in control conditions. This finding suggests that the positive effects associated with blended learning should not be attributed to the media, per se. An unexpected finding was the small number of rigorous published studies contrasting online and face-to-face learning conditions for K–12 students. In light of this small corpus, caution is required in generalizing to the K–12 population because the results are derived for the most part from studies in other settings (e.g., medical training, higher education)

An evaluation of a contract management simulation game for architecture students

Architects are currently grappling to exploit new forms of communication made possible with developments in internet communication. At the same time, the construction industry is in a state of flux as novel project management systems are being introduced. Students need to understand the first principles of project management within the context of our changing environment. One of the best ways for students to learn about the legalities of the construction process is through role play and simulation but there is a Catch 22. Unless students have a basic understanding of project management, the contractual process can be confusing and intimidating. Even fifth and sixth year architecture students are reluctant to ask practitioners questions for fear of appearing ignorant. This paper presents an evaluation of the cost and benefits of a web-based simulation game to deliver the Architecture studies curriculum. The webbased game allows students to critically observe the transformation of designs into buildings through the exploration of the contract management process. A questionnaire survey was used to assess how the computer simulation operates as a group exercise, how it compares with more traditional approaches and the best and worst features of the web-based system. The students found the game to be practical, enjoyable, motivating and effective in stimulating the learning process. The benefits of the web-based game were also found to outweigh the costs, thus providing support for its use as an active learning tool in Architectural Education

Self-Regulation in a Web-Based Course: A Case Study

Little is known about how successful students in Web-based courses self-regulate their learning. This descriptive case study used a social cognitive model of self-regulated learning (SRL) to investigate how six graduate students used and adapted traditional SRL strategies to complete tasks and cope with challenges in a Web-based technology course; it also explored motivational and environmental influences on strategy use. Primary data sources were three transcribed interviews with each of the students over the course of the semester, a transcribed interview with the course instructor, and the students’ reflective journals. Archived course documents, including transcripts of threaded discussions and student Web pages, were secondary data sources. Content analysis of the data indicated that these students used many traditional SRL strategies, but they also adapted planning, organization, environmental structuring, help seeking, monitoring, record keeping, and self-reflection strategies in ways that were unique to the Web-based learning environment. The data also suggested that important motivational influences on SRL strategy use—self-efficacy, goal orientation, interest, and attributions—were shaped largely by student successes in managing the technical and social environment of the course. Important environmental influences on SRL strategy use included instructor support, peer support, and course design. Implications for online course instructors and designers, and suggestions for future research are offered

Technology Solutions for Developmental Math: An Overview of Current and Emerging Practices

Reviews current practices in and strategies for incorporating innovative technology into the teaching of remedial math at the college level. Outlines challenges, emerging trends, and ways to combine technology with new concepts of instructional strategy

Online vs. face-to-face discussions in a web-based research methods course for postgraduate nursing students : A quasi-experimental study

Background: Web-based technologies are increasingly being used to create modes of online learning for nurses but their effect has not been assessed in nurse education. Objectives: Assess whether participation in face-to-face discussion seminars or online asynchronous discussion groups had different effects on educational attainment in a webbased course. Design: Non-randomised or quasi-experimental design with two groups – students choosing to have face-to-face discussion seminars and students choosing to have online discussions. Setting: The Core Methods module of a postgraduate research methods course. Participants: All 114 students participating in the first 2 years during which the course teaching material was delivered online. Outcome: Assignment mark for Core Methods course module. Methods: Background details of the students, their choices of modules and assignment marks were collected as part of the routine course administration. Students’ online activities were identified using the student tracking facility within WebCT. Regression models were fitted to explore the association between available explanatory variables and assignment mark. Results: Students choosing online discussions had a higher Core Methods assignment mark (mean 60.8/100) than students choosing face-to-face discussions (54.4); the difference was statistically significant (t = 3.13, df = 102, p = 0.002), although this ignores confounding variables. Among online discussion students, assignment mark was significantly correlated with the numbers of discussion messages read (Kendall’s taub = 0.22, p = 0.050) and posted (Kendall’s taub = 0.27, p = 0.017); among face-to-face discussion students, it was significantly associated with the number of non-discussion hits in WebCT (Kendall’s taub = 0.19, p = 0.036). In regression analysis, choice of discussion method, whether an MPhil/PhD student, number of non-discussion hits in WebCT, number of online discussion messages read and number posted were associated with assignment mark at the 5% level of significance when taken singly; in combination, only whether an MPhil/PhD student (p = 0.024) and number of non-discussion hits (p = 0.045) retained significance. Conclusions: This study demonstrates that a research methods course can be delivered to postgraduate healthcare students at least as successfully by an entirely online method in which students participate in online discussion as by a blended method in which students accessing web-based teaching material attend face-to-face seminar discussions. Increased online activity was associated with higher assignment marks. The study highlights new opportunities for educational research that arise from the use of virtual learning environments that routinely record the activities of learners and tutors

A spiral model for adding automatic, adaptive authoring to adaptive hypermedia

At present a large amount of research exists into the design and implementation of adaptive systems. However, not many target the complex task of authoring in such systems, or their evaluation. In order to tackle these problems, we have looked into the causes of the complexity. Manual annotation has proven to be a bottleneck for authoring of adaptive hypermedia. One such solution is the reuse of automatically generated metadata. In our previous work we have proposed the integration of the generic Adaptive Hypermedia authoring environment, MOT ( My Online Teacher), and a semantic desktop environment, indexed by Beagle++. A prototype, Sesame2MOT Enricher v1, was built based upon this integration approach and evaluated. After the initial evaluations, a web-based prototype was built (web-based Sesame2MOT Enricher v2 application) and integrated in MOT v2, conforming with the findings of the first set of evaluations. This new prototype underwent another evaluation. This paper thus does a synthesis of the approach in general, the initial prototype, with its first evaluations, the improved prototype and the first results from the most recent evaluation round, following the next implementation cycle of the spiral model [Boehm, 88]

E-Learning in Postsecondary Education

Over the past decade postsecondary education has been moving increasingly from the class room to online. During the fall 2010 term 31 percent of U.S. college students took at least one online course. The primary reasons for the growth of e-learning in the nation\u27s colleges and universities include the desire of those institutions to generate new revenue streams, improve access, and offer students greater scheduling flexibility. Yet the growth of e-learning has been accompanied by a continuing debate about its effectiveness and by the recognition that a number of barriers impede its widespread adoption in higher education

Global Teamwork: A Study of Design Learning in Collaborative Virtual Environments

With the recent developments in communication and information technologies, using Collaborative Virtual Environments (CVEs) in design activity has experienced a remarkable increase. In this paper we present a collaborative learning activity between the University of Sydney (USYD), and the Istanbul Technical University (ITU). This paper shares our teaching experience and discusses the principles of collaborative design learning in virtual environments. Followed by a study on students’ perception on the courses and collaborative learning in both universities, this paper also suggests future refinements on the course structure and the main areas of collaborative design learning. Keywords: Collaborative Design; Collaborative Virtual Environments; Design Teaching And Learning</p

Ontology mapping by concept similarity

This paper presents an approach to the problem of mapping ontologies. The motivation for the research stems from the Diogene Project which is developing a web training environment for ICT professionals. The system includes high quality training material from registered content providers, and free web material will also be made available through the project's "Web Discovery" component. This involves using web search engines to locate relevant material, and mapping the ontology at the core of the Diogene system to other ontologies that exist on the Semantic Web. The project's approach to ontology mapping is presented, and an evaluation of this method is described