Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies

A systematic search of the research literature from 1996 through July 2008 identified more than a thousand empirical studies of online learning. Analysts screened these studies to find those that (a) contrasted an online to a face-to-face condition, (b) measured student learning outcomes, (c) used a rigorous research design, and (d) provided adequate information to calculate an effect size. As a result of this screening, 51 independent effects were identified that could be subjected to meta-analysis. The meta-analysis found that, on average, students in online learning conditions performed better than those receiving face-to-face instruction. The difference between student outcomes for online and face-to-face classes—measured as the difference between treatment and control means, divided by the pooled standard deviation—was larger in those studies contrasting conditions that blended elements of online and face-to-face instruction with conditions taught entirely face-to-face. Analysts noted that these blended conditions often included additional learning time and instructional elements not received by students in control conditions. This finding suggests that the positive effects associated with blended learning should not be attributed to the media, per se. An unexpected finding was the small number of rigorous published studies contrasting online and face-to-face learning conditions for K–12 students. In light of this small corpus, caution is required in generalizing to the K–12 population because the results are derived for the most part from studies in other settings (e.g., medical training, higher education)

Ariadne: An interface to support collaborative database browsing:Technical Report CSEG/3/1995

This paper outlines issues in the learning of information searching skills. We report on our observations of the learning of browsing skills and the subsequent iterative development and testing of the Ariadne system – intended to investigate and support the collaborative learning of search skills. A key part of this support is a mechanism for recording an interaction history and providing students with a visualisation of that history that they can reflect and comment upon

Recommendation, collaboration and social search

This chapter considers the social component of interactive information retrieval: what is the role of other people in searching and browsing? For simplicity we begin by considering situations without computers. After all, you can interactively retrieve information without a computer; you just have to interact with someone or something else. Such an analysis can then help us think about the new forms of collaborative interactions that extend our conceptions of information search, made possible by the growth of networked ubiquitous computing technology. Information searching and browsing have often been conceptualized as a solitary activity, however they always have a social component. We may talk about 'the' searcher or 'the' user of a database or information resource. Our focus may be on individual uses and our research may look at individual users. Our experiments may be designed to observe the behaviors of individual subjects. Our models and theories derived from our empirical analyses may focus substantially or exclusively on an individual's evolving goals, thoughts, beliefs, emotions and actions. Nevertheless there are always social aspects of information seeking and use present, both implicitly and explicitly. We start by summarizing some of the history of information access with an emphasis on social and collaborative interactions. Then we look at the nature of recommendations, social search and interfaces to support collaboration between information seekers. Following this we consider how the design of interactive information systems is influenced by their social elements

Knowledge Enhanced Notes (KEN)

To aid the creation and through-life support of large complex engineering products, organisations are placing a greater emphasis on constructing complete and accurate records of design activities. Current documentary approaches are not sufficient to capture activities and decisions in their entirety and can lead to organisations revisiting and in some cases reworking design decisions in order to understand previous design episodes. This paper presents an overview of the challenges in creating accurate, re-usable records of synchronous design activities, enhancing the through-life support of engineering products, followed by the development of an information capture software system to address these challenges. The main objectives for the development of the Knowledge Enhanced Notes system are described followed by the techniques chosen to address the objectives, and finally a description of a use-case for the system. Whilst the focus of the KEN System was to aid the creation and through-life support of large complex engineering products through constructing complete and accurate records of design activities, the system is entirely generic in its application to synchronous activities

Wearable learning tools

In life people must learn whenever and wherever they experience something new. Until recently computing technology could not support such a notion, the constraints of size, power and cost kept computers under the classroom table, in the office or in the home. Recent advances in miniaturization have led to a growing field of research in ‘wearable’ computing. This paper looks at how such technologies can enhance computer‐mediated communications, with a focus upon collaborative working for learning. An experimental system, MetaPark, is discussed, which explores communications, data retrieval and recording, and navigation techniques within and across real and virtual environments. In order to realize the MetaPark concept, an underlying network architecture is described that supports the required communication model between static and mobile users. This infrastructure, the MUON framework, is offered as a solution to provide a seamless service that tracks user location, interfaces to contextual awareness agents, and provides transparent network service switching

Mobile, ubiquitous information seeking, as a group: the iBingo collaborative video retrieval system

iBingo features two or more users performing collaborative information seeking tasks, using mobile devices, Apple iPod iTouch in our case. The novelty in our work is that the system, called iBingo, mediates the collaborative searches among the users and performs a realtime division of labour among co-searchers so users are presented with documents which are both unique and tailored to the individual. This enables each user to explore unique subsets of the retrieved information space. We demonstrate iBingo mobile collabo-rative search on a video collection from TRECVid 2007

Designing Interfaces to Support Collaboration in Information Retrieval

Information retrieval systems should acknowledge the existence of collaboration in the search process. Collaboration can help users to be more effective in both learning systems and in using them. We consider some issues of viewing interfaces to information retrieval systems as collaborative notations and how to build systems that more actively support collaboration. We describe a system that embodies just one kind of explicit support; a graphical representation of the search process that can be manipulated and discussed by the users. By acknowledging the importance of other people in the search process, we can develop systems that not only improve help-giving by people but which can lead to a more robust search activity, more able to cope with, and indeed exploit, the failures of any intelligent agents used

Improving instructional effectiveness with computer‐mediated communication

This study explores the use of asynchronous Computer‐Mediated Communication (CMC) in the delivery of instructional content, and points up the interaction among learners, as well as between learners and instructors. The instructional content in the project described was available to learners online as Microsoft Word documents, with email being used for communicating within the student group. Many students, as well as some of the instructors, felt uncomfortable with the flexibility and openness that a CMC environment allowed. However, once familiar with this process of instruction and interaction, learners were able to work consistently at their own pace, and understand that instructors are interested in every individual learner's opinion and in the collective views of the group. It was evident that a CMC‐based instructional delivery system, when carefully planned, has the potential to facilitate that outcome, and to improve instructional effectiveness