Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies

A systematic search of the research literature from 1996 through July 2008 identified more than a thousand empirical studies of online learning. Analysts screened these studies to find those that (a) contrasted an online to a face-to-face condition, (b) measured student learning outcomes, (c) used a rigorous research design, and (d) provided adequate information to calculate an effect size. As a result of this screening, 51 independent effects were identified that could be subjected to meta-analysis. The meta-analysis found that, on average, students in online learning conditions performed better than those receiving face-to-face instruction. The difference between student outcomes for online and face-to-face classes—measured as the difference between treatment and control means, divided by the pooled standard deviation—was larger in those studies contrasting conditions that blended elements of online and face-to-face instruction with conditions taught entirely face-to-face. Analysts noted that these blended conditions often included additional learning time and instructional elements not received by students in control conditions. This finding suggests that the positive effects associated with blended learning should not be attributed to the media, per se. An unexpected finding was the small number of rigorous published studies contrasting online and face-to-face learning conditions for K–12 students. In light of this small corpus, caution is required in generalizing to the K–12 population because the results are derived for the most part from studies in other settings (e.g., medical training, higher education)

Developing Learning Analytics for Epistemic Commitments in a Collaborative Information Seeking Environment

Learning analytics sits at the confluence of learning, information, and computer sciences. Using a distinctive account of learning analytics as a form of assessment, I first argue for its potential in pedagogically motivated learning design, suggesting a particular construct – epistemic cognition in literacy contexts – to probe using learning analytics. I argue for a recasting of epistemic cognition as ‘epistemic commitments’ in collaborative information tasks drawing a novel alignment between information seeking and multiple document processing (MDP) models, with empirical and theoretical grounding given for a focus on collaboration and dialogue in such activities. Thus, epistemic commitments are seen in the ways students seek, select, and integrate claims from multiple sources, and the ways in which their collaborative dialogue is brought to bear in this activity. Accordingly, the empirical element of the thesis develops two pedagogically grounded literacy based tasks: a MDP task, in which pre-selected documents were provided to students; and a collaborative information seeking task (CIS), in which students could search the web. These tasks were deployed at scale (n > 500) and involved writing an evaluative review, followed by a pedagogically supported peer assessment task. Assessment outcomes were analysed in the context of a new epistemic commitments-oriented set of trace data, and psychometric data regarding the participants’ epistemic cognition. Demonstrating the value of the methodological and conceptual approach taken, qualitative analyses indicate clear epistemic activity, and stark differences in behaviour between groups, the complexity of which is challenging to model computationally. Despite this complexity, quantitative analyses indicate that up to 30% of variance in output scores can be modelled using behavioural indicators. The explanatory potential of behaviourally-oriented models of epistemic commitments grounded in tool-interaction and collaborative dialogue is demonstrated. The thesis provides an exemplification of theoretically positioned analytic development, drawing on interdisciplinary literatures in addressing complex learning contexts

From ‘motivational climate’ to ‘motivational atmosphere’: a review of research examining the social and environmental influences on athlete motivation in sport

This chapter is intended to provide a comprehensive review of the various theories of social and environmental factors that influence athletes’ motivation in sport. In order to achieve this, a short historical review is conducted of the various ways in which motivation has been studied over the past 100 years, culminating in the ‘social-cognitive’ approach that undergirds several of the current theories of motivation in sport. As an outcome of this brief review, the conceptualisation and measurement of motivation are discussed, with a focus on the manner in which motivation may be influenced by key social agents in sport, such as coaches, parents and peers. This discussion leads to a review of Deci & Ryan’s (2000) self-determination theory (SDT), which specifies that environments and contexts which support basic psychological needs (competence, relatedness and autonomy) will produce higher quality motivation than environments which frustrate of exacerbate these needs. The research establishing the ways in which key social agents can support these basic needs is then reviewed, and the review depicts a situation wherein SDT has precipitated a way of studying the socio-environmental influences on motivation that has become quite piecemeal and fragmented. Following this, the motivational climate approach (Ames, 1992) specified in achievement-goals theory (AGT – Nicholls, 1989) is also reviewed. This section reveals a body of research which is highly consistent in its methodology and findings. The following two sections reflect recent debates regarding the nature of achievement goals and the way they are conceptualised (e.g., approach-avoidance goals and social goals), and the implications of this for motivational climate research are discussed. This leads to a section reviewing the current issues and concerns in the study of social and environmental influences on athlete motivation. Finally, future research directions and ideas are proposed to facilitate, precipitate and guide further research into the social and environmental influences on athlete motivation in sport. Recent studies that have attempted to address these issues are reviewed and their contribution is assessed

Conflicted Minds: Recalibrational Emotions Following Trust-based Interaction.

Consistent with a modular view of the mind, both short-sighted and long-sighted programs may be simultaneously active in the mind and in conflict with one another when individuals face choice dilemmas in trust-based economic interactions. Recalibrational theory helps us identify the adaptive design features shared among subsets of superordinate emotion programs. According to this design logic and the computation of adaptive problem features produced by Trust games, we predict the activation of emotions after Trust games. While this study successfully predicts reports of twenty distinct emotional states, further studies are needed to demonstrate ultimate recalibrational functions of emotions.emotions, recalibrational theory, modularity, Trust game, experiments

Explicit Feedback Within Game-based Training: Examining The Influence Of Source Modality Effects On Interaction

This research aims to enhance Simulation-Based Training (SBT) applications to support training events in the absence of live instruction. The overarching purpose is to explore available tools for integrating intelligent tutoring communications in game-based learning platforms and to examine theory-based techniques for delivering explicit feedback in such environments. The primary tool influencing the design of this research was the Generalized Intelligent Framework for Tutoring (GIFT), a modular domain-independent architecture that provides the tools and methods to author, deliver, and evaluate intelligent tutoring technologies within any training platform. Influenced by research surrounding Social Cognitive Theory and Cognitive Load Theory, the resulting experiment tested varying approaches for utilizing an Embodied Pedagogical Agent (EPA) to function as a tutor during interaction in a game-based environment. Conditions were authored to assess the tradeoffs between embedding an EPA directly in a game, embedding an EPA in GIFT’s browser-based Tutor-User Interface (TUI), or using audio prompts alone with no social grounding. The resulting data supports the application of using an EPA embedded in GIFT’s TUI to provide explicit feedback during a game-based learning event. Analyses revealed conditions with an EPA situated in the TUI to be as effective as embedding the agent directly in the game environment. This inference is based on evidence showing reliable differences across conditions on the metrics of performance and self-reported mental demand and feedback usefulness items. This research provides source modality tradeoffs linked to tactics for relaying training relevant explicit information to a user based on real-time performance in a game