Scaffolding Reflection: Prompting Social Constructive Metacognitive Activity in Non-Formal Learning

The study explores the effects of three different types of non-adaptive, metacognitive scaffolding on social, constructive metacognitive activity and reflection in groups of non-formal learners. Six triads of non-formal learners were assigned randomly to one of the three scaffolding conditions: structuring, problematising or epistemological. The triads were then asked to collaboratively resolve an ill-structured problem and record their deliberations. Evidence from think-aloud protocols was analysed using conversational and discourse analysis. Findings indicate that epistemological scaffolds produced more social, constructive metacognitive activity than either of the two other scaffolding conditions in all metacognitive activities except for task orientation, as well as higher quality interactions during evaluation and reflection phases. However, participants appeared to be less aware of their activities as forming a strategic, self-regulatory response to the problem. This may indicate that for learning transfer, it may be necessary to employ an adaptive, facilitated reflection on learners' activities

Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies

A systematic search of the research literature from 1996 through July 2008 identified more than a thousand empirical studies of online learning. Analysts screened these studies to find those that (a) contrasted an online to a face-to-face condition, (b) measured student learning outcomes, (c) used a rigorous research design, and (d) provided adequate information to calculate an effect size. As a result of this screening, 51 independent effects were identified that could be subjected to meta-analysis. The meta-analysis found that, on average, students in online learning conditions performed better than those receiving face-to-face instruction. The difference between student outcomes for online and face-to-face classes—measured as the difference between treatment and control means, divided by the pooled standard deviation—was larger in those studies contrasting conditions that blended elements of online and face-to-face instruction with conditions taught entirely face-to-face. Analysts noted that these blended conditions often included additional learning time and instructional elements not received by students in control conditions. This finding suggests that the positive effects associated with blended learning should not be attributed to the media, per se. An unexpected finding was the small number of rigorous published studies contrasting online and face-to-face learning conditions for K–12 students. In light of this small corpus, caution is required in generalizing to the K–12 population because the results are derived for the most part from studies in other settings (e.g., medical training, higher education)

Influence of Discussion Prompts on Fostering Student Teachers’ Competence in Knowledge of English Instruction

This study analyzed questionnaire, pre-test, post-test, and online posts to explore influence of discussion prompts on the competence in English instruction of seven student teachers of elementary school EFL (English as a Foreign Language) in a practicum in Taiwan. This study reached the following conclusions. First, student teachers had good perceptions of the discussion prompts, particularly their effects on reflection on and relevance of English instruction. Secondly, student teachers had good perceptions of discussion prompts because of their clarity; however, they were not satisfied with inactive discussions among participants. Finally, participants’ education background and teaching experience affected their perceptions and learning via discussion prompts. A conceptual framework on effective implementations of discussion prompts was suggested

Using Technology to Develop Preservice Teachers\u27 Reflective Thinking

Developing high-level reflection skills proves troublesome for some preservice teachers. To examine the potential of an online environment for increasing productive reflection, students in three sequential undergraduate education classes responded to regular online prompts. We coded student comments for productive and unproductive reflection, knowledge integration, and analysis of the four aspects of teaching (learners and learning, subject matter knowledge, assessment and instruction ) as described by Davis, Bain, & Harrington (2001). We adapted a scoring approach recommended by Davis & Linn, (2000); Davis (2003) to analyze what aspects of teaching preservice teachers included, emphasized, and integrated when they reflected on their own beliefs about teaching. Discussion examines the utility of online environments for producing productive preservice teacher reflection

A Meta-Analysis of Self-Regulated Learning Interventions and Learning Outcomes in Higher Education E-Learning Environments

Through a systematic review of the literature, 36 empirical studies regarding self-regulated learning (SRL) interventions and learning outcomes in higher education e-learning environments were identified and meta-analyzed using15 years of data. Frequently studied interventions included providing SRL scaffolding, SRL training, or SRL training and scaffolding either as a precursor or as part of the learning environment or both. Scaffolding interventions were embedded as part of the learning environment and designed to guide learners to perform cognitive and metacognitive strategies such as task analysis, goal setting, and reflection during a learning activity. Training interventions, by contrast, involved instruction in the use of SRL strategies prior to beginning a learning activity, course or program. In some studies, both training and scaffolding SRL interventions were implemented. Information about the types of SRLinterventions including the means of measuring learning outcomes (more or less complex), instructional design characteristics and learning outcomes data for calculating effect sizes were extracted for the purposes of conducting this meta-analysis

MASELTOV Deliverable Report 7.2: Feedback and Progress Indicators

This document explores the range of feedback and progress indicators (FPIs) that can be used to support incidental, mobile learning for the target MASELTOV audience, recent immigrants to the EU. We propose that feedback, and progress indicators (we differentiate between the two) should play an instrumental role in helping learners reflect upon individual, often isolated learning episodes mediated by single MASELTOV services, and enable them to reconceive them as constituting elements of a coherent, larger learning journey. The goal of feedback and progress indicators is to support the motivation for learning and from this the social inclusion of recent immigrants. Our underpinning assumption is that the MASELTOV software designers’ goal should be to encourage not just resolution of immediate challenges (e.g. finding a doctor, translating a sign) but a user’s reflection on their continuing progress towards integration into the host country, including improving their language skills. We define feedback as responses to a learner’s performance against criteria of quality and as a means of directing and encouraging the learner; and progress indicators as responses indicating the current position of a learner within a larger activity or journey (often related to time). Drawing partly from the worlds of web-based language learning and video games, we identify which feedback and progress indicators may best support incidental mobile learning, and the major challenges faced. For some MASELTOV services, feedback and progress indicators for large scale learning journeys are less apparent (e.g. TextLens, the MASELTOV tool that enables a user to take a photo of a sign and convert the image into text, potentially for future viewing or translation), while some services are explicitly educational (e.g. language lessons). However we see all of these as potentially part of an ecology of services that can support social inclusion, so all tools should include FPIs that encourage broader learning goals. In this document we draw on the Common European Framework of Reference for Languages as appropriate, and also reflect on learner perspectives (derived from WP2 and WP9 findings) to identify suitable FPIs, as well as being informed by academic literature. Furthermore, we recommend FPIs that would be suitable for the MASELTOV tools and services. The remainder of the deliverable handles the four identified key areas where mobile incidental learning particularly requires FPIs: 1. encouraging reflection 2. future goal setting 3. planning 4. social learning It should be noted that this document is a high level review, identifying significant literature and key examples of FPIs in practice. This document offers recommendations therefore in general terms. Decisions about specific FPIs to be implemented will be made in coordination with technical partners to identify which MASELTOV services and tools will support which specific feedback and progress indicators, and how they will be implemented within the system

Self-Regulated Learning in a Pandemic: Implementing the SEE Framework in an Online Teaching Environment

Self-regulated learning (SRL) is a cyclical process that motivates students and facilitates achievement in a variety of domains (Wang, 2013). It entails several processes, such as planning, setting goals, using learning strategies, self-monitoring, reflecting, and holding adaptive motivational beliefs. Moreover, SRL can be developed through interventions and classroom practices. However, there is a shortage of trained interventionists. Teachers can also use a variety of classroom practices to develop students’ SRL skills. A framework of practices, known as the Settings, Events, and Exchanges (SEE) framework, was developed to organize these classroom practices for teachers (Callan et al., 2020). The practices in this framework include (a) the creation of a setting that is conducive to SRL, (b) student-teacher exchanges that facilitate the development of SRL, and (c) events that allow students the chance to reflect on their learning. Specifically, teachers can foster effective learning settings by developing supportive student-teacher relationships, implementing routines and clear participation structures, providing collaborative learning opportunities, and encouraging the use of adaptive help-seeking strategies. Exchanges that support SRL include the use of explicit instructions, modeling, SRL feedback, prompts, and connections made between the use of SRL strategies and academic success. Finally, events that can facilitate SRL include multiple opportunities to succeed, long-term learning opportunities, tasks that are both at an appropriate challenge level as well as supportive of student autonomy, self-assessment, peer co-learning, and the use of SRL worksheets (Callan et al., 2020). The SEE framework was developed to support SRL development in traditional, in person classrooms. In light of the fact that online learning elicits a greater need for SRL, the purpose of this presentation is to examine which SEE framework practices do and do not have empirical support within online learning environments. Doing so provides practical support for teachers and identifies research gaps for researchers

The Use of Reflective Questioning as a Peer Coaching Strategy in an Asynchronous Online Cognitive Apprenticeship

The cognitive apprenticeship framework melds situated, authentic learning with social learning theory. The learning strategies included in a cognitive apprenticeship are modeling, coaching, scaffolding, articulation, reflection, and exploration. Previous research indicates that the most beneficial strategy for the learner is coaching, and is also the most time-consuming strategy for the instructor. However, no previous research has been conducted to determine which coaching strategies can be utilized in order to lessen the burden on the instructor, while being beneficial to the learner. The purpose of this study was to explore the use of guided reflective questions as a strategy for enhancing cognitive presence in peer dyad groups. These dyads were created in order to provide a platform for peer coaching in an online, asynchronous professional development course designed using the cognitive apprenticeship framework for the professional development of professional programming librarians and paraprofessional programmers. The current study found a significant difference in cognitive presence levels between the control and treatment groups, and no significant difference in learning outcomes between the two groups. Additionally, the study highlighted the challenges faced by participants, such as lack of time to devote to professional development and lack of peer engagement from their peer coach. Participants also valued the fresh perspectives that they experienced during peer interactions and the availability of resources that were provided during the course. Discussion of the results highlights constraints, limitations, challenges, and positive aspects of participation in an asynchronous online cognitive apprenticeship. Discussion of the results also sheds light on questions worthy of future research in order to develop best practices for the use of cognitive apprenticeships in professional development and online contexts

Feedback is a gift: Do Video-enhanced rubrics result in providing better peer feedback than textual rubrics?

High-quality elaborative peer feedback is a blessing for both learners and teachers. However, learners can experience difficulties in giving high-quality feedback on complex skills using textual analytic rubrics. High-quality elaborative feedback can be strengthened by adding video-modeling examples with embedded self-explanation prompts, turning textual analytic rubrics (TR) into so-called \u27video-enhanced analytic rubrics\u27 (VER). This study contrasts two experimental conditions (TR, n = 54; VERs, n = 49) with their version of the anonymized online tool (used to collect the given feedback in \u27Tips for improvement and Tops identifying strengths\u27). Peer feedback quality (concreteness and consistency) was evaluated using Natural Language Processing. As expected, the video-enhanced rubrics condition resulted in a higher quantity of words used and a lower amount of naive wording compared to the textual rubric condition. Contrary to our assumptions, it did not lower the amount of non-constructive wording nor improved the amount of behavioral and process-related feedback. Possibly, the transition from providing more feedback to delivering more accurate behavioral and process-related feedback has not yet been made in the time set for the study