Let's Set Up Some Subgoals: Understanding Human-Pedagogical Agent Collaborations and Their Implications for Learning and Prompt and Feedback Compliance

International audienceResearch on collaborative learning between humans and virtual pedagogical agents represents a necessary extension to recent research on the conceptual, theoretical, methodological, analytical, and educational issues behind co-and socially-shared regulated learning between humans. This study presents a novel coding framework that was developed and used to describe collaborations between learners and a pedagogical agent (PA) during a subgoal setting activity with MetaTutor, an intelligent tutoring system. Learner-PA interactions were examined across two scaffolding conditions: prompt and feedback (PF), and control. Learners' compliance to follow the PA's prompts and feedback in the PF condition were also examined. Results demonstrated that learners followed the PA's prompts and feedback to help them set more appropriate subgoals for their learning session the majority of the time. Descriptive statistics revealed that when subgoals were set collaboratively between learners and the PA, they generally lead to higher proportional learning gains when compared to less collaboratively set goals. Taken together, the results provide preliminary evidence that learners are both willing to engage in and benefit from collaborative interactions with PAs when immediate, directional feedback and the opportunity to try again are provided. Implications and future directions for extending co-and socially-shared regulated learning theories to include learner-PA interactions are proposed

Reflection-in-Action Markers for Reflection-on-Action in Computer-Supported Collaborative Learning Settings

International audienceWe describe an exploratory study on the use of markers set during a synchronous collaborative interaction (reflection-in-action) for later construction of reflection reports upon the collaboration that occurred (reflection-on-action). During two sessions, pairs of students used the Visu videoconferencing tool for synchronous interaction and marker setting (positive, negative or free) and then individual report building on the interaction (using markers or not). A quantitative descriptive analysis was conducted on the markers put in action, on their use to reflect on action and on the reflection categories of the sentences in these reports. Results show that the students (1) used the markers equally as a note-taking and reflection means during the interaction, (2) used mainly positive markers both to reflect in and on action; (3) paid more attention in identifying what worked in their interaction (conservative direction) rather than in planning on how to improve their group work (progressive direction); (4) used mainly their own markers to reflect on action, with an increase in the use of their partners' markers in the second reflection reports; (5) reflected mainly on their partner in the first reflection reports and more on themselves in the second reports to justify themselves and to express their satisfaction

Possible approaches to personalisation at Cass Business School

This report discusses the result of an investigation into the personalisation of learning and how it could be applied in a university with primarily face-to-face instruction, and, a diverse student body

Effects of Metacognitive Monitoring on Academic Achievement in an Ill-Structured Problem-Solving Environment

Higher education courses are increasingly moving online while educational approaches are concurrently shifting their focus toward student-centered approaches to learning. These approaches promote critical thinking by asking students to solve a range of ill-structured problems that exist in the real world. Researchers have found that student-centered online learning environments require students to have self-regulated learning skills, including metacognitive skills to regulate their own learning processes. Much of the research suggests that externally supporting students while they are learning online, either directly or indirectly, helps them to succeed academically. However, few empirical studies have investigated what levels of support are most effective for promoting students\u27 self-regulated learning behaviors. Additionally, these studies reported conflicting results – some found maximum support to be most effective while others found no significant difference. The purpose of this study was to investigate the effectiveness of different levels of support for self-regulated learning during a complex learning activity to solve an ill-structured problem-solving situation in an online learning environment. In addition, the role of students\u27 self-efficacy on their academic achievement was examined. A total of 101 undergraduate students from three international studies courses offered at a large urban Southeastern public university in the United States participated in the study. The students were randomly assigned to treatment (minimum support, maximum support) and control groups. Students\u27 academic achievement scores were measured using a conceptual knowledge test created by the professor teaching the courses. O\u27Neil\u27s (1997) Trait Self-Regulation Questionnaire measured students\u27 self-efficacy. Analysis of Co-Variance (ANCOVA) was conducted to analyze the data. The ANCOVA results indicated significant improvement of the academic achievement of the minimum support group versus both the maximum support and control groups. Additionally, self-efficacy as a co-variable did not significantly impact students\u27 achievement scores in any of the groups. The overall results indicated that it is important to consider the level of self-regulated learning support when designing online learning environments promoting students\u27 critical thinking skills. Promoting students\u27 self-regulated learning skills is vital when designing online higher education courses

The effects of problem-based learning scaffolds on cognitive load, problem-solving, and student performance within a multimedia-enhanced learning environment

textLearners who are novice problem solvers often encounter difficulty when solving complex problems. One explanation for this difficulty is that the cognitive requirements of problem-solving are sufficiently high that learners easily become overwhelmed and frustrated, leading to a state known as cognitive overload in which learning is obstructed. Cognitive Load Theory is concerned with the design of instructional approaches intended to manage the cognitive load required for thinking and problem-solving tasks. Scaffolds are any kind of support that facilitates the accomplishment of a difficult task that a learner would not be able to accomplish on their own. They are potential mechanisms to support students in negotiating the potentially high cognitive load required by complex problem-solving. The purpose of this study was to examine the effects of technology-based scaffolds within a problem-based learning environment known as Alien Rescue. The study investigated the impact of scaffolds on cognitive load, problem-solving behaviors, science knowledge, and student perceptions of the learning environment. Participants for this study included sixth grade students from a suburban middle school in the southwestern United States. Student classes were assigned to one of three treatment conditions: (a) a problem constraint condition in which students were guided through a problem-solving process similar to that of an expert, (b) a prompt condition in which students were provided with guiding messages during problem-solving, and (c) a control condition with no scaffolding. All conditions participated in the use of Alien Rescue for three weeks. Measures including a self-report measure of mental effort, calculated instructional efficiency scores, problem solution scores, student activity logs, and science knowledge test performance were used to evaluate students' cognitive load, problem-solving performance, problem-solving strategies, and learning gains. An open-ended questionnaire and student interviews were used to gather data on students' perceptions of the program. Results of the study indicate statistically significant differences between treatment conditions with respect to problem-solving efficiency, student problem-solving behaviors, and scientific knowledge gain. Additionally, qualitative findings highlight problematic aspects of the highly structured condition as implemented within the classroom context while also identifying components of the learning environment that were perceived as helpful and useful to participants. Teacher interviews also provided insight into classroom implementation of the program and opportunities to further enhance scaffolds to support student learning. Implications of the study from research, instructional design, and technology perspectives are discussed along with a treatment of study limitations and opportunities for further research in this area.Curriculum and Instructio

Development of Self-Regulated Learning Skills Within Open-Ended Computer-Based Learning Environments for Science

Over the past decade, open-ended computer-based learning environments have been increasingly used to facilitate students’ learning of complex scientific topics. The non-linearity and open-endedness of these environments create learning opportunities for students, but can also impose challenges in terms of extraneous cognitive load and greater requirements for self-regulated learning (SRL). SRL is crucial for academic success in various educational settings. This dissertation explores how self-regulatory skills develop and the role of gender in the development of SRL skills in Virtual Performance Assessments (VPA), an immersive, open-ended virtual environment designed to assess middle school students’ science inquiry skills. Findings from three analyses combining educational data mining techniques with multilevel modeling indicated that students developed self-regulatory behaviors and strategies as they used VPA. For example, experience with VPA prepared students to adopt more efficient note-taking and note-reviewing strategies. Students who used VPA for the second time engaged in note-taking more frequently, noted a significantly higher quantity of unique information, used the control of variables strategy more frequently in note-taking, and reproduced more domain-specific declarative information in notes than students who used VPA for the first time, all of which have been found to be positively associated with science inquiry performance. Students also learned to exploit more available sources of information by applying learning strategies, in order to either solve inquiry problems, or to monitor and evaluate their solutions. Compared to the second-time users who focused primarily on answering the core inquiry question and selectively collected data, the first-time users’ behaviors showed the repetition and combination of exploratory actions such as talking with non-player characters and collecting data. In addition, consistent gender differences in SRL were observed in this study. Female students were more likely to take notes than male students; they took notes and reviewed notes more frequently and recorded a higher quantity of information in notes, especially information from the research kiosk. Females were also more likely to review notes or read research pages to assist them with the problem-solving and decision-making process than their male counterparts. Possibly due to the higher quantity of information recorded by female note-takers and their tendency to review notes over males, female students’ performance on science inquiry tasks improved across the course of using the two scenarios of VPA, whereas the male students’ science inquiry skills did not show improvement. Results from this dissertation study provide insights into the instructional design of personalized open-ended learning environments to facilitate self-regulated learning for both male and female students

AN INVESTIGATION OF THE IMPACT OF METACOGNITIVE PROMPTS, AS FACILATED BY THE EFAP-SRL MODEL, ON ACHIEVEMENT ON THE END |OF UNIT MATH TEST AMONG 8th GRADE GIRLS IN QATAR PREPARATORY SCHOOLS.

The aim of the present study is to investigate the impact of using metacognitive prompts as facilitated by the Enhanced Formative Assessment with Self-Regulated Learning (EFAP-SRL) model on students’ achievement on the end of unit Math assessment among 8th grade girls. The study was conducted at two schools over a two-month period; each school had a control group and a treatment group (N=113). Students from the treatment group received quizzes with built-in metacognitive prompts, while students from the control group received quizzes not containing metacognitive prompts. Teachers in the treatment group received three training sessions on how to use the EFAP-SRL model; the researcher received training sessions given by a specialist in SRL in College of Medicine in Qatar. The results showed no significant difference on the end of unit assessment scores between the control groups and treatment groups; furthermore, assessment scores from all four groups were skewed. The results of the study suggest a need for summative assessments to be constructed using an item bank of good quality test items. Additionally, the study suggests that a replication study using metacognitive prompts over a longer period of time is needed to determine a possible impact

The role of eye contact in promoting effective learning in natural science in the secondary school

The study explores the role of eye contact in promoting effective learning in natural science in the secondary school using eye-tracking technology. A theoretical framework constituting the theories of Vygotsky, Piaget and Bandura inform the study. In the empirical inquiry in this study a purposefully selected group of eleven Grade 9-learners of mixed ability were eye-tracked by means of the Tobii 60 X-2 eye-tracker during individual viewings of a video-recording of a natural science lesson taught by the educator using a PowerPoint presentation. The Tobii 60 X-2 eyetracker establishes how a learner pays attention to information presented through educator narration, visuals and texts during teaching and learning. The findings indicate that, as the learners’ areas of interest, their highest total fixation duration was firstly on the PowerPoint presentation, and secondly on the educator. Under-performing natural science learners showed shorter and less dense fixation in both areas of interest.Science and Technology EducationM. Ed. (Natural Science Education