Training Effects of Adaptive Emotive Responses From Animated Agents in Simulated Environments

Humans are distinct from machines in their capacity to emote, stimulate, and express emotions. Because emotions play such an important role in human interactions, human-like agents used in pedagogical roles for simulation-based training should properly reflect emotions. Currently, research concerning the development of this type of agent focuses on basic agent interface characteristics, as well as character building qualities. However, human-like agents should provide emotion-like qualities that are clearly expressed, properly synchronized, and that simulate complex, real-time interactions through adaptive emotion systems. The research conducted for this dissertation was a quantitative investigation using 3 (within) x 2 (between) x 3 (within) factorial design. A total of 56 paid participants consented to complete the study. Independent variables included emotion intensity (i.e., low, moderate, and high emotion), levels of expertise (novice participant versus experienced participant), and number of trials. Dependent measures included visual attention, emotional response towards the animated agents, simulation performance score, and learners\u27 perception of the pedagogical agent persona while participants interacted with a pain assessment and management simulation. While no relationships were indicated between the levels of emotion intensity portrayed by the animated agents and the participants\u27 visual attention, emotional response towards the animated agent, and simulation performance score, there were significant relationships between the level of expertise of the participant and the visual attention, emotional responses, and performance outcomes. The results indicated that nursing students had higher visual attention during their interaction with the animated agents. Additionally, nursing students expressed more neutral facial expression whereas experienced nurses expressed more emotional facial expressions towards the animated agents. The results of the simulation performance scores indicated that nursing students obtained higher performance scores in the pain assessment and management task than experienced nurses. Both groups of participants had a positive perception of the animated agents persona

Investigating the impact of pedagogical agent gender matching and learner choice on learning outcomes and perceptions

abstract: The similarity attraction hypothesis posits that humans are drawn toward others who behave and appear similar to themselves. Two experiments examined this hypothesis with middle-school students learning electrical circuit analysis in a computer-based environment with an Animated Pedagogical Agent (APA). Experiment 1 was designed to determine whether matching the gender of the APA to the student has a positive impact on learning outcomes or student perceptions. One hundred ninety-seven middle-school students learned with the computer-based environment using an APA that matched their gender or one which was opposite in gender. Female students reported higher program ratings when the APA matched their gender. Male students, on the other hand, reported higher program ratings than females when the APA did not match their gender. Experiment 2 systematically tested the impact of providing learners the choice among four APAs on learning outcomes and student perceptions. Three hundred thirty-four middle-school students received either a pre-assigned random APA or were free to choose from four APA options: young male agent, older male agent, young female agent, or older female agent. Learners had higher far transfer scores when provided a choice of animated agent, but student perceptions were not impacted by having the ability to make this choice. We suggest that offering students learner control positively impacts student motivation and learning by increasing student perceptions of autonomy, responsibility for the success of the instructional materials, and global satisfaction with the design of materials.NOTICE: this is the author’s version of a work that was accepted for publication in COMPUTERS & EDUCATION. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in COMPUTERS & EDUCATION Volume 67, September 2013, Pages 36–50 http://dx.doi.org/10.1016/j.compedu.2013.02.00

Modeling Student Affective State Patterns during Self-Regulated Learning in Physics Playground

This dissertation research focuses on investigating the incidence of student self-regulated learning behavior, and examines patterns in student affective states that accompany such self-regulated behavior. This dissertation leverages prediction models of student affective states in the Physics Playground educational game platform to identify common patterns in student affective states during use of self-regulated learning behavior. In Study 1, prediction models of student affective states are developed in the context of the educational game environment Physics Playground, using affective state observations and computer log data that had already been collected as part of a larger project. The performances of student affective state prediction models generated using a combination of the computer log and observational data are then compared against those of similar prediction models generated using video data collected at the same time. In Study 2, I apply these affective state prediction models to generate predictions of student affective states on a broader set of data collected from students participants playing Physics Playground. In parallel, I define aggregated behavioral features that represent the self-observation and strategic planning components of self-regulated learning. Affective state predictions are then mapped to playground level attempts that contain these self-regulated learning behavioral features, and sequential pattern mining is applied to the affective state predictions to identify the most common patterns in student emotions. Findings from Study 1 demonstrate that both video data and interaction log data can be used to predict student affective states with significant accuracy. Since the video data is a direct measure of student emotions, it shows better performance across most affective states. However, the interaction log data can be collected natively by Physics Playground and is able to be generalized more easily to other learning environments. Findings from Study 2 suggest that self-regulatory behavior is closely associated with sustained periods of engaged concentration and .self-regulated learning behaviors are associated with transitions from negative affective states (confusion, frustration, and boredom) to the positive engaged concentration state. The results of this dissertation project demonstrate the power of measuring student affective states in real time and examining the temporal relationship to self-regulated learning behavior within an unstructured educational game platform. These results thus provide a building block for future research on the real-time assessment of student emotions and its relationship with self-regulated learning behaviors, particularly within online student-centered and self-directed learning contexts

The effects of problem-based learning scaffolds on cognitive load, problem-solving, and student performance within a multimedia-enhanced learning environment

textLearners who are novice problem solvers often encounter difficulty when solving complex problems. One explanation for this difficulty is that the cognitive requirements of problem-solving are sufficiently high that learners easily become overwhelmed and frustrated, leading to a state known as cognitive overload in which learning is obstructed. Cognitive Load Theory is concerned with the design of instructional approaches intended to manage the cognitive load required for thinking and problem-solving tasks. Scaffolds are any kind of support that facilitates the accomplishment of a difficult task that a learner would not be able to accomplish on their own. They are potential mechanisms to support students in negotiating the potentially high cognitive load required by complex problem-solving. The purpose of this study was to examine the effects of technology-based scaffolds within a problem-based learning environment known as Alien Rescue. The study investigated the impact of scaffolds on cognitive load, problem-solving behaviors, science knowledge, and student perceptions of the learning environment. Participants for this study included sixth grade students from a suburban middle school in the southwestern United States. Student classes were assigned to one of three treatment conditions: (a) a problem constraint condition in which students were guided through a problem-solving process similar to that of an expert, (b) a prompt condition in which students were provided with guiding messages during problem-solving, and (c) a control condition with no scaffolding. All conditions participated in the use of Alien Rescue for three weeks. Measures including a self-report measure of mental effort, calculated instructional efficiency scores, problem solution scores, student activity logs, and science knowledge test performance were used to evaluate students' cognitive load, problem-solving performance, problem-solving strategies, and learning gains. An open-ended questionnaire and student interviews were used to gather data on students' perceptions of the program. Results of the study indicate statistically significant differences between treatment conditions with respect to problem-solving efficiency, student problem-solving behaviors, and scientific knowledge gain. Additionally, qualitative findings highlight problematic aspects of the highly structured condition as implemented within the classroom context while also identifying components of the learning environment that were perceived as helpful and useful to participants. Teacher interviews also provided insight into classroom implementation of the program and opportunities to further enhance scaffolds to support student learning. Implications of the study from research, instructional design, and technology perspectives are discussed along with a treatment of study limitations and opportunities for further research in this area.Curriculum and Instructio

The role of eye contact in promoting effective learning in natural science in the secondary school

The study explores the role of eye contact in promoting effective learning in natural science in the secondary school using eye-tracking technology. A theoretical framework constituting the theories of Vygotsky, Piaget and Bandura inform the study. In the empirical inquiry in this study a purposefully selected group of eleven Grade 9-learners of mixed ability were eye-tracked by means of the Tobii 60 X-2 eye-tracker during individual viewings of a video-recording of a natural science lesson taught by the educator using a PowerPoint presentation. The Tobii 60 X-2 eyetracker establishes how a learner pays attention to information presented through educator narration, visuals and texts during teaching and learning. The findings indicate that, as the learners’ areas of interest, their highest total fixation duration was firstly on the PowerPoint presentation, and secondly on the educator. Under-performing natural science learners showed shorter and less dense fixation in both areas of interest.Science and Technology EducationM. Ed. (Natural Science Education

Productive Failure in Virtual Language Learning for English

Vocabulary and syntax are challenges for English as Foreign Language (EFL) learners when they want to communicate in English. Task-based Language Teaching is commonly used in EFL teaching of vocabulary and syntax, which is a type of Direct Instruction (DI) that involves the initial use of explicit language instruction followed by a language learning activity. This study compared the efficacy for language learning of a different type of pedagogical approach, Productive Failure (PF), which delays instruction until after a language learning activity, to Direct Instruction (DI). There were three main language learning assessment areas: (a) students' declarative and procedural knowledge in the written production of the target language, (b) students' declarative and procedural knowledge in the spoken production of the target language, and (c) students' cognitive and metacognitive strategies in learning. English language education department freshmen in an Indonesian university (N=112) participated in the study by performing language learning activities in Second Life (SL), which is a 3-D virtual learning environment. They were randomly assigned to two language learning treatment groups. The PF group finished a communicative task on describing places prior to receiving explicit instruction. In contrast, the DI group watched an instructional video before completing a communicative task on describing places. This was followed by students in both groups finishing a similar communicative task in SL. Data from pre-and post-tests were analysed quantitatively, and video captures were transcribed and analysed qualitatively. The quantitative results found that PF group students performed significantly higher on the English syntax written assessment and both groups performed equally on the written vocabulary assessment. However, both groups performed equally on the spoken assessments of syntax and vocabulary. In the qualitative analysis, the PF students were found to use more self-regulated learning strategies and study tactics than DI students. The pattern of these findings is discussed in terms of previous research and theory. Overall, these findings suggest further research is warranted to investigate the use of PF language learning activities that involve the use of a virtual learning environment

Investigating the Influence of Subgoals on Learning During Search

Search-as-learning research has emphasized the need to better support searchers when learning about complex topics online. Prior work in the learning sciences has shown that effective self-regulated learning (SRL), in which goals are a central function, is critical to improving learning outcomes. This dissertation investigates the influence of subgoals on learning during search. Two conditions were investigated: Subgoals and NoSubgoals. In the Subgoals condition, a tool called the Subgoal Manager was used to help searchers to develop specific subgoals associated with an overall learning-oriented search task. The influence of subgoals is explored along four dimensions: (1) learning outcomes; (2) searcher perceptions; (3) search behaviors; and (4) SRL processes. Learning outcomes were measured with two assessments, an established multiple-choice conceptual knowledge test and an open-ended summary of learning. Learning assessments were administered immediately after search and one week after search to capture learning retention. A qualitative analysis was conducted to identify the percentage of true statements on open-ended learning assessments. A think-aloud protocol was used to capture SRL processes. A second qualitative analysis was conducted to categorize SRL processes from think-aloud comments and behaviors during the search session. Findings from the dissertation suggest that subgoals improved learning during search. Additionally, it seems that subgoals helped participants to better retain what was learned one week later. Findings also suggest that SRL processes of participants in the Subgoals condition were more frequent and more diverse. SRL processes that were explicitly supported by the Subgoal Manager seemed to be more frequent in the Subgoals condition as well as SRL processes that were not explicitly supported.Doctor of Philosoph