Investigating the impact of pedagogical agent gender matching and learner choice on learning outcomes and perceptions

abstract: The similarity attraction hypothesis posits that humans are drawn toward others who behave and appear similar to themselves. Two experiments examined this hypothesis with middle-school students learning electrical circuit analysis in a computer-based environment with an Animated Pedagogical Agent (APA). Experiment 1 was designed to determine whether matching the gender of the APA to the student has a positive impact on learning outcomes or student perceptions. One hundred ninety-seven middle-school students learned with the computer-based environment using an APA that matched their gender or one which was opposite in gender. Female students reported higher program ratings when the APA matched their gender. Male students, on the other hand, reported higher program ratings than females when the APA did not match their gender. Experiment 2 systematically tested the impact of providing learners the choice among four APAs on learning outcomes and student perceptions. Three hundred thirty-four middle-school students received either a pre-assigned random APA or were free to choose from four APA options: young male agent, older male agent, young female agent, or older female agent. Learners had higher far transfer scores when provided a choice of animated agent, but student perceptions were not impacted by having the ability to make this choice. We suggest that offering students learner control positively impacts student motivation and learning by increasing student perceptions of autonomy, responsibility for the success of the instructional materials, and global satisfaction with the design of materials.NOTICE: this is the author’s version of a work that was accepted for publication in COMPUTERS & EDUCATION. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in COMPUTERS & EDUCATION Volume 67, September 2013, Pages 36–50 http://dx.doi.org/10.1016/j.compedu.2013.02.00

Animated pedagogical agents effects on enhancing student motivation and learning in a science inquiry learning environment

This study focuses on the design and testing of a motivational animated pedagogical agent (APA) in an inquiry learning environment on kinematics. The aim of including the APA was to enhance students’ perceptions of task relevance and self-efficacy. Given the under-representation of girls in science classrooms, special attention was given to designing an APA that would appeal to the female students. A review of the literature suggested that the best design solution would be an agent who was female, young, attractive, and “cool”. An experiment compared three conditions: agent (image and voice), voice (no image), and control (no image and no voice). The research question was whether students’ motivation and knowledge changed over time as they worked in the inquiry learning environment, and whether condition and gender affected such changes. Participants were 61 third-year students (mean age 14.7 years) from a secondary school. Gender was distributed evenly within and across conditions. A significant main effect of time on self-efficacy was found, with self-efficacy beliefs increasing significantly for both boys and girls. In addition, there was a significant interaction between time, condition, and gender for self-efficacy. About halfway during training, girls’ self-efficacy beliefs significantly increased in both experimental conditions and decreased in the control condition. For boys the opposite pattern was found. Girls also gave higher appraisals for the agent. Students in all three conditions realized significant knowledge gains, which did not differ by gender. The discussion critically considers the need for, and design of motivational scaffolding in inquiry learning environment

'It's Almost Like Talking to a Person': Student Disclosure to Pedagogical Agents in Sensitive Setting

Online chatbots (also known as pedagogical agents or virtual assistants) are becoming embedded into the fabric of technology, both in educational and commercial settings. Yet understanding of these technologies is inchoate and often untheorised, influenced by individuals’ willingness to trust technologies, aesthetic appearance of the chatbot and technical literacy, among other factors. This paper draws upon data from two research studies that evaluated students’ experiences of using pedagogical agents in education using responsive evaluation. The findings suggest that emotional connections with pedagogical agents were intrinsic to the user’s sense of trust and therefore likely to affect levels of truthfulness and engagement. They also indicate that the topic of the pedagogical agent-student interaction is key to the student’s experience. The implications of these studies are that truthfulness, personalisation and emotional engagement are all vital components in using pedagogical agents to enhance online learning

Interactions Between Patterns of Gamer Behaviors and Time-on-Task for Mathematics Remediation in a Game-based HIVE

As the presence of digital game-based learning increases in United States classrooms, understanding their impact on achievement is critical. Digital games for learning offer many potential benefits, including reducing the number of students trapped in a remediation cycle, a contributor to college dropout. Despite the recognized potential of game-based learning, few researchers have explored the relationships between specific patterns of behaviors and types of digital game-based learning environments. The underlying theory for this study was patterns of gamer behaviors may predict in-game behaviors. Archival, third-party data regarding The Lost Function - Episode 1: Sum of the Forgotten Minds by Advanced Training & Learning Technology, LLC was used in this study. Using 4 case groups at the high school and college levels (n=114), self-reported levels of the 3 patterns of gamer behaviors, gender, and age-band were analyzed using multiple regression to determine relationships to time-on-task in a game-based highly interactive virtual environment, designed for mathematics remediation. While the results were inconclusive, this study supported the existing literature regarding gender differences and the lack of mutual exclusivity in behavior typing. Recommendations include additional research in how the statements used in the 3-factor model may be adjusted to allow for a broader population of game players. The social change implication is that further understanding of the relationship between learner traits and digital learning environment may assist educators that employ digital game-based learning a way to better align learners to the most appropriate digital learning environment, thereby increases their chances at success

The Effect of Pedagogical Agent Persona on Performance, Self-Efficacy, and Attitudes in Adult Learners in an Online Environment

Pedagogical agents, virtual avatars that are often included in online training or educational modules, have been studied in a variety of disciplines to determine the extent to which their inclusion in online or multimedia learning environments may influence both cognitive and affective outcomes in learners. The present study examined the effect of a peer-like pedagogical agent providing motivational messaging in an online English language learning environment to determine if the agent will positively affect college students’ performance, self-efficacy, and attitude in comparison to a control group. All participants studied an online, self-paced English grammar module, either with (treatment version) or without (control version) a peer-like motivating pedagogical agent. The study also sought to determine if learners would perceive the agent as having a distinct persona. The study found no statistically significant difference between the treatment group and the control group on performance, self-efficacy, and attitude. However, for both the treatment group and the control group, student performance and self-efficacy were significantly improved after the online English module. In addition, the participants perceived the agent as having a distinct persona

Digital Assistants for Self-Regulated Learning: Towards a State-Of-The-Art Overview

We observe a continuous shift from face-to-face to hybrid or online education. Today, learners are exposed to a high level of autonomy and, at the same time, have less contact with peers and teachers. In this environment, the ability to self-regulate one’s learning is becoming more relevant to achieve positive learning results and academic success. However, the application of self-regulated learning is not trivial. A potential solution for this challenge comes in the form of digital assistants like chatbots or pedagogical agents that provide structure for the learners. Existing research on digital assistants for self-regulated learning is scattered across several fields. In this research-in-progress paper, we present preliminary results of a systematic literature review (SLR) study providing an overview of the state-of- the-art of digital assistants supporting SRL. Our results show that future research in this domain should focus on affect, behavioral, and context regulation and more longitudinal studies are required

Learning designs incorporating animated pedagogical agents: Their potential for improving academic writing competence, writing self-efficacy, and reducing writing anxiety

Academic writing can be extremely challenging, especially for new university students. This is compounded by the mass-migration of courses to online delivery, which further increases the complexity of acquiring writing skills. Animated pedagogical agents (APAs) have shown promise in addressing these problems, because they simulate authentic face-to-face social interactions thereby potentially increasing student engagement, motivation, and favourable emotions conducive to learning. This study’s first aim was to examine the impact of learning designs employing APAs on novice learners’ academic writing, writing anxiety, and writing self-efficacy. Its second aim was to examine the influence of various delivery options (didactic delivery or scaffolded questioning) with support messages (emotional, motivational or neither) on writing competence, writing anxiety and writing self-efficacy. These aims were achieved in a mixed-method study that included six experimental conditions tested using two multimedia academic writing lessons provided to 106 participants who were new to Australian tertiary studies. Quantitative data were collected immediately before and after the lessons (Phase 1), while qualitative data were obtained by interviews with a subset of participants after Lesson 2 (Phase 2). The impact of the independent variable combinations on the dependent variables were examined quantitatively (General Linear Modelling, t-tests) and qualitatively (thematic analysis). The results demonstrate that completing two academic writing lessons with APAs can increase writing competence and self-efficacy, and reduce writing anxiety. However, no significant differences were found between the support and delivery groups. Despite the lack of significant inter-group differences, more participants from the emotional group reported that their negative emotions were reduced because of the lesson. Also, all the participants in the motivational group reported perceptions of writing improvement as a result of attending the lessons. The overall positive result suggests promising possibilities for writing support delivered online to counter student under preparedness for academic writing

Supplemental Instruction in First-Year Chemistry Courses: Efficacy and Gender Balance

Increasing student success and retention rates are top goals for many higher education institutions. Supplemental Instruction (SI) is a widely used academic support program designed to increase students’ academic performance and provide students the learning skills they need to persist to graduation. Unfortunately, a lack of time, personnel, and resources often prevent in-depth, meaningful analysis on the effectiveness of SI programs. This study examined the relationship of attending SI sessions for first-year chemistry courses to student grade outcomes and retention rates for attendees. The gender of SI leaders and SI participants was also assessed to determine if leader and participant gender were related to SI attendance, final course grades, or retention. The results indicated that students who attended SI earned significantly higher final course grades and were retained at significantly higher rates after one and two terms. A positive correlation was discovered between the number of SI sessions attended and final course grades. Significant differences in final grades were demonstrated between students who attended SI and those who did not at all levels of composite ACT scores. Both male and female students showed a preference for gender-matching with their SI leader, but students who attended SI sessions with both male and female SI leaders earned higher final course grades than students who gender-matched with their SI leader and students who only attended SI sessions with an SI leader whose gender differed from their own. No significant differences were found between male and female students for final course grades or retention outcomes