Invisible Intelligent Authoring Tools

Imagine that you, an expert in technology and in the learning sciences, have decided to help your colleagues pass on their expertise to others by helping them build intelligent tutors systems (ITSs). Your expert colleagues can be in only one place at a time, and an ITS would multiply the impact of their expertise better than an online video, since an ITS can personalize the instruction. ITSs have demonstrated significant learning gains in a variety of disciplines, after all (Anderson, 1989; Koedinger, 1997; Lesgold, Lajoie, Bunzo & Eggan, 1992; Ritter, Kulikowich, Lei, McGuire & Morgan, 2007; VanLehn, et al., 2005), so this approach makes sense

Characteristics of a Multi-User Tutoring Architecture

Intelligent tutor systems have been quite successful in instruction of individuals (Koedinger, Anderson, Hadley, & Mark, 1997; Ritter, Kulikowich, Lei, McGuire, & Morgan, 2007; Vanlehn, et al., 2005), but multiple challenges exist when attempting to tutor a team. Sottilare, Holden, Brawner, and Goldberg (2011) describe some of the architectural challenges of team tutoring at a high level in terms of functional requirements. In this paper we describe specific challenges in terms of implementing a team architecture within the Generalized Intelligent Framework for Tutoring (GIFT), including simultaneous startup and synchronization with distributed team members, maintaining state of multiple users, and timing feedback for teams and individuals appropriately

A quantitative analysis of the relationship between an online homework system and student achievement in pre-calculus

Supporting student success in entry-level mathematics courses at the undergraduate level has and continues to be a challenge. Recently we have seen an increased reliance on technological supports including software to supplement more traditional in-class instruction. In this paper, we explore the effects on student performance of the use of a computer software program to supplement instruction in an entry-level mathematics course at the undergraduate level, specifically, a pre-calculus course. Relying on data from multiple sections of the course over various semesters, we compare student performance in those classes utilizing the software against those in which it was not used. Quantitative analysis of the data then leads us to conclusions about the effectiveness of the software as well as recommendations for future iterations of the course and others like it

Easy Authoring of Intelligent Tutoring Systems for Synthetic Environments

ABSTRACT: We describe how the Extensible Problem Specifi

Authoring Effective Embedded Tutors: An Overview of the Extensible Problem Specific Tutor (xPST) System

The Extensible Problem Specific Tutor (xPST) allows authors who are not cognitive scientists and not programmers to quickly create an intelligent tutoring system that provides instruction akin to a model-tracing tutor. Furthermore, this instruction is overlaid on existing software, so that the learner’s interface does not have to be made from scratch. The xPST architecture allows for extending its capabilities by the addition of plug-ins that communicate with additional third-party software. After reviewing this general architecture, we describe three major implementations that we have created using the xPST system, each using different third-party software as the learner’s interface. We have conducted three evaluations of authors using xPST to create tutoring content, and these are considered in turn. These evaluations show that xPST authors can quickly learn the system, and can efficiently produce successful embedded instruction

A meta-analysis of the effectiveness of intelligent tutoring systems on college students' academic learning

© 2013 American Psychological Association.This meta-analysis synthesizes research on the effectiveness of intelligent tutoring systems (ITS) for college students. Thirty-five reports were found containing 39 studies assessing the effectiveness of 22 types of ITS in higher education settings. Most frequently studied were AutoTutor, Assessment and Learning in Knowledge Spaces, eXtended Tutor-Expert System, and Web Interface for Statistics Education. Major findings include (a) Overall, ITS had a moderate positive effect on college students' academic learning (g = .32 to g = .37); (b) ITS were less effective than human tutoring, but they outperformed all other instruction methods and learning activities, including traditional classroom instruction, reading printed text or computerized materials, computer-assisted instruction, laboratory or homework assignments, and no-treatment control; (c) ITS's effectiveness did not significantly differ by different ITS, subject domain, or the manner or degree of their involvement in instruction and learning; and (d) effectiveness in earlier studies appeared to be significantly greater than that in more recent studies. In addition, there is some evidence suggesting the importance of teachers and pedagogy in ITS-assisted learning

USING PRAISE TO INCREASE VISUAL ATTENDING IN AN ASYNCHRONOUS ONLINE LEARNING ENVIRONMENT: AN EYE TRACKING STUDY

With the emergence of online courses in the mid-1990s, the number of students enrolled in online courses has been growing at an exponential rate (Schwirzke, Vashaw, & Watson, 2018). This trend brings with it new problems, such as familiarity with evidence-supported behavioral techniques that will maintain student engagement and improve likelihood of academic success in online learning environments. The purpose of the present study was to examine how the use of praise may affect visual engagement with video lectures with the assistance of commercially available eye tracking technology. A secondary objective of the study was to identify how praise affects performance on post-lecture knowledge assessments of information delivered through online videos. Results indicated that three out of four undergraduate participants were visually engaged with the video lecture more when provided praise than in the absence of praise, while the fourth participant showed ceiling effects. Results also indicated that praise did not have a significant effect on post-lecture knowledge assessment accuracy. These results indicate that praise may have utility in improving visual engagement in online learning environments and that inexpensive eye tracking technology may be useful for measuring visual engagement in these environments

Intelligent Tutoring System Authoring Tools for Non-Programmers

An intelligent tutoring system (ITS) is a software application that tries to replicate the performance of a human tutor by supporting the theory of learning by doing . ITSs have been shown to improve the performance of a student in wide range of domains. Despite their benefits, ITSs have not seen widespread use due to the complexity involved in their development. Developing an ITS from scratch requires expertise in several fields including computer science, cognitive psychology and artificial intelligence. In order to decrease the skill threshold required to build ITSs, several authoring tools have been developed. In this thesis, I document several contributions to the field of intelligent tutoring in the form of extensions to an existing ITS authoring tool, research studies on authoring tool paradigms and the design of authoring tools for non-programmers in two complex domains - natural language processing and 3D game environments. The Extensible Problem Specific Tutor (xPST) is an authoring tool that helps rapidly develop model-tracing like tutors on existing interfaces such as webpages. xPST\u27s language was made more expressive with the introduction of new checktypes required for answer checking in problems belonging to domains such as geometry and statistics. A web-based authoring (WAT) tool was developed for the purpose of tutor management and deployment and to promote non-programmer authoring of ITSs. The WAT was used in a comparison study between two authoring tool paradigms - GUI based and text based, in two different problem domains - statistics and geometry. User-programming of natural language processing (NLP) in ITSs is not common with authoring toolkits. Existing NLP techniques do not offer sufficient power to non-programmers and the NLP is left to expert developers or machine learning algorithms. We attempted to address this challenge by developing a domain-independent authoring tool, ConceptGrid that is intended to help non-programmers develop ITSs that perform natural language processing. ConceptGrid has been integrated into xPST. When templates created using ConceptGrid were tested, they approached the accuracy of human instructors in scoring student responses. 3D game environments belong to another domain for which authoring tools are uncommon. Authoring game-based tutors is challenging due to the inherent domain complexity and dynamic nature of the environment. We attempt to address this challenge through the design of authoring tool that is intended to help non-programmers develop game-based ITSs

USING CONTINGENT PRAISE TO INCREASE VISUAL ENGAGEMENT IN AN ASYNCHRONOUS ONLINE LEARNING ENVIRONMENT: AN EYE TRACKING STUDY

As more students move to online learning, this results in not only new barriers but new opportunities in academia. The purpose of this study was to examine how behavior-contingent praise affects visual engagement with an online video lecture when using WebGazer, a publicly available eye tracking software, with a user’s integrated webcam. A second aim of this study was to examine if using WebGazer with an integrated webcam was a valid alternative to hand scoring when collecting visual engagement data. Results of WebGazer measurement indicated a moderate effect size for three participants in the presence of contingent praise, and a large effect size was observed for one participant when provided contingent praise. Based on visual analysis and simple linear regression, level, shape of data paths, trend, and overall range of data were similar for three participants. One participant’s WebGazer and hand scoring data demonstrated a notable discrepancy in range, level, and shape for the Demand and Praise conditions. These results indicate that contingent praise may result in an increase in visual engagement in online learning environments and that using WebGazer and an integrated webcam may be a valid tool for measuring visual engagement in online learning environments. Discrepancies in WebGazer and hand scoring data are discussed