Towards an Intelligent Tutor for Mathematical Proofs

Computer-supported learning is an increasingly important form of study since it allows for independent learning and individualized instruction. In this paper, we discuss a novel approach to developing an intelligent tutoring system for teaching textbook-style mathematical proofs. We characterize the particularities of the domain and discuss common ITS design models. Our approach is motivated by phenomena found in a corpus of tutorial dialogs that were collected in a Wizard-of-Oz experiment. We show how an intelligent tutor for textbook-style mathematical proofs can be built on top of an adapted assertion-level proof assistant by reusing representations and proof search strategies originally developed for automated and interactive theorem proving. The resulting prototype was successfully evaluated on a corpus of tutorial dialogs and yields good results.Comment: In Proceedings THedu'11, arXiv:1202.453

Investigating Learning in an Intelligent Tutoring System through Randomized Controlled Experiments

In the United States, many students are doing poorly on new high-stakes standards-based tests that are required by the No Child Left Behind Act of 2002. Teachers are expected to cover more material to address all of the topics covered in standardized tests, and instructional time is more precious than ever. Educators want to know that the interventions that they are using in their classrooms are effective for students of varying abilities. Many educational technologies rely on tutored problem solving, which requires students to work through problems step-by-step while the system provides hints and feedback, to improve student learning. Intelligent tutoring researchers, education scientists and cognitive scientists are interested in knowing whether tutored problem solving is effective and for whom. Intelligent tutoring systems have the ability to adapt to individual students but need to know what types of feedback to present to individual students for the best and most efficient learning results. This dissertation presents an evaluation of the ASSISTment System, an intelligent tutoring system for the domain of middle school mathematics. In general, students were found to learn when engaging in tutored problem solving in the ASSISTment System. Students using the ASSISTment System also learned more when compared to paper-and-pencil problem-solving. This dissertation puts together a series of randomized controlled studies to build a comprehensive theory about when different types of tutoring feedback are more appropriate in an intelligent tutoring system. Data from these studies were used to analyze whether interactive tutored problem solving in an intelligent tutoring system is more effective than less interactive methods of allowing students to solve problems. This dissertation is novel in that it presents a theory that designers of intelligent tutoring systems could use to better adapt their software to the needs of students. One of the interesting results showed is that the effectiveness of tutored problem solving in an intelligent tutoring system is dependent on the math proficiency of the students. Students with low math proficiency learned more when they engaged in interactive tutoring sessions where they worked on one step at a time, and students with high math proficiency learned more when they were given the whole solution at once. More interactive methods of tutoring take more time versus less interactive methods. The data showed that it is worth the extra time it takes for students with low math proficiency. The main contribution of this dissertation is the development of a comprehensive theory of when educational technologies should use tutored problem solving to help students learn compared to other feedback mechanisms such as hints on demand, worked out solutions, worked examples and educational web pages

Mitigating User Frustration through Adaptive Feedback based on Human-Automation Etiquette Strategies

The objective of this study is to investigate the effects of feedback and user frustration in human-computer interaction (HCI) and examine how to mitigate user frustration through feedback based on human-automation etiquette strategies. User frustration in HCI indicates a negative feeling that occurs when efforts to achieve a goal are impeded. User frustration impacts not only the communication with the computer itself, but also productivity, learning, and cognitive workload. Affect-aware systems have been studied to recognize user emotions and respond in different ways. Affect-aware systems need to be adaptive systems that change their behavior depending on users’ emotions. Adaptive systems have four categories of adaptations. Previous research has focused on primarily function allocation and to a lesser extent information content and task scheduling. However, the fourth approach, changing the interaction styles is the least explored because of the interplay of human factors considerations. Three interlinked studies were conducted to investigate the consequences of user frustration and explore mitigation techniques. Study 1 showed that delayed feedback from the system led to higher user frustration, anger, cognitive workload, and physiological arousal. In addition, delayed feedback decreased task performance and system usability in a human-robot interaction (HRI) context. Study 2 evaluated a possible approach of mitigating user frustration by applying human-human etiquette strategies in a tutoring context. The results of Study 2 showed that changing etiquette strategies led to changes in performance, motivation, confidence, and satisfaction. The most effective etiquette strategies changed when users were frustrated. Based on these results, an adaptive tutoring system prototype was developed and evaluated in Study 3. By utilizing a rule set derived from Study 2, the tutor was able to use different automation etiquette strategies to target and improve motivation, confidence, satisfaction, and performance using different strategies, under different levels of user frustration. This work establishes that changing the interaction style alone of a computer tutor can affect a user’s motivation, confidence, satisfaction, and performance. Furthermore, the beneficial effect of changing etiquette strategies is greater when users are frustrated. This work provides a basis for future work to develop affect-aware adaptive systems to mitigate user frustration

Students´ language in computer-assisted tutoring of mathematical proofs

Truth and proof are central to mathematics. Proving (or disproving) seemingly simple statements often turns out to be one of the hardest mathematical tasks. Yet, doing proofs is rarely taught in the classroom. Studies on cognitive difficulties in learning to do proofs have shown that pupils and students not only often do not understand or cannot apply basic formal reasoning techniques and do not know how to use formal mathematical language, but, at a far more fundamental level, they also do not understand what it means to prove a statement or even do not see the purpose of proof at all. Since insight into the importance of proof and doing proofs as such cannot be learnt other than by practice, learning support through individualised tutoring is in demand. This volume presents a part of an interdisciplinary project, set at the intersection of pedagogical science, artificial intelligence, and (computational) linguistics, which investigated issues involved in provisioning computer-based tutoring of mathematical proofs through dialogue in natural language. The ultimate goal in this context, addressing the above-mentioned need for learning support, is to build intelligent automated tutoring systems for mathematical proofs. The research presented here has been focused on the language that students use while interacting with such a system: its linguistic propeties and computational modelling. Contribution is made at three levels: first, an analysis of language phenomena found in students´ input to a (simulated) proof tutoring system is conducted and the variety of students´ verbalisations is quantitatively assessed, second, a general computational processing strategy for informal mathematical language and methods of modelling prominent language phenomena are proposed, and third, the prospects for natural language as an input modality for proof tutoring systems is evaluated based on collected corpora

Interacting with a Chatbot-Based Advising System: Understanding the Effect of Chatbot Personality and User Gender on Behavior

Chatbots with personality have been shown to affect engagement and user subjective satisfaction. Yet, the design of most chatbots focuses on functionality and accuracy rather than an interpersonal communication style. Existing studies on personality-imbued chatbots have mostly assessed the effect of chatbot personality on user preference and satisfaction. However, the influence of chatbot personality on behavioral qualities, such as users’ trust, engagement, and perceived authenticity of the chatbots, is largely unexplored. To bridge this gap, this study contributes: (1) A detailed design of a personality-imbued chatbot used in academic advising. (2) Empirical findings of an experiment with students who interacted with three different versions of the chatbot. Each version, vetted by psychology experts, represents one of the three dominant traits, agreeableness, conscientiousness, and extraversion. The experiment focused on the effect of chatbot personality on trust, authenticity, engagement, and intention to use the chatbot. Furthermore, we assessed whether gender plays a role in students’ perception of the personality-imbued chatbots. Our findings show a positive impact of chatbot personality on perceived chatbot authenticity and intended engagement, while student gender does not play a significant role in the students’ perception of chatbots

The Impact of Technology-Enhanced Learning Activities on Nursing Student Engagement in the Classroom

Educating student nurses in the present environment requires professors to stay current with new methodologies as well as innovations in technology. The question is how to address both the impact of technology and the skills of clinical reasoning, and keep the students involved in the material. If there can be integration of each aspect through the use of technology-enhanced learning activities on the internet and preparation to approach the issue, then perhaps this can increase success. This is a quasi-experimental intervention study that explored the impact of a case study blogging assignment on the engagement of students enrolled in a fundamental nursing course. A pre-test/post-test design, using the Adapted Engaged Learning Index as the instrument, was conducted over an eight week period. A total of 153 students received a pre-test to measure engagement. The students were then divided into control and intervention classes. A post-test was administered after 5 pre-class blogging assignments had been completed. The results indicated there was no significant differences between the pre and post-tests for either the intervention group (p = .118) or the control group (p = .110), although the faculty identified an increased ability to participate in class and clinically reason. The study introduced the use of technology to encourage student preparation prior to class which may lead to increased participation and knowledge integration. The findings led to the recommendation that further studies should be conducted to identify technology-enhanced educational interventions that increase student engagement. These would include using the full semester in a course that only iii has one component, increasing orientation of the students to blogging in the learning management system, and expanding to multiple collegiate sites to increase generalizability. It is imperative that educators engage nursing students in learning and facilitate their mastering of clinical reasoning skills. Nurses need to be proficient in clinical reasoning as their professions calls for the ability to make timely and effective decisions. Through creative and innovative educational strategies, students will start to make the connections necessary to develop this mindset. This research explored the importance using technology enhanced educational adjuncts to assist in the transformation of nursing education and hence, to prepare future professionals

An investigation into the matrix of support for medical students on hospital placement: a case study

Historically, consultants oversaw students on placements as part of ‘firms’. More recently, however, new roles have emerged that have dedicated educational support functions. The overall aim of this thesis is to investigate the structure of support for University of Birmingham medical students on hospital placements using a social learning theory lens. This in-depth, single site study begins with an investigation of how a newly introduced role of Senior Academy Tutor (SAT) supports students on hospital placement, followed by an exploration of the wider support matrix available to students. The first phase used routinely collected evaluation data to gauge Year 5 student sentiment about the SAT role, and then explored key themes with student focus groups and interviews with SATs. The second phase used a questionnaire survey to investigate how different roles support Year 3 to 5 students during their hospital placements. Key findings were that students’ orientation to their learning and to the matrix of support roles changes as they progress through the MBChB programme. From being concerned with learning basic skills and passing exams, students become more interested in learning the role of a junior doctor and joining the hospital community of practice

Interacting with a Chatbot-Based Advising System: Understanding the Effect of Chatbot Personality and User Gender on Behavior

Chatbots with personality have been shown to affect engagement and user subjective satisfaction. Yet, the design of most chatbots focuses on functionality and accuracy rather than an interpersonal communication style. Existing studies on personality-imbued chatbots have mostly assessed the effect of chatbot personality on user preference and satisfaction. However, the influence of chatbot personality on behavioral qualities, such as users’ trust, engagement, and perceived authenticity of the chatbots, is largely unexplored. To bridge this gap, this study contributes: (1) A detailed design of a personality-imbued chatbot used in academic advising. (2) Empirical findings of an experiment with students who interacted with three different versions of the chatbot. Each version, vetted by psychology experts, represents one of the three dominant traits, agreeableness, conscientiousness, and extraversion. The experiment focused on the effect of chatbot personality on trust, authenticity, engagement, and intention to use the chatbot. Furthermore, we assessed whether gender plays a role in students’ perception of the personality-imbued chatbots. Our findings show a positive impact of chatbot personality on perceived chatbot authenticity and intended engagement, while student gender does not play a significant role in the students’ perception of chatbots