Designing intelligent computer‐based simulations: A pragmatic approach

This paper examines the design of intelligent multimedia simulations. A case study is presented which uses an approach based in part on intelligent tutoring system design to integrate formative assessment into the learning of clinical decision‐making skills for nursing students. The approach advocated uses a modular design with an integrated intelligent agent within a multimedia simulation. The application was created using an object‐orientated programming language for the multimedia interface (Delphi) and a logic‐based interpreted language (Prolog) to create an expert assessment system. Domain knowledge is also encoded in a Windows help file reducing some of the complexity of the expert system. This approach offers a method for simplifying the production of an intelligent simulation system. The problems developing intelligent tutoring systems are examined and an argument is made for a practical approach to developing intelligent multimedia simulation systems

Interactive Teaching Algorithms for Inverse Reinforcement Learning

We study the problem of inverse reinforcement learning (IRL) with the added twist that the learner is assisted by a helpful teacher. More formally, we tackle the following algorithmic question: How could a teacher provide an informative sequence of demonstrations to an IRL learner to speed up the learning process? We present an interactive teaching framework where a teacher adaptively chooses the next demonstration based on learner's current policy. In particular, we design teaching algorithms for two concrete settings: an omniscient setting where a teacher has full knowledge about the learner's dynamics and a blackbox setting where the teacher has minimal knowledge. Then, we study a sequential variant of the popular MCE-IRL learner and prove convergence guarantees of our teaching algorithm in the omniscient setting. Extensive experiments with a car driving simulator environment show that the learning progress can be speeded up drastically as compared to an uninformative teacher.Comment: IJCAI'19 paper (extended version

Engaging Undergraduate Students in Transportation Studies through Simulating Transportation for Realistic Engineering Education and Training (STREET)

The practice of transportation engineering and planning has evolved substantially over the past several decades. A new paradigm for transportation engineering education is required to better engage students and deliver knowledge. Simulation tools have been used by transportation professionals to evaluate and analyze the potential impact of design or control strategy changes. Conveying complex transportation concepts can be effectively achieved by exploring them through simulation. Simulation is particularly valuable in transportation education because most transportation policies and strategies in the real world take years to implement with a prohibitively high cost. Transportation simulation allows learners to apply different control strategies in a risk-free environment and to expose themselves to transportation engineering methodologies that are currently in practice. Despite the advantages, simulation, however, has not been widely adopted in the education of transportation engineering. Using simulation in undergraduate transportation courses is sporadic and reported efforts have been focused on the upper-level technical elective courses. A suite of web-based simulation modules was developed and incorporated in the undergraduate transportation courses at University of Minnesota. The STREET (Simulating Transportation for Realistic Engineering Education and Training) research project was recently awarded by NSF (National Science Foundation) to develop web-based simulation modules to improve instruction in transportation engineering courses and evaluate their effectiveness. Our ultimate goal is to become the epicenter for developing simulation-based teaching materials, an active textbook, which offers an interactive learning environment to undergraduate students. With the hand-on nature of simulation, we hope to improve student understanding of critical concepts in transportation engineering and student motivation toward transportation engineering, and improve student retention in the field. We also would like to disseminate the results and teaching materials to other colleges to integrate the simulation modules in their curricula.Transportation Education and Training, Transportation Simulation, Roadway Geometry Design

An agent-based simulator applied to teaching-learning process to predict sociometric indices in higher education

Most novice teachers and even some experienced teachers can lack appropriate tools for designing teaching strategies that ensure the quality of education. The ability of working in teams is crucial in educating professionals. The literature proves that social relations influence the performance of teams. For instance, the team cohesion is directly related with its performance. In the current work, we have developed an agent-based tool for assisting teachers in simulating their teaching strategies to estimate their influence on the group sociometrics like cohesion, coherence of reciprocal relations, dissociation and density of relations. The experiments with nine scenarios in disciplines of computer science, electronic, psychology, business, tourism and renewal energies with 239 students and six teachers including experienced and novice ones show that its underlying agent-based framework can adapt to different disciplines obtaining similar outcomes to the real ones. We learned that the tool was especially reliable in predicting the density of relations and the cohesion, being the latter one probably the most relevant due to its known relation with academic performance. In addition, we also learned that it was difficult to assess the prediction quality of the dissociation in higher education, due to the usual low amounts or absence of reciprocal rejections in the students' groups in this educational stage. The presented agent-based tool is publicly distributed as open source for facilitating other researchers in following this research line

Cultural Learning in a Dynamic Environment: an Analysis of Both Fitness and Diversity in Populations of Neural Network Agents

Evolutionary learning is a learning model that can be described as the iterative Darwinian process of fitness-based selection and genetic transfer of information leading to populations of higher fitness. Cultural learning describes the process of information transfer between individuals in a population through non-genetic means. Cultural learning has been simulated by combining genetic algorithms and neural networks using a teacher/pupil scenario where highly fit individuals are selected as teachers and instruct the next generation. This paper examines the effects of cultural learning on the evolutionary process of a population of neural networks. In particular, the paper examines the genotypic and phenotypic diversity of a population as well as its fitness. Using these measurements, it is possible to examine the effects of cultural learning on the population's genetic makeup. Furthermore, the paper examines whether cultural learning provides a more robust learning mechanism in the face of environmental changes. Three benchmark tasks have been chosen as the evolutionary task for the population: the bit-parity problem, the game of tic-tac-toe and the game of connect-four. Experiments are conducted with populations employing evolutionary learning alone and populations combining evolutionary and cultural learning in an environment that changes dramatically.Cultural Learning, Dynamic Environments, Diversity, Multi-Agent Systems, Artificial Life

Towards Agent-Based Simulation Support for Training Teachers

he quality of teacher training is crucial as it influences the academic performance of students. The last decades have witnessed a steep increase in the use of information applications for improving the training of teachers. In this line of work, the current approach proposes to use agent-based simulation for supporting the training of teachers. The current work focuses on the capability of teachers in designing appropriate teaching strategies with the corresponding schedules of learning activities. In particular, the current approach uses FTS-SOCI (an agent-based Framework for simulating Teaching Strategies with evolutions of Sociograms) for simulating the social repercussions of certain teaching strategies. Teachers can pursue obtaining groups with high cohesion, which is normally related with a high academic performance. This article illustrates the current approach with the training of a computer science teacher for the programming subject