Human Active Learning

Active machine learning (AML) is a popular research area in machine learning. It allows selection of the most informative instances in training data of the domain for manual labeling. AML aims to produce a highly accurate classifier using as few labeled instances as possible, thereby minimizing the cost of obtaining labeled data. As machines can learn from experience like humans do, using AML for human category learning may help human learning become more efficient and hence reduce the cost of teaching. This chapter is a review of recent research literature concerning the use of AML technique to enhance human learning and teaching. There are a few studies on the applications of AML to the human category learning domain. The most interesting study was by Castro et al., which showed that humans learn faster with better performance when they can actively select the informative instances from a pool of unlabeled data instead of random sampling. Although AML can facilitate object categorization for humans, there are still many challenges and questions that need to be addressed in the use of AML for modeling human categorization. In this chapter, we will discuss some of these challenges

Aiming to Know You Better Perhaps Makes Me a More Engaging Dialogue Partner

There have been several attempts to define a plausible motivation for a chit-chat dialogue agent that can lead to engaging conversations. In this work, we explore a new direction where the agent specifically focuses on discovering information about its interlocutor. We formalize this approach by defining a quantitative metric. We propose an algorithm for the agent to maximize it. We validate the idea with human evaluation where our system outperforms various baselines. We demonstrate that the metric indeed correlates with the human judgments of engagingness.Comment: To appear in the proceedings of Conference on Computational Natural Language Learning, CoNLL 201

The Theoretical and Methodological Opportunities Afforded by Guided Play With Young Children

For infants and young children, learning takes place all the time and everywhere. How children learn best both in and out of school has been a long-standing topic of debate in education, cognitive development, and cognitive science. Recently, guided play has been proposed as an integrative approach for thinking about learning as a child-led, adult-assisted playful activity. The interactive and dynamic nature of guided play presents theoretical and methodological challenges and opportunities. Drawing upon research from multiple disciplines, we discuss the integration of cutting-edge computational modeling and data science tools to address some of these challenges, and highlight avenues toward an empirically grounded, computationally precise and ecologically valid framework of guided play in early education

Constructing the world: Active causal learning in cognition

Humans are adept at constructing causal models of the world that can support prediction, explanation, simulation-based reasoning, planning and control. In this thesis I explore how people learn about the causal world interacting with it, and how they represent and modify their causal knowledge as they gather evidence. Over 10 experiments and modelling, I show that interventional and temporal cues, along with top-down hierarchical constraints, inform the gradual evolution and adaptation of increasingly rich causal representations. Chapters 1 and 2 develop a rational analysis of the problems of learning and representing causal structure, and choosing interventions, that perturb the world in ways that reveal its structure. Chapters 3--5 focus on structure learning over sequences of discrete trials, in which learners can intervene by setting variables within a causal system and observe the consequences. The second half of the thesis generalises beyond the discrete trial learning case, exploring interventional causal learning in situations where events occur in continuous time (Chapters 6 and 7); and in spatiotemporally rich physical "microworlds" (Chapter 8). Throughout the experiments, I find that both children and adults are robust active causal learners, able to deal with noise and complexity even as normative judgment and intervention selection become radically intractable. To explain their success, I develop scalable process level accounts of both causal structure learning and intervention selection inspired by approximation algorithms in machine learning. I show that my models can better explain patterns of behaviour than a range of alternatives as well as shedding light on the source of common biases including confirmatory testing, anchoring effects and probability matching. Finally, I propose a close relationship between active learning and active aspects of cognition including thinking, decision making and executive control

Asking and evaluating natural language questions

The ability to ask questions during learning is a key aspect ofhuman cognition. While recent research has suggested com-mon principles underlying human and machine “active learn-ing,” the existing literature has focused on relatively simpletypes of queries. In this paper, we study how humans constructrich and sophisticated natural language queries to search for in-formation in a large yet computationally tractable hypothesisspace. In Experiment 1, participants were allowed to ask anyquestion they liked in natural language. In Experiment 2, par-ticipants were asked to evaluate questions that they did not gen-erate themselves. While people rarely asked the most informa-tive questions in Experiment 1, they strongly preferred moreinformative questions in Experiment 2, as predicted by an idealBayesian analysis. Our results show that rigorous information-based accounts of human question asking are more widely ap-plicable than previously studied, explaining preferences acrossa diverse set of natural language questions