A Computational Model of Creative Design as a Sociocultural Process Involving the Evolution of Language

The aim of this research is to investigate the mechanisms of creative design within the context of an evolving language through computational modelling. Computational Creativity is a subfield of Artificial Intelligence that focuses on modelling creative behaviours. Typically, research in Computational Creativity has treated language as a medium, e.g., poetry, rather than an active component of the creative process. Previous research studying the role of language in creative design has relied on interviewing human participants, limiting opportunities for computational modelling. This thesis explores the potential for language to play an active role in computational creativity by connecting computational models of the evolution of artificial languages and creative design processes. Multi-agent simulations based on the Domain-Individual-Field-Interaction framework are employed to evolve artificial languages with features that may support creative designing including ambiguity, incongruity, exaggeration and elaboration. The simulation process consists of three steps: (1) constructing representations associating topics, meanings and utterances; (2) structured communication of utterances and meanings through the playing of “language games”; and (3) evaluation of design briefs and works. The use of individual agents with different evaluation criteria, preferences and roles enriches the scope and diversity of the simulations. The results of the experiments conducted with artificial creative language systems demonstrate the expansion of design spaces by generating compositional utterances representing novel concepts among design agents using language features and weighted context free grammars. They can be used to computationally explore the roles of language in creative design, and possibly point to computational applications. Understanding the evolution of artificial languages may provide insights into human languages, especially those features that support creativity

Grounding semantics in robots for Visual Question Answering

In this thesis I describe an operational implementation of an object detection and description system that incorporates in an end-to-end Visual Question Answering system and evaluated it on two visual question answering datasets for compositional language and elementary visual reasoning

A theoretical framework for computer models of cooperative dialogue, acknowledging multi-agent conflict

This thesis describes a theoretical framework for modelling cooperative dialogue. The linguistic theory is a version of speech act theory adopted from Cohen and Levesque, in which dialogue utterances are generated and interpreted pragmatically in the context of a theory of rational interaction. The latter is expressed as explicitly and formally represented principles of rational agenthood and cooperative interaction. The focus is the development of strategic principles of multi-agent interaction as such a basis for cooperative dialogue. In contrast to the majority of existing work, these acknowledge the Positive role of conflict to multi-agent cooperation. and make no assumptions regarding the benevolence and sincerity of agents. The result is a framework wherein agents can resolve conflicts by negotiation. It is a preliminary stage to the future building of computer models of cooperative dialogue for both HCI and DAI, which will therefore be more widely and generally applicable than those currently in existence. The theory of conflict and cooperation is expressed in the different patterns of mental states which characterise multi-agent conflict, cooperation and indifference as three alternative postural relations. Agents can recognise and potentially create these. Dialogue actions are the strategic tools with which mental states can be manipulated, whilst acknowledging that agents are autonomous over their mental states; they have control over what they acquire and reveal in dialogue. Strategic principles of belief and goal adoption are described in terms of the relationships between autonomous agents' beliefs, goals, preferences, and interests, and the relation of these to action. Veracity, mendacity, concealing and revealing are defined as properties of acts. The role of all these elements in reasoning about dialogue action and conflict resolution, is tester in analyses of two example dialogues; a record of a real trade union negotiation and an extract from "Othello" by Shakespeare

The significance of silence. Long gaps attenuate the preference for ‘yes’ responses in conversation.

In conversation, negative responses to invitations, requests, offers and the like more often occur with a delay – conversation analysts talk of them as dispreferred. Here we examine the contrastive cognitive load ‘yes’ and ‘no’ responses make, either when given relatively fast (300 ms) or delayed (1000 ms). Participants heard minidialogues, with turns extracted from a spoken corpus, while having their EEG recorded. We find that a fast ‘no’ evokes an N400-effect relative to a fast ‘yes’, however this contrast is not present for delayed responses. This shows that an immediate response is expected to be positive – but this expectation disappears as the response time lengthens because now in ordinary conversation the probability of a ‘no’ has increased. Additionally, however, 'No' responses elicit a late frontal positivity both when they are fast and when they are delayed. Thus, regardless of the latency of response, a ‘no’ response is associated with a late positivity, since a negative response is always dispreferred and may require an account. Together these results show that negative responses to social actions exact a higher cognitive load, but especially when least expected, as an immediate response

You have interrupted me again!: making voice assistants more dementia-friendly with incremental clarification

In spontaneous conversation, speakers seldom have a full plan of what they are going to say in advance: they need to conceptualise and plan incrementally as they articulate each word in turn. This often leads to long pauses mid-utterance. Listeners either wait out the pause, offer a possible completion, or respond with an incremental clarification request (iCR), intended to recover the rest of the truncated turn. The ability to generate iCRs in response to pauses is therefore important in building natural and robust everyday voice assistants (EVA) such as Amazon Alexa. This becomes crucial with people with dementia (PwDs) as a target user group since they are known to pause longer and more frequently, with current state-of-the-art EVAs interrupting them prematurely, leading to frustration and breakdown of the interaction. In this article, we first use two existing corpora of truncated utterances to establish the generation of clarification requests as an effective strategy for recovering from interruptions. We then proceed to report on, analyse, and release SLUICE-CR: a new corpus of 3,000 crowdsourced, human-produced iCRs, the first of its kind. We use this corpus to probe the incremental processing capability of a number of state-of-the-art large language models (LLMs) by evaluating (1) the quality of the model's generated iCRs in response to incomplete questions and (2) the ability of the said LLMs to respond correctly after the users response to the generated iCR. For (1), our experiments show that the ability to generate contextually appropriate iCRs only emerges at larger LLM sizes and only when prompted with example iCRs from our corpus. For (2), our results are in line with (1), that is, that larger LLMs interpret incremental clarificational exchanges more effectively. Overall, our results indicate that autoregressive language models (LMs) are, in principle, able to both understand and generate language incrementally and that LLMs can be configured to handle speech phenomena more commonly produced by PwDs, mitigating frustration with today's EVAs by improving their accessibility

Negotiated Tutoring: An Approach to Interaction in Intelligent Tutoring Systems

This thesis describes a general approach to tutorial interaction in Intelligent Tutoring Systems, called "Negotiated Tutoring". Some aspects of the approach have been implemented as a computer program in the 'KANT' (Kritical Argument Negotiated Tutoring) system. Negotiated Tutoring synthesises some recent trends in Intelligent Tutoring Systems research, including interaction symmetry, use of explicit negotiation in dialogue, multiple interaction styles, and an emphasis on cognitive and metacognitive skill acquisition in domains characterised by justified belief. This combination of features has not been previously incorporated into models for intelligent tutoring dialogues. Our approach depends on modelling the high-level decision-making processes and memory representations used by a participant in dialogue. Dialogue generation is controlled by reasoning mechanisms which operate on a 'dialogue state', consisting of conversants' beliefs, a set of possible dialogue moves, and a restricted representation of the recent utterances generated by both conversants. The representation for conversants' beliefs is based on Anderson's (1983) model for semantic memory, and includes a model for dialogue focus based on spreading activation. Decisions in dialogue are based on preconditions with respect to the dialogue state, higher level educational preferences which choose between relevant alternative dialogue moves, and negotiation mechanisms designed to ensure cooperativity. The domain model for KANT was based on a cognitive model for perception of musical structures in tonal melodies, which extends the theory of Lerdahl and Jackendoff (1983). Our model ('GRAF' - GRouping Analysis with Frames) addresses a number of problems with Lerdahl and Jackendoff's theory, notably in describing how a number of unconscious processes in music cognition interact, including elements of top-down and bottom-up processing. GRAF includes a parser for musical chord functions, a mechanism for performing musical reductions, low-level feature detectors and a frame-system (Minsky 1977) for musical phrase structures

Suicidal Utopian Delusions in the 21st Century: Philosophy, Human Nature and the Collapse of Civilization-- Articles and Reviews 2006-2017 2nd Edition Feb 2018

This collection of articles was written over the last 10 years and edited to bring them up to date (2019). All the articles are about human behavior (as are all articles by anyone about anything), and so about the limitations of having a recent monkey ancestry (8 million years or much less depending on viewpoint) and manifest words and deeds within the framework of our innate psychology as presented in the table of intentionality. As famous evolutionist Richard Leakey says, it is critical to keep in mind not that we evolved from apes, but that in every important way, we are apes. If everyone was given a real understanding of this (i.e., of human ecology and psychology to actually give them some control over themselves), maybe civilization would have a chance. As things are however the leaders of society have no more grasp of things than their constituents and so collapse into anarchy is inevitable. The first group of articles attempt to give some insight into how we behave that is reasonably free of theoretical delusions. In the next three groups, I comment on three of the principal delusions preventing a sustainable world— technology, religion and politics (cooperative groups). People believe that society can be saved by them, so I provide some suggestions in the rest of the book as to why this is unlikely via short articles and reviews of recent books by well-known writers. It is critical to understand why we behave as we do and so the first section presents articles that try to describe (not explain as Wittgenstein insisted) behavior. I start with a brief review of the logical structure of rationality, which provides some heuristics for the description of language (mind, rationality, personality) and gives some suggestions as to how this relates to the evolution of social behavior. This centers around the two writers I have found the most important in this regard, Ludwig Wittgenstein and John Searle, whose ideas I combine and extend within the dual system (two systems of thought) framework that has proven so useful in recent thinking and reasoning research. As I note, there is in my view essentially complete overlap between philosophy, in the strict sense of the enduring questions that concern the academic discipline, and the descriptive psychology of higher order thought (behavior). Once one has grasped Wittgenstein’s insight that there is only the issue of how the language game is to be played, one determines the Conditions of Satisfaction (what makes a statement true or satisfied etc.) and that is the end of the discussion. No neurophysiology, no metaphysics, no postmodernism, no theology. It is my contention that the table of intentionality (rationality, mind, thought, language, personality etc.) that features prominently here describes more or less accurately, or at least serves as an heuristic for, how we think and behave, and so it encompasses not merely philosophy and psychology, but everything else (history, literature, mathematics, politics etc.). Note especially that intentionality and rationality as I (along with Searle, Wittgenstein and others) view it, includes both conscious deliberative System 2 and unconscious automated System 1 actions or reflexes. The next section describes the digital delusions, which confuse the language games of System 2 with the automatisms of System one, and so cannot distinguish biological machines (i.e., people) from other kinds of machines (i.e., computers). The ‘reductionist’ claim is that one can ‘explain’ behavior at a ‘lower’ level, but what actually happens is that one does not explain human behavior but a ‘stand in’ for it. Hence the title of Searle’s classic review of Dennett’s book (“Consciousness Explained”)— “Consciousness Explained Away”. In most contexts ‘reduction’ of higher level emergent behavior to brain functions, biochemistry, or physics is incoherent. Even for ‘reduction’ of chemistry or physics, the path is blocked by chaos and uncertainty. Anything can be ‘represented’ by equations, but when they ‘represent’ higher order behavior, it is not clear (and cannot be made clear) what the ‘results’ mean. Reductionist metaphysics is a joke, but most scientists and philosophers lack the appropriate sense of humor. The last section describes The One Big Happy Family Delusion, i.e., that we are selected for cooperation with everyone, and that the euphonious ideals of Democracy, Diversity and Equality will lead us into utopia, if we just manage things correctly (the possibility of politics). Again, the No Free Lunch Principle ought to warn us it cannot be true, and we see throughout history and all over the contemporary world, that without strict controls, selfishness and stupidity gain the upper hand and soon destroy any nation that embraces these delusions. In addition, the monkey mind steeply discounts the future, and so we cooperate in selling our descendant’s heritage for temporary comforts, greatly exacerbating the problems. The only major change in this edition is the addition in the last article of a short discussion of China, a threat to peace and freedom as great as overpopulation and climate change and one to which even most professional scholars and politicians are oblivious so I regarded it as sufficiently important to warrant a new edition. I describe versions of this delusion (i.e., that we are basically ‘friendly’ if just given a chance) as it appears in some recent books on sociology/biology/economics. Even Sapolsky’s otherwise excellent “Behave”(2017) embraces leftist politics and group selection and gives space to a discussion of whether humans are innately violent. I end with an essay on the great tragedy playing out in America and the world, which can be seen as a direct result of our evolved psychology manifested as the inexorable machinations of System 1. Our psychology, eminently adaptive and eugenic on the plains of Africa from ca. 6 million years ago, when we split from chimpanzees, to ca. 50,000 years ago, when many of our ancestors left Africa (i.e., in the EEA or Environment of Evolutionary Adaptation), is now maladaptive and dysgenic and the source of our Suicidal Utopian Delusions. So, like all discussions of behavior (philosophy, psychology, sociology, biology, anthropology, politics, law, literature, history, economics, soccer strategies, business meetings, etc.), this book is about evolutionary strategies, selfish genes and inclusive fitness (kin selection, natural selection). The great mystic Osho said that the separation of God and Heaven from Earth and Humankind was the most evil idea that ever entered the Human mind. In the 20th century an even more evil notion arose, or at least became popular with leftists—that humans are born with rights, rather than having to earn privileges. The idea of human rights is an evil fantasy created by leftists to draw attention away from the merciless destruction of the earth by unrestrained 3rd world motherhood. Thus, every day the population increases by 200,000, who must be provided with resources to grow and space to live, and who soon produce another 200,000 etc. And one almost never hears it noted that what they receive must be taken from those already alive, and their descendants. Their lives diminish those already here in both major obvious and countless subtle ways. Every new baby destroys the earth from the moment of conception. In a horrifically overcrowded world with vanishing resources, there cannot be human rights without destroying the earth and our descendant’s futures. It could not be more obvious, but it is rarely mentioned in a clear and direct way, and one will never see the streets full of protesters against motherhood. The most basic facts, almost never mentioned, are that there are not enough resources in America or the world to lift a significant percentage of the poor out of poverty and keep them there. Even the attempt to do this is already bankrupting America and destroying the world. The earth’s capacity to produce food decreases daily, as does our genetic quality. And now, as always, by far the greatest enemy of the poor is other poor and not the rich. America and the world are in the process of collapse from excessive population growth, most of it for the last century, and now all of it, due to 3rd world people. Consumption of resources and the addition of 4 billion more ca. 2100 will collapse industrial civilization and bring about starvation, disease, violence and war on a staggering scale. The earth loses about 2% of its topsoil every year, so as it nears 2100, most of its food growing capacity will be gone. Billions will die and nuclear war is all but certain. In America, this is being hugely accelerated by massive immigration and immigrant reproduction, combined with abuses made possible by democracy. Depraved human nature inexorably turns the dream of democracy and diversity into a nightmare of crime and poverty. China will continue to overwhelm America and the world, as long as it maintains the dictatorship which limits selfishness. The root cause of collapse is the inability of our innate psychology to adapt to the modern world, which leads people to treat unrelated persons as though they had common interests (which I suggest may be regarded as an unrecognized -- but the commonest and most serious-- psychological problem -- Inclusive Fitness Disorder). This, plus ignorance of basic biology and psychology, leads to the social engineering delusions of the partially educated who control democratic societies. Few understand that if you help one person you harm someone else—there is no free lunch and every single item anyone consumes destroys the earth beyond repair. Consequently, social policies everywhere are unsustainable and one by one all societies without stringent controls on selfishness will collapse into anarchy or dictatorship. Without dramatic and immediate changes, there is no hope for preventing the collapse of America, or any country that follows a democratic system. Hence my concluding essay “Suicide by Democracy”. Those wishing to read my other writings may see Talking Monkeys 2nd ed (2019), The Logical Structure of Philosophy, Psychology, Mind and Language in Ludwig Wittgenstein and John Searle 2nd ed (2019), Suicide by Democracy 3rd ed (2019), The Logical Stucture of Human Behavior (2019) and Suicidal Utopian Delusions in the 21st Century 4th ed (2019

Flexibly Instructable Agents

This paper presents an approach to learning from situated, interactive tutorial instruction within an ongoing agent. Tutorial instruction is a flexible (and thus powerful) paradigm for teaching tasks because it allows an instructor to communicate whatever types of knowledge an agent might need in whatever situations might arise. To support this flexibility, however, the agent must be able to learn multiple kinds of knowledge from a broad range of instructional interactions. Our approach, called situated explanation, achieves such learning through a combination of analytic and inductive techniques. It combines a form of explanation-based learning that is situated for each instruction with a full suite of contextually guided responses to incomplete explanations. The approach is implemented in an agent called Instructo-Soar that learns hierarchies of new tasks and other domain knowledge from interactive natural language instructions. Instructo-Soar meets three key requirements of flexible instructability that distinguish it from previous systems: (1) it can take known or unknown commands at any instruction point; (2) it can handle instructions that apply to either its current situation or to a hypothetical situation specified in language (as in, for instance, conditional instructions); and (3) it can learn, from instructions, each class of knowledge it uses to perform tasks.Comment: See http://www.jair.org/ for any accompanying file

Suicidal Utopian Delusions in the 21st Century -- Philosophy, Human Nature and the Collapse of Civilization -- Articles and Reviews 2006-2019 4th Edition

The first group of articles attempt to give some insight into how we behave that is reasonably free of theoretical delusions. In the next three groups I comment on three of the principal delusions preventing a sustainable world— technology, religion and politics (cooperative groups). People believe that society can be saved by them, so I provide some suggestions in the rest of the book as to why this is unlikely via short articles and reviews of recent books by well-known writers. America and the world are in the process of collapse from excessive population growth, most of it for the last century and now all of it due to 3rd world people. Consumption of resources and the addition of 4 billion more ca. 2100 will collapse industrial civilization and bring about starvation, disease, violence and war on a staggering scale. Billions will die and nuclear war is all but certain. In America this is being hugely accelerated by massive immigration and immigrant reproduction, combined with abuses made possible by democracy. Depraved human nature inexorably turns the dream of democracy and diversity into a nightmare of crime and poverty. The root cause of collapse is the inability of our innate psychology to adapt to the modern world, which leads people to treat unrelated persons as though they had common interests. This, plus ignorance of basic biology and psychology, leads to the social engineering delusions of the partially educated who control democratic societies. Few understand that if you help one person you harm someone else—there is no free lunch and every single item anyone consumes destroys the earth beyond repair. Consequently social policies everywhere are unsustainable and one by one all societies without stringent controls on selfishness will collapse into anarchy or dictatorship. Without dramatic and immediate changes, there is no hope for preventing the collapse of America, or any country that follows a democratic system. Hence my concluding essay “Suicide by Democracy”

The development of conversational and communication skills

This thesis investigates the development of children's conversational and communication skills. This is done by investigating both communicative process and outcome in two communication media: face-to-face interaction and audio-only interaction. Communicative outcome is objectively measured by assessing accuracy of performance of communication tasks. A multi-level approach to the assessment of communicative process is taken. Non-verbal aspects of process which are investigated are gaze and gesture. Verbal aspects of process range from global linguistic assessments such as length of conversational turn, to a detailed coding of utterance function according to Conversational Games analysis. The results show that children of 6 years and less do not adapt to the loss of visual signals in audio-only communication, and their performance suffers. Both the structure of children's dialogues and their use of visual signals were found to differ from that of adults. It is concluded that both verbal and non-verbal communication strategies develop into adulthood. Successful integration of these different aspects of communication is central to being an effective communicator