Intentions and Creative Insights: a Reinforcement Learning Study of Creative Exploration in Problem-Solving

Insight is perhaps the cognitive phenomenon most closely associated with creativity. People engaged in problem-solving sometimes experience a sudden transformation: they see the problem in a radically different manner, and simultaneously feel with great certainty that they have found the right solution. The change of problem representation is called "restructuring", and the affective changes associated with sudden progress are called the "Aha!" experience. Together, restructuring and the "Aha!" experience characterize insight. Reinforcement Learning is both a theory of biological learning and a subfield of machine learning. In its psychological and neuroscientific guise, it is used to model habit formation, and, increasingly, executive function. In its artificial intelligence guise, it is currently the favored paradigm for modeling agents interacting with an environment. Reinforcement learning, I argue, can serve as a model of insight: its foundation in learning coincides with the role of experience in insight problem-solving; its use of an explicit "value" provides the basis for the "Aha!" experience; and finally, in a hierarchical form, it can achieve a sudden change of representation resembling restructuring. An experiment helps confirm some parallels between reinforcement learning and insight. It shows how transfer from prior tasks results in considerably accelerated learning, and how the value function increase resembles the sense of progress corresponding to the "Aha!"-moment. However, a model of insight on the basis of hierarchical reinforcement learning did not display the expected "insightful" behavior. A second model of insight is presented, in which temporal abstraction is based on self-prediction: by predicting its own future decisions, an agent adjusts its course of action on the basis of unexpected events. This kind of temporal abstraction, I argue, corresponds to what we call "intentions", and offers a promising model for biological insight. It explains the "Aha!" experience as resulting from a temporal difference error, whereas restructuring results from an adjustment of the agent's internal state on the basis of either new information or a stochastic interpretation of stimuli. The model is called the actor-critic-intention (ACI) architecture. Finally, the relationship between intentions, insight, and creativity is extensively discussed in light of these models: other works in the philosophical and scientific literature are related to, and sometimes illuminated by the ACI architecture

Artificial general intelligence: Proceedings of the Second Conference on Artificial General Intelligence, AGI 2009, Arlington, Virginia, USA, March 6-9, 2009

Artificial General Intelligence (AGI) research focuses on the original and ultimate goal of AI – to create broad human-like and transhuman intelligence, by exploring all available paths, including theoretical and experimental computer science, cognitive science, neuroscience, and innovative interdisciplinary methodologies. Due to the difficulty of this task, for the last few decades the majority of AI researchers have focused on what has been called narrow AI – the production of AI systems displaying intelligence regarding specific, highly constrained tasks. In recent years, however, more and more researchers have recognized the necessity – and feasibility – of returning to the original goals of the field. Increasingly, there is a call for a transition back to confronting the more difficult issues of human level intelligence and more broadly artificial general intelligence

Insights Into Global Engineering Education After the Birth of Industry 5.0

Insights Into Global Engineering Education After the Birth of Industry 5.0 presents a comprehensive overview of recent developments in the fields of engineering and technology. The book comprises single chapters authored by various researchers and edited by an expert active in the engineering education research area. It provides a thorough overview of the latest research efforts by international authors on engineering education and opens potential new research paths for further novel developments

Artificial Intelligence for a Better Future

This open access book proposes a novel approach to Artificial Intelligence (AI) ethics. AI offers many advantages: better and faster medical diagnoses, improved business processes and efficiency, and the automation of boring work. But undesirable and ethically problematic consequences are possible too: biases and discrimination, breaches of privacy and security, and societal distortions such as unemployment, economic exploitation and weakened democratic processes. There is even a prospect, ultimately, of super-intelligent machines replacing humans. The key question, then, is: how can we benefit from AI while addressing its ethical problems? This book presents an innovative answer to the question by presenting a different perspective on AI and its ethical consequences. Instead of looking at individual AI techniques, applications or ethical issues, we can understand AI as a system of ecosystems, consisting of numerous interdependent technologies, applications and stakeholders. Developing this idea, the book explores how AI ecosystems can be shaped to foster human flourishing. Drawing on rich empirical insights and detailed conceptual analysis, it suggests practical measures to ensure that AI is used to make the world a better place

European governance challenges in bio-engineering : making perfect life : bio-engineering (in) the 21st century : final report

In the STOA project Making Perfect Life four fields were studied of 21st century bio-engineering: engineering of living artefacts, engineering of the body, engineering of the brain, and engineering of intelligent artefacts. This report describes the main results of the project. It shows how developments in the four fields of bio-engineering are shaped by two megatrends: "biology becoming technology" and "technology becoming biology". These developments result in a broadening of the bio-engineering debate in our society. The report addresses the long term views that are inspiring this debate and discusses a multitude of ethical, legal and social issues that arise from bio-engineering developments in the fields described. Against this background four specific developments are studied in more detail: the rise of human genome sequencing, the market introduction of neurodevices, the capturing by information technology of the psychological and physiological states of users, and the pursuit of standardisation in synthetic biology. These developments are taken in this report as a starting point for an analysis of some of the main European governance challenges in 21st century bio-engineering

European governance challenges in bio-engineering : making perfect life : bio-engineering (in) the 21st century : final report

In the STOA project Making Perfect Life four fields were studied of 21st century bio-engineering: engineering of living artefacts, engineering of the body, engineering of the brain, and engineering of intelligent artefacts. This report describes the main results of the project. It shows how developments in the four fields of bio-engineering are shaped by two megatrends: "biology becoming technology" and "technology becoming biology". These developments result in a broadening of the bio-engineering debate in our society. The report addresses the long term views that are inspiring this debate and discusses a multitude of ethical, legal and social issues that arise from bio-engineering developments in the fields described. Against this background four specific developments are studied in more detail: the rise of human genome sequencing, the market introduction of neurodevices, the capturing by information technology of the psychological and physiological states of users, and the pursuit of standardisation in synthetic biology. These developments are taken in this report as a starting point for an analysis of some of the main European governance challenges in 21st century bio-engineering

From Logic to Realism to Brighter Future for Humanity

This collection of articles explores a wide range of subject, from Godel’s incompleteness theorem, to possible technocalypse and neutrofuturology. Articles on historical debates on irrational number to electroculture, on vortex particle, or on different Neutrosophic applications are included