Myths and Legends of the Baldwin Effect

This position paper argues that the Baldwin effect is widely misunderstood by the evolutionary computation community. The misunderstandings appear to fall into two general categories. Firstly, it is commonly believed that the Baldwin effect is concerned with the synergy that results when there is an evolving population of learning individuals. This is only half of the story. The full story is more complicated and more interesting. The Baldwin effect is concerned with the costs and benefits of lifetime learning by individuals in an evolving population. Several researchers have focussed exclusively on the benefits, but there is much to be gained from attention to the costs. This paper explains the two sides of the story and enumerates ten of the costs and benefits of lifetime learning by individuals in an evolving population. Secondly, there is a cluster of misunderstandings about the relationship between the Baldwin effect and Lamarckian inheritance of acquired characteristics. The Baldwin effect is not Lamarckian. A Lamarckian algorithm is not better for most evolutionary computing problems than a Baldwinian algorithm. Finally, Lamarckian inheritance is not a better model of memetic (cultural) evolution than the Baldwin effect

How to shift bias: Lessons from the Baldwin effect

An inductive learning algorithm takes a set of data as input and generates a hypothesis as output. A set of data is typically consistent with an infinite number of hypotheses; therefore, there must be factors other than the data that determine the output of the learning algorithm. In machine learning, these other factors are called the bias of the learner. Classical learning algorithms have a fixed bias, implicit in their design. Recently developed learning algorithms dynamically adjust their bias as they search for a hypothesis. Algorithms that shift bias in this manner are not as well understood as classical algorithms. In this paper, we show that the Baldwin effect has implications for the design and analysis of bias shifting algorithms. The Baldwin effect was proposed in 1896, to explain how phenomena that might appear to require Lamarckian evolution (inheritance of acquired characteristics) can arise from purely Darwinian evolution. Hinton and Nowlan presented a computational model of the Baldwin effect in 1987. We explore a variation on their model, which we constructed explicitly to illustrate the lessons that the Baldwin effect has for research in bias shifting algorithms. The main lesson is that it appears that a good strategy for shift of bias in a learning algorithm is to begin with a weak bias and gradually shift to a strong bias

A deep reinforcement learning based homeostatic system for unmanned position control

Deep Reinforcement Learning (DRL) has been proven to be capable of designing an optimal control theory by minimising the error in dynamic systems. However, in many of the real-world operations, the exact behaviour of the environment is unknown. In such environments, random changes cause the system to reach different states for the same action. Hence, application of DRL for unpredictable environments is difficult as the states of the world cannot be known for non-stationary transition and reward functions. In this paper, a mechanism to encapsulate the randomness of the environment is suggested using a novel bio-inspired homeostatic approach based on a hybrid of Receptor Density Algorithm (an artificial immune system based anomaly detection application) and a Plastic Spiking Neuronal model. DRL is then introduced to run in conjunction with the above hybrid model. The system is tested on a vehicle to autonomously re-position in an unpredictable environment. Our results show that the DRL based process control raised the accuracy of the hybrid model by 32%.N/

Intuitive expertise in ICT graduate supervision

Intuitive expertise in the application of advanced interdisciplinary facilitation is the subject of this personal reflection on the graduate supervisory style of Professor David Squires in computers in education. This single‐case reflective study examines the characteristics of effective supervision observed during masters and doctoral supervision at King's College in the years 1990–9. Interdisciplinarity in ICT graduate studies particularly requires a fluency of supervisory expertise in enabling supervisees to combine multiple complex perspectives from a number of fields of knowledge. Intuitive combinatory aspects of supervision are highlighted in this reflection on the role carried out by an academic expert in facilitating student success. This is examined from a perspective incorporating affective as well as intellectual elements, informed by characteristics identified in professional sports and performing arts coaching/mentoring. Key characteristics comprising a model of intuitive expertise in ICT graduate supervision were outlined. The resultant portrait aims to complement existing literature on graduate supervision, with reference to the field of ICTI computers in education relating to student hypermedia composition

Social learning mechanisms compared in a simple environment

Social learning can be adaptive, but little is known about the underlying mechanisms. Many researchers have focused on imitation but this may have led to simpler mechanisms being underestimated. We demonstrate in simulation that imitative learning is not always the best strategy for a group-living animal, and that the effectiveness of any such strategy will depend on details of the environment and the animal's lifestyle. We show that observations of behavioural convergence or "traditions" might suggest effective social learning, but are meaningless considered alone

Recognizing complex gestures via natural interfaces

Natural interfaces have revolutionized the way we interact with computers. They have provided in many fields a comfortable and efficient mechanism that requires no computer knowledge, nor artificial controlling devices, but allow as to interoperate via natural gestures. Diverse fields such as entertainment, remote control, medicine, fitness exercise are finding improvements with the introduction of this technology. However, most of these sensorial interfaces only provide support for basic gestures. In this work we show how it is possible to construct your own complex gestures using the underlying capabilities of these sensor devices.Universidad de Málaga. Campus de Excelencia Internacional Andalucía Tec