Evolutionary robotics and neuroscience

No description supplie

Recurrent neural networks and adaptive motor control

This thesis is concerned with the use of neural networks for motor control tasks. The main goal of the thesis is to investigate ways in which the biological notions of motor programs and Central Pattern Generators (CPGs) may be implemented in a neural network framework. Biological CPGs can be seen as components within a larger control scheme, which is basically modular in design. In this thesis, these ideas are investigated through the use of modular recurrent networks, which are used in a variety of control tasks. The first experimental chapter deals with learning in recurrent networks, and it is shown that CPGs may be easily implemented using the machinery of backpropagation. The use of these CPGs can aid the learning of pattern generation tasks; they can also mean that the other components in the system can be reduced in complexity, say, to a purely feedforward network. It is also shown that incremental learning, or 'shaping' is an effective method for building CPGs. Genetic algorithms are also used to build CPGs; although computational effort prevents this from being a practical method, it does show that GAs are capable of optimising systems that operate in the context of a larger scheme. One interesting result from the GA is that optimal CPGs tend to have unstable dynamics, which may have implications for building modular neural controllers. The next chapter applies these ideas to some simple control tasks involving a highly redundant simulated robot arm. It was shown that it is relatively straightforward to build CPGs that represent elements of pattern generation, constraint satisfaction. and local feedback. This is indirect control, in which errors are backpropagated through a plant model, as well as the ePG itself, to give errors for the controller. Finally, the third experimental chapter takes an alternative approach, and uses direct control methods, such as reinforcement learning. In reinforcement learning, controller outputs have unmodelled effects; this allows us to build complex control systems, where outputs modulate the couplings between sets of dynamic systems. This was shown for a simple case, involving a system of coupled oscillators. A second set of experiments investigates the use of simplified models of behaviour; this is a reduced form of supervised learning, and the use of such models in control is discussed

Formal Modeling of Connectionism using Concurrency Theory, an Approach Based on Automata and Model Checking

This paper illustrates a framework for applying formal methods techniques, which are symbolic in nature, to specifying and verifying neural networks, which are sub-symbolic in nature. The paper describes a communicating automata [Bowman & Gomez, 2006] model of neural networks. We also implement the model using timed automata [Alur & Dill, 1994] and then undertake a verification of these models using the model checker Uppaal [Pettersson, 2000] in order to evaluate the performance of learning algorithms. This paper also presents discussion of a number of broad issues concerning cognitive neuroscience and the debate as to whether symbolic processing or connectionism is a suitable representation of cognitive systems. Additionally, the issue of integrating symbolic techniques, such as formal methods, with complex neural networks is discussed. We then argue that symbolic verifications may give theoretically well-founded ways to evaluate and justify neural learning systems in the field of both theoretical research and real world applications

Nonlinear self-tuning control for power oscillation damping

Power systems exhibit nonlinear behavior especially during disturbances, necessitating the application of appropriate nonlinear control techniques. Lack of availability of accurate and updated models for the whole power system adds to the challenge. Conventional damping control design approaches consider a single operating condition of the system, which are obviously simple but tend to lack performance robustness. Objective of this research work is to design a measurement based self-tuning controller, which does not rely on accurate models and deals with nonlinearities in system response. Designed controller is required to ensure settling of inter-area oscillations within 10−12s, following disturbance such as a line outage. The neural network (NN) model is illustrated for the representation of nonlinear power systems. An optimization based algorithm, Levenberg-Marquardt (LM), for online estimation of power system dynamic behavior is proposed in batch mode to improve the model estimation. Careful study shows that the LM algorithm yields better closed loop performance, compared to conventional recursive least square (RLS) approach with the pole-shifting controller (PSC) in linear framework. Exploiting the capability of LM, a special form of neural network compatible with feedback linearization technique, is applied. Validation of the performance of proposed algorithm is done through the modeling and simulating heavy loading of transmission lines, when the nonlinearities are pronounced. Nonlinear NN model in the Feedback Linearization (FLNN) form gives better estimation than the autoregressive with an external input (ARX) form. The proposed identifier (FLNN with LM algorithm) is then tested on a 4−machine, 2−area power system in conjunction with the feedback linearization controller (FBLC) under varying operating conditions. This case study indicates that the developed closed loop strategy performs better than the linear NN with PSC. Extension of FLNN with FBLC structure in a multi-variable setup is also done. LM algorithm is successfully employed with the multi-input multi-output FLNN structure in a sliding window batch mode, and FBLC controller generates multiple control signals for FACTS. Case studies on a large scale 16−machine, 5−area power system are reported for different power flow scenarios, to prove the superiority of proposed schemes: both MIMO and MISO against a conventional model based controller. A coefficient vector for FBLC is derived, and utilized online at each time instant, to enhance the damping performance of controller, transforming into a time varying controller

Neural Networks for Modeling and Control of Particle Accelerators

We describe some of the challenges of particle accelerator control, highlight recent advances in neural network techniques, discuss some promising avenues for incorporating neural networks into particle accelerator control systems, and describe a neural network-based control system that is being developed for resonance control of an RF electron gun at the Fermilab Accelerator Science and Technology (FAST) facility, including initial experimental results from a benchmark controller.Comment: 21 p

Bio-inspired Dynamic Control Systems with Time Delays

The world around us exhibits a rich and ever changing environment of startling, bewildering and fascinating complexity. Almost everything is never as simple as it seems, but through the chaos we may catch fleeting glimpses of the mechanisms within. Throughout the history of human endeavour we have mimicked nature to harness it for our own ends. Our attempts to develop truly autonomous and intelligent machines have however struggled with the limitations of our human ability. This has encouraged some to shirk this responsibility and instead model biological processes and systems to do it for us. This Thesis explores the introduction of continuous time delays into biologically inspired dynamic control systems. We seek to exploit rich temporal dynamics found in physical and biological systems for modelling complex or adaptive behaviour through the artificial evolution of networks to control robots. Throughout, arguments have been presented for the modelling of delays not only to better represent key facets of physical and biological systems, but to increase the computational potential of such systems for the synthesis of control. The thorough investigation of the dynamics of small delayed networks with a wide range of time delays has been undertaken, with a detailed mathematical description of the fixed points of the system and possible oscillatory modes developed to fully describe the behaviour of a single node. Exploration of the behaviour for even small delayed networks illustrates the range of complex behaviour possible and guides the development of interesting solutions. To further exploit the potential of the rich dynamics in such systems, a novel approach to the 3D simulation of locomotory robots has been developed focussing on minimising the computational cost. To verify this simulation tool a simple quadruped robot was developed and the motion of the robot when undergoing a manually designed gait evaluated. The results displayed a high degree of agreement between the simulation and laser tracker data, verifying the accuracy of the model developed. A new model of a dynamic system which includes continuous time delays has been introduced, and its utility demonstrated in the evolution of networks for the solution of simple learning behaviours. A range of methods has been developed for determining the time delays, including the novel concept of representing the time delays as related to the distance between nodes in a spatial representation of the network. The application of these tools to a range of examples has been explored, from Gene Regulatory Networks (GRNs) to robot control and neural networks. The performance of these systems has been compared and contrasted with the efficacy of evolutionary runs for the same task over the whole range of network and delay types. It has been shown that delayed dynamic neural systems are at least as capable as traditional Continuous Time Recurrent Neural Networks (CTRNNs) and show significant performance improvements in the control of robot gaits. Experiments in adaptive behaviour, where there is not such a direct link between the enhanced system dynamics and performance, showed no such discernible improvement. Whilst we hypothesise that the ability of such delayed networks to generate switched pattern generating nodes may be useful in Evolutionary Robotics (ER) this was not borne out here. The spatial representation of delays was shown to be more efficient for larger networks, however these techniques restricted the search to lower complexity solutions or led to a significant falloff as the network structure becomes more complex. This would suggest that for anything other than a simple genotype, the direct method for encoding delays is likely most appropriate. With proven benefits for robot locomotion and the open potential for adaptive behaviour delayed dynamic systems for evolved control remain an interesting and promising field in complex systems research

A functional link network based adaptive power system stabilizer

An on-line identifier using Functional Link Network (FLN) and Pole-shift (PS) controller for power system stabilizer (PSS) application are presented in this thesis. To have the satisfactory performance of the PSS controller, over a wide range of operating conditions, it is desirable to adapt PSS parameters in real time. Artificial Neural Networks (ANNs) transform the inputs in a low-dimensional space to high-dimensional nonlinear hidden unit space and they have the ability to model the nonlinear characteristics of the power system. The ability of ANNs to learn makes them more suitable for use in adaptive control techniques. On-line identification obtains a mathematical model at each sampling period to track the dynamic behavior of the plant. The ANN identifier consisting of a Functional link Network (FLN) is used for identifying the model parameters. A FLN model eliminates the need of hidden layer while retaining the nonlinear mapping capability of the neural network by using enhanced inputs. This network may be conveniently used for function approximation with faster convergence rate and lesser computational load. The most commonly used Pole Assignment (PA) algorithm for adaptive control purposes assign the pole locations to fixed locations within the unit circle in the z-plane. It may not be optimum for different operating conditions. In this thesis, PS type of adaptive control algorithm is used. This algorithm, instead of assigning the closed-loop poles to fixed locations within the unit circle in the z-plane, this algorithm assumes that the pole characteristic polynomial of the closed-loop system has the same form as the pole characteristic of the open-loop system and shifts the open-loop poles radially towards the centre of the unit circle in the z-plane by a shifting factor α according to some rules. In this control algorithm, no coefficients need to be tuned manually, so manual parameter tuning (which is a drawback in conventional power system stabilizer) is minimized. The PS control algorithm uses the on-line updated ARMA parameters to calculate the new closed-loop poles of the system that are always inside the unit circle in the z-plane. Simulation studies on a single-machine infinite bus and on a multi-machine power system for various operating condition changes, verify the effectiveness of the combined model of FLN identifier and PS control in damping the local and multi-mode oscillations occurring in the system. Simulation studies prove that the APSSs have significant benefits over conventional PSSs: performance improvement and no requirement for parameter tuning

A New Approach of the Online Tuning Gain Scheduling Nonlinear PID Controller Using Neural Network

This chapter presents the design, development and implementation of a novel proposed online-tuning Gain Scheduling Dynamic Neural PID (DNN-PID) Controller using neural network suitable for real-time manipulator control applications. The unique feature of the novel DNN-PID controller is that it has highly simple and dynamic self-organizing structure, fast online-tuning speed, good generalization and flexibility in online-updating. The proposed adaptive algorithm focuses on fast and efficiently optimizing Gain Scheduling and PID weighting parameters of Neural MLPNN model used in DNN-PID controller. This approach is employed to implement the DNN-PID controller with a view of controlling the joint angle position of the highly nonlinear pneumatic artificial muscle (PAM) manipulator in real-time through Real-Time Windows Target run in MATLAB SIMULINK® environment. The performance of this novel proposed controller was found to be outperforming in comparison with conventional PID controller. These results can be applied to control other highly nonlinear SISO and MIMO systems. Keywords: highly nonlinear PAM manipulator, proposed online tuning Gain Scheduling Dynamic Nonlinear PID controller (DNN-PID), real-time joint angle position control, fast online tuning back propagation (BP) algorithm, pneumatic artificial muscle (PAM) actuator