A Cognitive Architecture Based on a Learning Classifier System with Spiking Classifiers

© 2015, Springer Science+Business Media New York. Learning classifier systems (LCS) are population-based reinforcement learners that were originally designed to model various cognitive phenomena. This paper presents an explicitly cognitive LCS by using spiking neural networks as classifiers, providing each classifier with a measure of temporal dynamism. We employ a constructivist model of growth of both neurons and synaptic connections, which permits a genetic algorithm to automatically evolve sufficiently-complex neural structures. The spiking classifiers are coupled with a temporally-sensitive reinforcement learning algorithm, which allows the system to perform temporal state decomposition by appropriately rewarding “macro-actions”, created by chaining together multiple atomic actions. The combination of temporal reinforcement learning and neural information processing is shown to outperform benchmark neural classifier systems, and successfully solve a robotic navigation task

Third Conference on Artificial Intelligence for Space Applications, part 2

Topics relative to the application of artificial intelligence to space operations are discussed. New technologies for space station automation, design data capture, computer vision, neural nets, automatic programming, and real time applications are discussed

An Improved Continuous-Action Extended Classifier Systems for Function Approximation

AbstractDue to their structural simplicity and superior generalization capability, Extended Classifier Systems (XCSs) are gaining popularity within the Artificial Intelligence community. In this study an improved XCS with continuous actions is introduced for function approximation purposes. The proposed XCSF uses “prediction zones,” rather than distinct “prediction values,” to enable multi-member match sets that would allow multiple rules to be evaluated per training step. It is shown that this would accelerate the training procedure and reduce the computational cost associated with the training phase. The improved XCSF is also shown to produce more accurate rules than the classical classifier system when it comes to approximating complex nonlinear functions

Integrated control of vehicle chassis systems

This thesis develops a method to integrate several automotive intelligent chassis systems, such as Anti-lock Brake System, Traction Control System, Direct Yaw Control and Active Rear Wheel Steering, using evolutionary approaches. The Integrated Vehicle Control System (IVCS) combines and supervises all controllable systems in the vehicle, optimising the over all performance and minimising the energy consumption. The IVCS is able to improve the driving safety avoiding and preventing critical or unstable situations. Furthermore, if a critical or unstable configuration is reached, the integrated system should be able to recover a stable condition. The control structure proposed in this work has as main characteristics the modularity, extensibility and flexibility, fitting the requirements of a 'plug-and-play' philosophy. The investigation is divided into four steps: Vehicle Modelling, Soft-Computing, Behaviour Based Control, and Integrated Vehicle Control System. Several mathematical vehicle models, which are applied to designing and developing the control systems, are presented. MATLAB, SIMULINK and ADAMS are used as tools to implement and simulate those models. A methodology for learning and optimisation is presented. This methodology is based on Evolutionary Algorithms, integrating the Genetic Leaming Automata, CARLA and Fuzzy Logic System. The Behaviour Based Control is introduced as the main approach to designing the controllers and coordinators. The methodology previously described is used to learn the behaviours and optimise their performance, and the same technique is applied to coordinators. Several comparisons with other controllers are also carried out. From this an Integrated Vehicle Control System is designed, developed and implemented under a virtual environment. A range of manoeuvres is carried out in order to investigate its performance under diverse conditions. The leaming and optimisation method proposed in this thesis shows effective performance being able to learn all the controller and coordinator structures. The proposed approach for IVCS also demonstrates good performance, and is well suited to a 'plug-and-play' philosophy. This research provides a foundation for the implementation of the designed controllers and coordinators in a prototype vehicle.EThOS - Electronic Theses Online ServiceGBUnited Kingdo

Enhanced Distributed Learning Classifier System For Simulated Mobile Robot Behaviours

The four basic behaviours of mobile robot are chasing, approaching, avoiding and escaping. The main problem in robotic system is in selecting the correct behaviour. The aim of this research is to overcome the behaviour selection problem. This thesis proposes methods that can overcome the problems of good behaviour selection and good behaviour deletion. It also addresses the problem of missing information, solves the problem of oscillating between correct and incorrect behaviours, and addresses the low efficiency in mapping the input to the correct behaviour. A Distributed Learning Classifier System (DLCS) consisting of five Learning Classifier Systems (LCS) with hierarchical architecture of three levels is used. An enhanced Bucket Brigade Algorithm (BBA) is developed to avoid the problem of choosing classifiers with high strength value but with incorrect behaviour. An approach that detects steady state value for calling genetic algorithm (GA) is proposed to overcome the problems of good classifiers deletion and the local minima trap. Finally, efficient solutions for covering detectors, supporting default hierarchies formation and the oscillation between correct and incorrect action are introduced to avoid performance failure, generalisation of classifiers that have the ability to cover the specific and general conditions, and loss of desirable classifiers respectively. Overall, the enhanced approaches performed well and the enhanced learning processes proposed in the current study makes robot learning more effective. The simulated robot is tested and results have shown that it performs better with the four basic behaviours. The simulated robot is also tested on many examples of a complex behaviour which is any combination of the four basic behaviours and the results have shown that it performs better with this type of behaviours as well

Intent Classification during Human-Robot Contact

Robots are used in many areas of industry and automation. Currently, human safety is ensured through physical separation and safeguards. However, there is increasing interest in allowing robots and humans to work in close proximity or on collaborative tasks. In these cases, there is a need for the robot itself to recognize if a collision has occurred and respond in a way which prevents further damage or harm. At the same time, there is a need for robots to respond appropriately to intentional contact during interactive and collaborative tasks. This thesis proposes a classification-based approach for differentiating between several intentional contact types, accidental contact, and no-contact situations. A dataset is de- veloped using the Franka Emika Panda robot arm. Several machine learning algorithms, including Support Vector Machines, Convolutional Neural Networks, and Long Short-Term Memory Networks, are applied and used to perform classification on this dataset. First, Support Vector Machines were used to perform feature identification. Compar- isons were made between classification on raw sensor data compared to data calculated from a robot dynamic model, as well as between linear and nonlinear features. The results show that very few features can be used to achieve the best results, and accuracy is highest when combining raw data from sensors with model-based data. Accuracies of up to 87% were achieved. Methods of performing classification on the basis of each individual joint, compared to the whole arm, are tested, and shown not to provide additional benefits. Second, Convolutional Neural Networks and Long Short-Term Memory Networks were evaluated for the classification task. A simulated dataset was generated and augmented with noise for training the classifiers. Experiments show that additional simulated and augmented data can improve accuracy in some cases, as well as lower the amount of real- world data required to train the networks. Accuracies up to 93% and 84% we achieved by the CNN and LSTM networks, respectively. The CNN achieved an accuracy of 87% using all real data, and up to 93% using only 50% of the real data with simulated data added to the training set, as well as with augmented data. The LSTM achieved an accuracy of 75% using all real data, and nearly 80% accuracy using 75% of real data with augmented simulation data