The Performance of Binary Artificial Bee Colony (BABC) in Structure Selection of Polynomial NARX and NARMAX Models

This paper explores the capability of the Binary Artificial Bee Colony (BABC) algorithm for feature selection of Nonlinear Autoregressive Moving Average with Exogenous Inputs (NARMAX) model, and compares its implementation with the Binary Particle Swarm Optimization (BPSO) algorithm. A binarized modification of the BABC algorithm was used to perform structure selection of the NARMAX model on a Flexible Robot Arm (FRA) dataset. The solution quality and convergence was compared with the BPSO optimization algorithm. Fitting and validation tests were performed using the One-Step Ahead (OSA), correlation and histogram tests. BABC was able to outperform BPSO in terms of convergence consistency with equal solution quality. Additionally, it was discovered that BABC was less prone to converge to local minima while BPSO was able to converge faster. Results from this study showed that BABC was better-suited for structure selection in huge dataset and the convergence has been proven to be more consistent relative to BPSO

Comparison between Binary Particles Swarm Optimization (BPSO) and Binary Artificial Bee Colony (BABC) for nonlinear autoregressive model structure selection of chaotic data

No Abstract

Modeling Dynamic Systems for Multi-Step Prediction with Recurrent Neural Networks

This thesis investigates the applicability of Recurrent Neural Networks (RNNs) and Deep Learning methods for multi-step prediction of robotic systems. The unmodeled dynamics and simplifying assumptions in classic modeling methods result in models that yield rapidly diverging predictions when the model is used in an iterative fashion, i.e., for multi-step prediction. However, the effect of the unmodeled dynamics can be captured by collecting datasets of the system. Deep Learning provides a strong set of tools to extract patterns from data, however, large datasets are commonly required for the methods to work well. Collecting a large amount of data from a robotic system can be a cumbersome and expensive approach. In this work, Deep Learning methods, particularly RNNs, are studied and employed for the purpose of learning models of two aerial vehicles from experimental data. The feasibility of employing RNNs is first studied to learn a model of a quadrotor based on a simulated dataset, which yields a Multi Layer Fully Connected (MLFC) architecture. Models can be learned for multi-step prediction, recovering excellent predictions over 500 timesteps in the presence of simulated disturbances to the robot and noise on the measurements. To learn models from experimental data, the RNN state initialization problem is defined and formulated. It is shown that the RNN state initialization problem can be addressed by creating and training an initialization network jointly with the multi-step prediction network, and the combination can be used in a black-box modeling approach such that the model produces predictions which are immediately accurate. The RNN based black-box methods are trained on an experimental dataset gathered from a quadrotor and a publicly available helicopter dataset. The quadrotor dataset, which encompasses approximately 4 hours of flight data in various regimes, has been released and is now available publicly online. Finally, a hybrid network, which combines the proposed RNN based black-box models with a physics based quadrotor model into a single RNN-based modeling system is introduced. The proposed hybrid network solves many of the limitations of the existing state of the art in long-term prediction for robotics systems. Trained on the quadrotor dataset, the hybrid model provides accurate body angular rate and velocity predictions of the vehicle over almost 2 seconds which is suitable to be used in a variety of model-based controller applications