A brief review of neural networks based learning and control and their applications for robots

As an imitation of the biological nervous systems, neural networks (NN), which are characterized with powerful learning ability, have been employed in a wide range of applications, such as control of complex nonlinear systems, optimization, system identification and patterns recognition etc. This article aims to bring a brief review of the state-of-art NN for the complex nonlinear systems. Recent progresses of NNs in both theoretical developments and practical applications are investigated and surveyed. Specifically, NN based robot learning and control applications were further reviewed, including NN based robot manipulator control, NN based human robot interaction and NN based behavior recognition and generation

Resource-Aware Predictive Models in Cyber-Physical Systems

Cyber-Physical Systems (CPS) are composed of computing devices interacting with physical systems. Model-based design is a powerful methodology in CPS design in the implementation of control systems. For instance, Model Predictive Control (MPC) is typically implemented in CPS applications, e.g., in path tracking of autonomous vehicles. MPC deploys a model to estimate the behavior of the physical system at future time instants for a specific time horizon. Ordinary Differential Equations (ODE) are the most commonly used models to emulate the behavior of continuous-time (non-)linear dynamical systems. A complex physical model may comprise thousands of ODEs that pose scalability, performance and power consumption challenges. One approach to address these model complexity challenges are frameworks that automate the development of model-to-model transformation. In this dissertation, a state-based model with tunable parameters is proposed to operate as a reconfigurable predictive model of the physical system. Moreover, we propose a run-time switching algorithm that selects the best model using machine learning. We employed a metric that formulates the trade-off between the error and computational savings due to model reduction. Building statistical models are constrained to having expert knowledge and an actual understanding of the modeled phenomenon or process. Also, statistical models may not produce solutions that are as robust in a real-world context as factors outside the model, like disruptions would not be taken into account. Machine learning models have emerged as a solution to account for the dynamic behavior of the environment and automate intelligence acquisition and refinement. Neural networks are machine learning models, well-known to have the ability to learn linear and nonlinear relations between input and output variables without prior knowledge. However, the ability to efficiently exploit resource-hungry neural networks in embedded resource-bound settings is a major challenge.Here, we proposed Priority Neuron Network (PNN), a resource-aware neural networks model that can be reconfigured into smaller sub-networks at runtime. This approach enables a trade-off between the model's computation time and accuracy based on available resources. The PNN model is memory efficient since it stores only one set of parameters to account for various sub-network sizes. We propose a training algorithm that applies regularization techniques to constrain the activation value of neurons and assigns a priority to each one. We consider the neuron's ordinal number as our priority criteria in that the priority of the neuron is inversely proportional to its ordinal number in the layer. This imposes a relatively sorted order on the activation values. We conduct experiments to employ our PNN as the predictive model in a CPS application. We can see that not only our technique will resolve the memory overhead of DNN architectures but it also reduces the computation overhead for the training process substantially. The training time is a critical matter especially in embedded systems where many NN models are trained on the fly

Feasible, Robust and Reliable Automation and Control for Autonomous Systems

The Special Issue book focuses on highlighting current research and developments in the automation and control field for autonomous systems as well as showcasing state-of-the-art control strategy approaches for autonomous platforms. The book is co-edited by distinguished international control system experts currently based in Sweden, the United States of America, and the United Kingdom, with contributions from reputable researchers from China, Austria, France, the United States of America, Poland, and Hungary, among many others. The editors believe the ten articles published within this Special Issue will be highly appealing to control-systems-related researchers in applications typified in the fields of ground, aerial, maritime vehicles, and robotics as well as industrial audiences

Real-time support for high performance aircraft operation

The feasibility of real-time processing schemes using artificial neural networks (ANNs) is investigated. A rationale for digital neural nets is presented and a general processor architecture for control applications is illustrated. Research results on ANN structures for real-time applications are given. Research results on ANN algorithms for real-time control are also shown

The application of neural networks in active suspension

This thesis considers the application of neural networks to automotive suspension systems. In particular their ability to learn non-linear feedback control relationships. The speed of processing, once trained, means that neural networks open up new opportunities and allow increased complexity in the control strategies employed. The suitability of neural networks for this task is demonstrated here using multilayer perceptron, (MLP) feed forward neural networks applied to a quarter vehicle simulation model. Initially neural networks are trained from a training data set created using a non-linear optimal control strategy, the complexity of which prohibits its direct use. They are shown to be successful in learning the relationship between the current system states and the optimal control. [Continues.

Model-based powertrain design and control system development for the ideal all-wheel drive electric vehicle

The transfer case based all-wheel drive electric vehicle (TCAWDEV) and dual-axle AWDEV have been investigated to balance concerns about energy consumption, drivability and stability of vehicles. However, the mentioned powertrain architectures have the torque windup issue or the wheel skidding issue. The torque windup is an inherent issue of mechanical linked all-wheel drive systems. The hydraulic motor-based or the electric motor-based ideal all-wheel drive powertrain can provide feasible solutions to the mentioned issues. An ideal AWDEV (IAWDEV) powertrain architecture and its control schemes were proposed by this research; the architecture has four independent driving motors in powertrain. The IAWDEV gives more control freedoms to implement active torque controls and traction mode controls. In essence, this research came up with the distributed powertrain concept, and developed control schemes of the distributed powertrain to replace the transfer case and differential devices. The study investigated the dual-loop motor control, the hybrid sliding mode control (HSMC) and the neural network predictive control to reduce energy consumption and achieve better drivability and stability by optimizing the torque allocation of each dependent wheel. The mentioned control schemes were respectively developed for the anti-slip, differential and yaw stability functionalities of the IAWDEV powertrain. This study also investigated the sizing method that the battery capacity was estimated by using cruise performance at 3% road grade. In addition, the model-based verification was employed to evaluate the proposed powertrain design and control schemes. The verification shows that the design and controls can fulfill drivability requirements and minimize the existing issues, including torque windup and chattering of the slipping wheel. In addition, the verification shows that the IAWDEV can harvest around two times more energy while the vehicle is running on slippery roads than the TCAWDEV and the dual-axle AWDEV; the traction control can achieve better drivability and lower energy consumption than mentioned powertrains; the mode control can reduce 3% of battery charge depleting during the highway driving test. It also provides compelling evidences that the functionalities achieved by complicated and costly mechanical devices can be carried out by control schemes of the IAWDEV; the active torque controls can solve the inherent issues of mechanical linked powertrains; the sizing method is credible to estimate the operation envelop of powertrain components, even though there is some controllable over-sizing

Online Deep Learning for Improved Trajectory Tracking of Unmanned Aerial Vehicles Using Expert Knowledge

This work presents an online learning-based control method for improved trajectory tracking of unmanned aerial vehicles using both deep learning and expert knowledge. The proposed method does not require the exact model of the system to be controlled, and it is robust against variations in system dynamics as well as operational uncertainties. The learning is divided into two phases: offline (pre-)training and online (post-)training. In the former, a conventional controller performs a set of trajectories and, based on the input-output dataset, the deep neural network (DNN)-based controller is trained. In the latter, the trained DNN, which mimics the conventional controller, controls the system. Unlike the existing papers in the literature, the network is still being trained for different sets of trajectories which are not used in the training phase of DNN. Thanks to the rule-base, which contains the expert knowledge, the proposed framework learns the system dynamics and operational uncertainties in real-time. The experimental results show that the proposed online learning-based approach gives better trajectory tracking performance when compared to the only offline trained network.Comment: corrected version accepted for ICRA 201