Investigations of Different Approaches for Controlling the Speed of an Electric Motor with Nonlinear Dynamics Powered by a Li-ion battery - Case study

This research investigated different nonlinear models, state estimation techniques and control strategies applied to rechargeable Li-ion batteries and electric motors powered and adapted to these batteries. The finality of these investigations was achieved by finding the most suitable design approach for the real-time implementation of the most advanced state estimators based on intelligent neural networks and neural control strategies. For performance comparison purposes, was chosen as case study an accurate and robust EKF state of charge (SOC) estimator built on a simple second-order RC equivalent circuit model (2RC ECM) accurate enough to accomplish the main goal. An intelligent nonlinear autoregressive with exogenous input (NARX) Shallow Neural Network (SSN) estimator was developed to estimate the battery SOC, predict the terminal voltage, and map the nonlinear open circuit voltage (OCV) battery characteristic curve as a function of SOC. Focusing on nonlinear modeling and linearization techniques, such as partial state feedback linearization, for “proof concept” and simulations purposes in the case study, a third order nonlinear model for a DC motor (DCM) drive was selected. It is a valuable research support suitable to analyze the performance of state feedback linearization, system singularities, internal and zero dynamics, and solving reference tracking problems

Discrete-time neural network based state observer with neural network based control formulation for a class of systems with unmatched uncertainties

An observer is a dynamic system that estimates the state variables of another system using noisy measurements, either to estimate unmeasurable states, or to improve the accuracy of the state measurements. The Modified State Observer (MSO) is a technique that uses a standard observer structure modified to include a neural network to estimate system states as well as system uncertainty. It has been used in orbit uncertainty estimation and atmospheric reentry uncertainty estimation problems to correctly estimate unmodeled system dynamics. A form of the MSO has been used to control a nonlinear electrohydraulic system with parameter uncertainty using a simplified linear model. In this paper an extension of the MSO into discrete-time is developed using Lyapunov stability theory. Discrete-time systems are found in all digital hardware implementations, such as that found in a Martian rover, a quadcopter UAV, or digital flight control systems, and have the added benefit of reduced computation time compared to continuous systems. The derived adaptive update law guarantees stability of the error dynamics and boundedness of the neural network weights. To prove the validity of the discrete-time MSO (DMSO) simulation studies are performed using a two wheeled inverted pendulum (TWIP) robot, an unstable nonlinear system with unmatched uncertainties. Using a linear model with parameter uncertainties, the DMSO is shown to correctly estimate the state of the system as well as the system uncertainty, providing state estimates orders of magnitude more accurate, and in periods of time up to 10 times faster than the Discrete Kalman Filter. The DMSO is implemented on an actual TWIP robot to further validate the performance and demonstrate the applicability to discrete-time systems found in many aerospace applications. Additionally, a new form of neural network control is developed to compensate for the unmatched uncertainties that exist in the TWIP system using a state variable as a virtual control input. It is shown that in all cases the neural network based control assists with the controller effectiveness, resulting in the most effective controller, performing on average 53.1% better than LQR control alone --Abstract, page iii

Control of large-scale structures with large uncertainties

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Civil and Environmental Engineering, 2011.Cataloged from PDF version of thesis.Includes bibliographical references (p. 279-300).Performance-based design is a design approach that satisfies motion constraints as its primary goal, and then verifies for strength. The approach is traditionally executed by appropriately sizing stiffnesses, but recently, passive energy dissipation systems have gained popularity. Semi-active and active energy dissipation systems have been shown to outperform purely passive systems, but they are not yet widely accepted in the construction and structural engineering fields. Several factors are impeding the application of semi-active and active damping systems, such as large modeling uncertainties that are inherent to large-scale structures, limited state measurements, lack of mechanically reliable control devices, large power requirements, and the need for robust controllers. In order to enhance acceptability of feedback control systems to civil structures, an integrated control strategy designed for large-scale structures with large parametric uncertainties is proposed. The control strategy comprises a novel controller, as well as a new semi-active mechanical damping device. Specifically, the controller is an adaptive black-box representation that creates and optimizes control laws sequentially during an excitation, with no prior training. The novel feature is its online organization of the input space. The representation only requires limited observations for constructing an efficient representation, which allows control of unknown systems with limited state measurements. The semi-active mechanical device consists of a friction device inspired by a vehicle drum brakes, with a viscous and a stiffness element installed in parallel. Its unique characteristic is its theoretical damping force reaching the order of 100 kN, using a friction mechanism powered with a single 12-volts battery. It is conceived using mechanically reliable technologies, which is a solution to large power requirement and mechanical robustness. The integrated control system is simulated on an existing structure located in Boston, MA, as a replacement to the existing viscous damping system. Simulation results show that the integrated control system can mitigate wind vibrations as well as the current damping strategy, utilizing only one third of devices. In addition, the system created effective control rules for several types of earthquake excitations with no prior training, performing similarly to an optimal controller using full parametric and state knowledge.by Simon Laflamme.Ph.D

Adaptive control of compliant robots with Reservoir Computing

In modern society, robots are increasingly used to handle dangerous, repetitive and/or heavy tasks with high precision. Because of the nature of the tasks, either being dangerous, high precision or simply repetitive, robots are usually constructed with high torque motors and sturdy materials, that makes them dangerous for humans to handle. In a car-manufacturing company, for example, a large cage is placed around the robot’s workspace that prevents humans from entering its vicinity. In the last few decades, efforts have been made to improve human-robot interaction. Often the movement of robots is characterized as not being smooth and clearly dividable into sub-movements. This makes their movement rather unpredictable for humans. So, there exists an opportunity to improve the motion generation of robots to enhance human-robot interaction. One interesting research direction is that of imitation learning. Here, human motions are recorded and demonstrated to the robot. Although the robot is able to reproduce such movements, it cannot be generalized to other situations. Therefore, a dynamical system approach is proposed where the recorded motions are embedded into the dynamics of the system. Shaping these nonlinear dynamics, according to recorded motions, allows for dynamical system to generalize beyond demonstration. As a result, the robot can generate motions of other situations not included in the recorded human demonstrations. In this dissertation, a Reservoir Computing approach is used to create a dynamical system in which such demonstrations are embedded. Reservoir Computing systems are Recurrent Neural Network-based approaches that are efficiently trained by considering only the training of the readout connections and retaining all other connections of such a network unchanged given their initial randomly chosen values. Although they have been used to embed periodic motions before, they were extended to embed discrete motions, or both. This work describes how such a motion pattern-generating system is built, investigates the nature of the underlying dynamics and evaluates their robustness in the face of perturbations. Additionally, a dynamical system approach to obstacle avoidance is proposed that is based on vector fields in the presence of repellers. This technique can be used to extend the motion abilities of the robot without need for changing the trained Motion Pattern Generator (MPG). Therefore, this approach can be applied in real-time on any system that generates a certain movement trajectory. Assume that the MPG system is implemented on an industrial robotic arm, similar to the ones used in a car factory. Even though the obstacle avoidance strategy presented is able to modify the generated motion of the robot’s gripper in such a way that it avoids obstacles, it does not guarantee that other parts of the robot cannot collide with a human. To prevent this, engineers have started to use advanced control algorithms that measure the amount of torque that is applied on the robot. This allows the robot to be aware of external perturbations. However, it turns out that, even with fast control loops, the adaptation to compensate for a sudden perturbation, is too slow to prevent high interaction forces. To reduce such forces, researchers started to use mechanical elements that are passively compliant (e.g., springs) and light-weight flexible materials to construct robots. Although such compliant robots are much safer and inherently energy efficient to use, their control becomes much harder. Most control approaches use model information about the robot (e.g., weight distribution and shape). However, when constructing a compliant robot it is hard to determine the dynamics of these materials. Therefore, a model-free adaptive control framework is proposed that assumes no prior knowledge about the robot. By interacting with the robot it learns an inverse robot model that is used as controller. The more it interacts, the better the control be- comes. Appropriately, this framework is called Inverse Modeling Adaptive (IMA) control framework. I have evaluated the IMA controller’s tracking ability on sev- eral tasks, investigating its model independence and stability. Furthermore, I have shown its fast learning ability and comparable performance to taskspecific designed controllers. Given both the MPG and IMA controllers, it is possible to improve the inter- actability of a compliant robot in a human-friendly environment. When the robot is to perform human-like motions for a large set of tasks, we need to demonstrate motion examples of all these tasks. However, biological research concerning the motion generation of animals and humans revealed that a limited set of motion patterns, called motion primitives, are modulated and combined to generate advanced motor/motion skills that humans and animals exhibit. Inspired by these interesting findings, I investigate if a single motion primitive indeed can be modulated to achieve a desired motion behavior. By some elementary experiments, where an MPG is controlled by an IMA controller, a proof of concept is presented. Furthermore, a general hierarchy is introduced that describes how a robot can be controlled in a biology-inspired manner. I also investigated how motion primitives can be combined to produce a desired motion. However, I was unable to get more advanced implementations to work. The results of some simple experiments are presented in the appendix. Another approach I investigated assumes that the primitives themselves are undefined. Instead, only a high-level description is given, which describes that every primitive on average should contribute equally, while still allowing for a single primitive to specialize in a part of the motion generation. Without defining the behavior of a primitive, only a set of untrained IMA controllers is used of which each will represent a single primitive. As a result of the high-level heuristic description, the task space is tiled into sub-regions in an unsupervised manner. Resulting in controllers that indeed represent a part of the motion generation. I have applied this Modular Architecture with Control Primitives (MACOP) on an inverse kinematic learning task and investigated the emerged primitives. Thanks to the tiling of the task space, it becomes possible to control redundant systems, because redundant solutions can be spread over several control primitives. Within each sub region of the task space, a specific control primitive is more accurate than in other regions allowing for the task complexity to be distributed over several less complex tasks. Finally, I extend the use of an IMA-controller, which is tracking controller, to the control of under-actuated systems. By using a sample-based planning algorithm it becomes possible to explore the system dynamics in which a path to a desired state can be planned. Afterwards, MACOP is used to incorporate feedback and to learn the necessary control commands corresponding to the planned state space trajectory, even if it contains errors. As a result, the under-actuated control of a cart pole system was achieved. Furthermore, I presented the concept of a simulation based control framework that allows the learning of the system dynamics, planning and feedback control iteratively and simultaneously

Reservoir Computing: computation with dynamical systems

In het onderzoeksgebied Machine Learning worden systemen onderzocht die kunnen leren op basis van voorbeelden. Binnen dit onderzoeksgebied zijn de recurrente neurale netwerken een belangrijke deelgroep. Deze netwerken zijn abstracte modellen van de werking van delen van de hersenen. Zij zijn in staat om zeer complexe temporele problemen op te lossen maar zijn over het algemeen zeer moeilijk om te trainen. Recentelijk zijn een aantal gelijkaardige methodes voorgesteld die dit trainingsprobleem elimineren. Deze methodes worden aangeduid met de naam Reservoir Computing. Reservoir Computing combineert de indrukwekkende rekenkracht van recurrente neurale netwerken met een eenvoudige trainingsmethode. Bovendien blijkt dat deze trainingsmethoden niet beperkt zijn tot neurale netwerken, maar kunnen toegepast worden op generieke dynamische systemen. Waarom deze systemen goed werken en welke eigenschappen bepalend zijn voor de prestatie is evenwel nog niet duidelijk. Voor dit proefschrift is onderzoek gedaan naar de dynamische eigenschappen van generieke Reservoir Computing systemen. Zo is experimenteel aangetoond dat de idee van Reservoir Computing ook toepasbaar is op niet-neurale netwerken van dynamische knopen. Verder is een maat voorgesteld die gebruikt kan worden om het dynamisch regime van een reservoir te meten. Tenslotte is een adaptatieregel geïntroduceerd die voor een breed scala reservoirtypes de dynamica van het reservoir kan afregelen tot het gewenste dynamisch regime. De technieken beschreven in dit proefschrift zijn gedemonstreerd op verschillende academische en ingenieurstoepassingen

Artificial neural networks as simulators for behavioural evolution in evolutionary robotics

Robotic simulators for use in Evolutionary Robotics (ER) have certain challenges associated with the complexity of their construction and the accuracy of predictions made by these simulators. Such robotic simulators are often based on physics models, which have been shown to produce accurate results. However, the construction of physics-based simulators can be complex and time-consuming. Alternative simulation schemes construct robotic simulators from empirically-collected data. Such empirical simulators, however, also have associated challenges, such as that some of these simulators do not generalize well on the data from which they are constructed, as these models employ simple interpolation on said data. As a result of the identified challenges in existing robotic simulators for use in ER, this project investigates the potential use of Artificial Neural Networks, henceforth simply referred to as Neural Networks (NNs), as alternative robotic simulators. In contrast to physics models, NN-based simulators can be constructed without needing an explicit mathematical model of the system being modeled, which can simplify simulator development. Furthermore, the generalization capabilities of NNs suggest that NNs could generalize well on data from which these simulators are constructed. These generalization abilities of NNs, along with NNs’ noise tolerance, suggest that NNs could be well-suited to application in robotics simulation. Investigating whether NNs can be effectively used as robotic simulators in ER is thus the endeavour of this work. Since not much research has been done in employing NNs as robotic simulators, many aspects of the experimental framework on which this dissertation reports needed to be carefully decided upon. Two robot morphologies were selected on which the NN simulators created in this work were based, namely a differentially steered robot and an inverted pendulum robot. Motion tracking and robotic sensor logging were used to acquire data from which the NN simulators were constructed. Furthermore, custom code was written for almost all aspects of the study, namely data acquisition for NN training, the actual NN training process, the evolution of robotic controllers using the created NN simulators, as well as the onboard robotic implementations of evolved controllers. Experimental tests performed in order to determine ideal topologies for each of the NN simulators developed in this study indicated that different NN topologies can lead to large differences in training accuracy. After performing these tests, the training accuracy of the created simulators was analyzed. This analysis showed that the NN simulators generally trained well and could generalize well on data not presented during simulator construction. In order to validate the feasibility of the created NN simulators in the ER process, these simulators were subsequently used to evolve controllers in simulation, similar to controllers developed in related studies. Encouraging results were obtained, with the newly-evolved controllers allowing real-world experimental robots to exhibit obstacle avoidance and light-approaching behaviour with a reasonable degree of success. The created NN simulators furthermore allowed for the successful evolution of a complex inverted pendulum stabilization controller in simulation. It was thus clearly established that NN-based robotic simulators can be successfully employed as alternative simulation schemes in the ER process

Object-oriented analysis and design of computational intelligence systems

Machine learning from data, neuro-fuzzy information processing, approximate reasoning and genetic and evolutionary computation are all aspects of computational intelligence (also called soft computing methods). Soft computing methods differ from conventional computing in that they are tolerant of imprecision, uncertainty and partial truths. These characteristics can be exploited to achieve tractability, robustness and low solution costs when the solution to a complex (in machine terms) problem is required. The principal constituents of soft computing include: Neural Networks, Fuzzy Logic and Probabilistic Reasoning Systems. Genetic Algorithms (GAs), Evolutionary Algorithms, Chaos Theory', Complexity Theory and parts of Learning Theory all come under Probabilistic Reasoning Systems. Hybrid systems can be designed incorporating 2 or more aspects of soft computing that are more powerful than any of the components used in a stand alone fashion. A unified framework is needed to implement and manipulate such systems. Such a framework will allow for easy visualisation of the underlying concepts and easy modification of the resulting computer models. In this thesis, an investigation of the major aspects of computational intelligence has been carried out. The main emphasis has been placed on developing an object-oriented framework for architecting computational intelligence systems. Object models for Neural Networks, Fuzzy Logic Systems and Evolutionary Computation systems have been developed. Software has been written in C++ to realise sample implementations of the various systems. Finally, practical applications and the results of using the Neural Networks, Fuzzy Logic systems and Genetic Algorithms developed in solving real world problems are presented. A consistent notation based on the Object Modelling Technique (OMT) is used throughout the thesis to describe the software architectures from which the computer implementation models have been derived