On self-learning mechanism for the output regulation of second-order affine nonlinear systems

This paper studies global robust output regulation of second-order nonlinear systems with input disturbances that encompass the fully-actuated Euler-Lagrange systems. We assume the availability of relative output (w.r.t. a family of reference signals) and output derivative measurements. Based on a specific separation principle and self learning mechanism, we develop an internal model-based controller that does not require apriori knowledge of reference and disturbance signals and it only assumes that the kernels of these signals are a family of exosystems with unknown parameters (e.g., amplitudes, frequencies or time periods). The proposed control framework has a self-learning mechanism that extricates itself from requiring absolute position measurement nor precise knowledge of the feedforward kernel signals. By requiring the high-level task/trajectory planner to use the same class of kernels in constraining the trajectories, the proposed low-level controller is able to learn the desired trajectories, to suppress the disturbance signals, and to adapt itself to the uncertain plant parameters. The framework enables a plug-and-play control mechanism in both levels of control

Robust Output Regulation for Autonomous Robots:self-learning mechanisms, task-space control and multi-agent systems

This thesis focuses on robust output regulation for autonomous robots. The control objective of output regulation is to design a feedback controller to achieve asymptotic tracking and/or disturbance rejection for a class of exogenous reference and/or disturbance while maintaining closed-loop stability. We investigate three research problems that pertain to the constructive design of robust output regulation for fully actuated Euler-Lagrange systems from centralized to distributed fashions. The first one is the global robust output regulation of second-order affine nonlinear systems with input disturbances that encompass the fully-actuated Euler-Lagrange systems. Based on a certainty equivalence principle method, we proposed a novel class of nonlinear internal models taking a cascade interconnection structure with strictly relaxed conditions than before. The second one is the output regulation for robot manipulators working in task-space. An internal model-based adaptive controller is designed to cope with uncertain manipulator kinematic and dynamic parameters, as well as unknown periodic reference trajectories generated by harmonic oscillators. The last one is the formation control of manipulators’ end-effector subject to external disturbances or parameter uncertainties. We present and analyze gradient descent-based distributed formation controllers for end-effectors. Internal models are used to reject external disturbances. Moreover, by introducing an extra integrator and an adaptive estimator for gravitational compensation and stabilization, respectively, we extend the proposed gradient-based design to the case where the plant parameters are not exactly known

Reinforcement Learning, Intelligent Control and their Applications in Connected and Autonomous Vehicles

Reinforcement learning (RL) has attracted large attention over the past few years. Recently, we developed a data-driven algorithm to solve predictive cruise control (PCC) and games output regulation problems. This work integrates our recent contributions to the application of RL in game theory, output regulation problems, robust control, small-gain theory and PCC. The algorithm was developed for $H_\infty$ adaptive optimal output regulation of uncertain linear systems, and uncertain partially linear systems to reject disturbance and also force the output of the systems to asymptotically track a reference. In the PCC problem, we determined the reference velocity for each autonomous vehicle in the platoon using the traffic information broadcasted from the lights to reduce the vehicles\u27 trip time. Then we employed the algorithm to design an approximate optimal controller for the vehicles. This controller is able to regulate the headway, velocity and acceleration of each vehicle to the desired values. Simulation results validate the effectiveness of the algorithms

Output regulation of Euler-Lagrange systems based on error and velocity feedback

Based on a certainty equivalence property, we propose an adaptive internal model control law that solves global robust output regulation of uncertain Euler-Lagrange (EL) systems based only on error (or relative position) and velocity feedback. The proposed controller does not require apriori knowledge of reference signal and its derivatives, which are commonly assumed in literature. It enables a self-learning mechanism of the closed-loop EL systems where the adaptive internal model-based controller is able to learn the desired trajectories and adapt itself to the uncertain plant parameters. Furthermore, the analysis offers insights to the design of internal model-based output regulation for multivariable nonlinear systems with uniform vector relative degree two

The output regulation problem : a convergent dynamics approach

+192hlm.;24c