Model-Based Control Using Koopman Operators

This paper explores the application of Koopman operator theory to the control of robotic systems. The operator is introduced as a method to generate data-driven models that have utility for model-based control methods. We then motivate the use of the Koopman operator towards augmenting model-based control. Specifically, we illustrate how the operator can be used to obtain a linearizable data-driven model for an unknown dynamical process that is useful for model-based control synthesis. Simulated results show that with increasing complexity in the choice of the basis functions, a closed-loop controller is able to invert and stabilize a cart- and VTOL-pendulum systems. Furthermore, the specification of the basis function are shown to be of importance when generating a Koopman operator for specific robotic systems. Experimental results with the Sphero SPRK robot explore the utility of the Koopman operator in a reduced state representation setting where increased complexity in the basis function improve open- and closed-loop controller performance in various terrains, including sand.Comment: 8 page

Simple robust control laws for robot manipulators. Part 2: Adaptive case

A new class of asymptotically stable adaptive control laws is introduced for application to the robotic manipulator. Unlike most applications of adaptive control theory to robotic manipulators, this analysis addresses the nonlinear dynamics directly without approximation, linearization, or ad hoc assumptions, and utilizes a parameterization based on physical (time-invariant) quantities. This approach is made possible by using energy-like Lyapunov functions which retain the nonlinear character and structure of the dynamics, rather than simple quadratic forms which are ubiquitous to the adaptive control literature, and which have bound the theory tightly to linear systems with unknown parameters. It is a unique feature of these results that the adaptive forms arise by straightforward certainty equivalence adaptation of their nonadaptive counterparts found in the companion to this paper (i.e., by replacing unknown quantities by their estimates) and that this simple approach leads to asymptotically stable closed-loop adaptive systems. Furthermore, it is emphasized that this approach does not require convergence of the parameter estimates (i.e., via persistent excitation), invertibility of the mass matrix estimate, or measurement of the joint accelerations

Actor-Critic Reinforcement Learning for Control with Stability Guarantee

Reinforcement Learning (RL) and its integration with deep learning have achieved impressive performance in various robotic control tasks, ranging from motion planning and navigation to end-to-end visual manipulation. However, stability is not guaranteed in model-free RL by solely using data. From a control-theoretic perspective, stability is the most important property for any control system, since it is closely related to safety, robustness, and reliability of robotic systems. In this paper, we propose an actor-critic RL framework for control which can guarantee closed-loop stability by employing the classic Lyapunov's method in control theory. First of all, a data-based stability theorem is proposed for stochastic nonlinear systems modeled by Markov decision process. Then we show that the stability condition could be exploited as the critic in the actor-critic RL to learn a controller/policy. At last, the effectiveness of our approach is evaluated on several well-known 3-dimensional robot control tasks and a synthetic biology gene network tracking task in three different popular physics simulation platforms. As an empirical evaluation on the advantage of stability, we show that the learned policies can enable the systems to recover to the equilibrium or way-points when interfered by uncertainties such as system parametric variations and external disturbances to a certain extent.Comment: IEEE RA-L + IROS 202

Data-Driven Design of Energy-Shaping Controllers for Swing-Up Control of Underactuated Robots

We propose a novel data-driven procedure to train a neural network for the swing-up control of underactuated robotic systems. Our approach is inspired by several recent developments ranging from nonlinear control theory to machine learning. We embed a neural network indirectly into the equations of motion of the robotic manipulator as its control input. Using familiar results from passivity-based and energy-shaping control literature, this control function is determined by the appropriate gradients of a neural network, acting as an energy-like (Lyapunov) function. We encode the task of swinging-up robotic systems through the use of transverse coordinates and goal sets; which drastically accelerates the rate of learning by providing a concise target for the neural network. We demonstrate the efficacy of the algorithm with both numerical simulations and experiments

A performance analysis method for distributed real-time robotic systems: A case study of remote teleoperation

Robot coordination and control systems for remote teleoperation applications are by necessity implemented on distributed computers. Modeling and performance analysis of these distributed robotic systems is difficult, but important for economic system design. Performance analysis methods originally developed for conventional distributed computer systems are often unsatisfactory for evaluating real-time systems. The paper introduces a formal model of distributed robotic control systems; and a performance analysis method, based on scheduling theory, which can handle concurrent hard-real-time response specifications. Use of the method is illustrated by a case of remote teleoperation which assesses the effect of communication delays and the allocation of robot control functions on control system hardware requirements

Task-Driven Estimation and Control via Information Bottlenecks

Our goal is to develop a principled and general algorithmic framework for task-driven estimation and control for robotic systems. State-of-the-art approaches for controlling robotic systems typically rely heavily on accurately estimating the full state of the robot (e.g., a running robot might estimate joint angles and velocities, torso state, and position relative to a goal). However, full state representations are often excessively rich for the specific task at hand and can lead to significant computational inefficiency and brittleness to errors in state estimation. In contrast, we present an approach that eschews such rich representations and seeks to create task-driven representations. The key technical insight is to leverage the theory of information bottlenecks}to formalize the notion of a "task-driven representation" in terms of information theoretic quantities that measure the minimality of a representation. We propose novel iterative algorithms for automatically synthesizing (offline) a task-driven representation (given in terms of a set of task-relevant variables (TRVs)) and a performant control policy that is a function of the TRVs. We present online algorithms for estimating the TRVs in order to apply the control policy. We demonstrate that our approach results in significant robustness to unmodeled measurement uncertainty both theoretically and via thorough simulation experiments including a spring-loaded inverted pendulum running to a goal location.Comment: 9 pages, 4 figures, abridged version accepted to ICRA2019; Incorporates changes in final conference submissio

Bio-Inspired Adaptive Cooperative Control of Heterogeneous Robotic Networks

We introduce a new adaptive cooperative control strategy for robotic networks comprised of heterogeneous members. The proposed feedback synchronization exploits an active parameter adaptation strategy as opposed to adaptive parameter estimation of adaptive control theory. Multiple heterogeneous robots or vehicles can coordinate their motions by parameter adaptation analogous to bio-genetic mutation and adaptation. In contrast with fixed gains used by consensus theory, both the tracking control and diffusive coupling gains are automatically computed based on the adaptation law, the synchronization errors, and the tracking errors of heterogeneous robots. The optimality of the proposed adaptive cooperative control is studied via inverse optimal control theory. The proposed adaptive cooperative control can be applied to any network structure. The stability proof, by using a relatively new nonlinear stability tool, contraction theory, shows globally asymptotically synchronized motion of a heterogeneous robotic network. This adaptive cooperative control can be widely applied to cooperative control of unmanned aerial vehicles (UAVs), formation flying spacecraft, and multi-robot systems. Results of the simulation show the effectiveness of the proposed adaptive cooperative control laws especially for a network comprised of heterogeneous members

Learning-based position control of a closed-kinematic chain robot end-effector

A trajectory control scheme whose design is based on learning theory, for a six-degree-of-freedom (DOF) robot end-effector built to study robotic assembly of NASA hardwares in space is presented. The control scheme consists of two control systems: the feedback control system and the learning control system. The feedback control system is designed using the concept of linearization about a selected operating point, and the method of pole placement so that the closed-loop linearized system is stabilized. The learning control scheme consisting of PD-type learning controllers, provides additional inputs to improve the end-effector performance after each trial. Experimental studies performed on a 2 DOF end-effector built at CUA, for three tracking cases show that actual trajectories approach desired trajectories as the number of trials increases. The tracking errors are substantially reduced after only five trials

Robust decentralised variable structure control for rigid robotic manipulators

In this thesis, the problem of robust variable structure control for non-linear rigid robotic manipulators is investigated. Robustness and convergence results are presented for variable structure control systems of robotic manipulators with bounded unknown disturbances, nonlinearities, dynamical couplings and parameter uncertainties. The major outcomes of the work described in this thesis are summarised as given below. The basic variable structure theory is surveyed, and some basic ideas such as sliding mode designs, robustness analysis and control1er design methods for linear or non-linear systems are reviewed. Three recent variable structure control schemes for robotic manipulators are discussed and compared to highlight the research developments in this area. A decentralised variable structure model reference adaptive control scheme is proposed for a class of large scale systems. It is shown that, unlike previous decentralised variable structure control schemes, the local variable structure controller design in this scheme requires only three bounds of the subsystem matrices and dynamical interactions instead of the upper and the lower bounds of all unknown subsystem parameters. Using this scheme, not only asymptotic convergence of the output tracking error can be guaranteed, but also the controller design is greatly simplified. In order to eliminate chattering caused by the variable structure technique, local boundary layer controllers are presented. Furthermore, the scheme is applied to the tracking control of robotic manipulators with the result that strong robustness and asymptotic convergence of the output tracking error are obtained

Model Abstraction in Dynamical Systems: Application to Mobile Robot Control

This book investigates abstraction of dynamical systems for the purpose of designing controllers. Abstraction is a means to reduce a system model\u27s complexity while retaining the important behavior of that system. The motivating example throughout this text is the robotic car. Two topics are introduced in this text: control design using abstraction and propagation of uncertainty in abstracted systems. First, this book investigates the conditions for which controllers can be designed in abstracted systems and then transferred to the original dynamical system, taking advantage of design using the simpler model. This book also studies the relationship between the evolution of uncertain initial conditions in abstracted control systems. It is shown that a control system abstraction can capture the time evolution of the uncertainty in the original system by an appropriate choice of control input. This book provides a comprehensive review of the theory behind abstraction and applies the results to general nonlinear dynamical systems. In particular, the following topics are presented: * An overview of the history and current research in mobile robotic control design. * A mathematical review that provides the tools used in this research area. * The development of the robotic car model and both controllers used in the new control design. * A review of abstraction and an extension of these ideas into new system relationship characterizations called traceability and E-traceability. * A framework for designing controllers based on abstraction. * An open-loop control design with simulation results. * An investigation of system abstraction with uncertain initial conditions