Pseudospectral Model Predictive Control under Partially Learned Dynamics

Trajectory optimization of a controlled dynamical system is an essential part of autonomy, however many trajectory optimization techniques are limited by the fidelity of the underlying parametric model. In the field of robotics, a lack of model knowledge can be overcome with machine learning techniques, utilizing measurements to build a dynamical model from the data. This paper aims to take the middle ground between these two approaches by introducing a semi-parametric representation of the underlying system dynamics. Our goal is to leverage the considerable information contained in a traditional physics based model and combine it with a data-driven, non-parametric regression technique known as a Gaussian Process. Integrating this semi-parametric model with model predictive pseudospectral control, we demonstrate this technique on both a cart pole and quadrotor simulation with unmodeled damping and parametric error. In order to manage parametric uncertainty, we introduce an algorithm that utilizes Sparse Spectrum Gaussian Processes (SSGP) for online learning after each rollout. We implement this online learning technique on a cart pole and quadrator, then demonstrate the use of online learning and obstacle avoidance for the dubin vehicle dynamics.Comment: Accepted but withdrawn from AIAA Scitech 201

Concurrent Learning Adaptive Model Predictive Control with Pseudospectral Implementation

This paper presents a control architecture in which a direct adaptive control technique is used within the model predictive control framework, using the concurrent learning based approach, to compensate for model uncertainties. At each time step, the control sequences and the parameter estimates are both used as the optimization arguments, thereby undermining the need for switching between the learning phase and the control phase, as is the case with hybrid-direct-indirect control architectures. The state derivatives are approximated using pseudospectral methods, which are vastly used for numerical optimal control problems. Theoretical results and numerical simulation examples are used to establish the effectiveness of the architecture.Comment: 21 pages, 13 figure

Time-varying damping coefficient to increase power extraction from a notional wave energy harvester

Energy efficiency and renewable energy generation is attracting increasing attention, due to the established understanding that a new sustainable approach to power human activities is compulsory, on the one hand, and thanks to technological advances, on the other hand. Energy harvesters, at different scales, are promising tools, but their performance and economic viability depend on advanced energy-maximisation control techniques. This paper borrows a control strategy from the vibration energy harvesting field, and implements it to a notional wave energy conversion application. A linear time variant damping coefficient of the power take-off unit is considered, oscillating at twice sinusoidal excitation force frequency, inducing parametric resonance in the system and significantly expanding the response bandwidth. Active and semi-active solutions are investigated, allowing or preventing bi-directional power flow, comparing results with traditional passive and impedance-matching control. Results show that, although both active and semi-active control successfully increase the mean power extraction, much larger than passive control, semi-active control ensures better power quality and lower control forces

Convex optimization of launch vehicle ascent trajectories

This thesis investigates the use of convex optimization techniques for the ascent trajectory design and guidance of a launch vehicle. An optimized mission design and the implementation of a minimum-propellant guidance scheme are key to increasing the rocket carrying capacity and cutting the costs of access to space. However, the complexity of the launch vehicle optimal control problem (OCP), due to the high sensitivity to the optimization parameters and the numerous nonlinear constraints, make the application of traditional optimization methods somewhat unappealing, as either significant computational costs or accurate initialization points are required. Instead, recent convex optimization algorithms theoretically guarantee convergence in polynomial time regardless of the initial point. The main challenge consists in converting the nonconvex ascent problem into an equivalent convex OCP. To this end, lossless and successive convexification methods are employed on the launch vehicle problem to set up a sequential convex optimization algorithm that converges to the solution of the original problem in a short time. Motivated by the computational efficiency and reliability of the devised optimization strategy, the thesis also investigates the suitability of the convex optimization approach for the computational guidance of a launch vehicle upper stage in a model predictive control (MPC) framework. Being MPC based on recursively solving onboard an OCP to determine the optimal control actions, the resulting guidance scheme is not only performance-oriented but intrinsically robust to model uncertainties and random disturbances thanks to the closed-loop architecture. The characteristics of real-world launch vehicles are taken into account by considering rocket configurations inspired to SpaceX's Falcon 9 and ESA's VEGA as case studies. Extensive numerical results prove the convergence properties and the efficiency of the approach, posing convex optimization as a promising tool for launch vehicle ascent trajectory design and guidance algorithms

Robust Adaptive Control Barrier Functions: An Adaptive & Data-Driven Approach to Safety (Extended Version)

A new framework is developed for control of constrained nonlinear systems with structured parametric uncertainties. Forward invariance of a safe set is achieved through online parameter adaptation and data-driven model estimation. The new adaptive data-driven safety paradigm is merged with a recent adaptive control algorithm for systems nominally contracting in closed-loop. This unification is more general than other safety controllers as closed-loop contraction does not require the system be invertible or in a particular form. Additionally, the approach is less expensive than nonlinear model predictive control as it does not require a full desired trajectory, but rather only a desired terminal state. The approach is illustrated on the pitch dynamics of an aircraft with uncertain nonlinear aerodynamics.Comment: Added aCBF non-Lipschitz example and discussion on approach implementatio

Numerical Solution of Optimal Control Problems with Explicit and Implicit Switches

This dissertation deals with the efficient numerical solution of switched optimal control problems whose dynamics may coincidentally be affected by both explicit and implicit switches. A framework is being developed for this purpose, in which both problem classes are uniformly converted into a mixed–integer optimal control problem with combinatorial constraints. Recent research results relate this problem class to a continuous optimal control problem with vanishing constraints, which in turn represents a considerable subclass of an optimal control problem with equilibrium constraints. In this thesis, this connection forms the foundation for a numerical treatment. We employ numerical algorithms that are based on a direct collocation approach and require, in particular, a highly accurate determination of the switching structure of the original problem. Due to the fact that the switching structure is a priori unknown in general, our approach aims to identify it successively. During this process, a sequence of nonlinear programs, which are derived by applying discretization schemes to optimal control problems, is solved approximatively. After each iteration, the discretization grid is updated according to the currently estimated switching structure. Besides a precise determination of the switching structure, it is of central importance to estimate the global error that occurs when optimal control problems are solved numerically. Again, we focus on certain direct collocation discretization schemes and analyze error contributions of individual discretization intervals. For this purpose, we exploit a relationship between discrete adjoints and the Lagrange multipliers associated with those nonlinear programs that arise from the collocation transcription process. This relationship can be derived with the help of a functional analytic framework and by interrelating collocation methods and Petrov–Galerkin finite element methods. In analogy to the dual-weighted residual methodology for Galerkin methods, which is well–known in the partial differential equation community, we then derive goal–oriented global error estimators. Based on those error estimators, we present mesh refinement strategies that allow for an equilibration and an efficient reduction of the global error. In doing so we note that the grid adaption processes with respect to both switching structure detection and global error reduction get along with each other. This allows us to distill an iterative solution framework. Usually, individual state and control components have the same polynomial degree if they originate from a collocation discretization scheme. Due to the special role which some control components have in the proposed solution framework it is desirable to allow varying polynomial degrees. This results in implementation problems, which can be solved by means of clever structure exploitation techniques and a suitable permutation of variables and equations. The resulting algorithm was developed in parallel to this work and implemented in a software package. The presented methods are implemented and evaluated on the basis of several benchmark problems. Furthermore, their applicability and efficiency is demonstrated. With regard to a future embedding of the described methods in an online optimal control context and the associated real-time requirements, an extension of the well–known multi–level iteration schemes is proposed. This approach is based on the trapezoidal rule and, compared to a full evaluation of the involved Jacobians, it significantly reduces the computational costs in case of sparse data matrices

Optimal Control of Wave Energy Converters

In this dissertation, we address the optimal control of the Wave Energy Converters. The Wave Energy Converters introduced in this study can be categorized as the single body heaving device, the single body pitching device, the single body three degrees of freedoms device, and the Wave Energy Converters array. Different types of Wave Energy Converters are modeled mathematically, and different optimal controls are developed for them. The objective of the optimal controllers is to maximize the energy extraction with and without the motion and control constraints. The development of the unconstrained control is first introduced which includes the implementation of the Singular Arc control and the Simple Model Control. The constrained optimal control is then introduced which contains the Shape-based approach, Pseudospectral control, the Linear Quadratic Gaussian optimal control, and the Collective Control. The wave estimation is also discussed since it is required by the controllers. Several estimators are implemented, such as the Kalman Filter, the Extended Kalman Filter, and the Kalman-Consensus Filter. They can be applied for estimating the system states and the wave excitation force/wave excitation force field. Last, the controllers are validated with the Discrete Displacement Hydraulic system which is the Power Take-off unit of the Wave Energy Converter. The simulation results show that the proposed optimal controllers can maximize the energy absorption when the wave estimation is accurate. The performance of the unconstrained controllers is close to the theoretical maximum (Complex Conjugate Control). Furthermore, the energy extraction is optimized and the constraints are satisfied by applying the constrained controllers. However, when the proposed controllers are further validated with the hydraulic system, they extract less energy than a simple Proportional-derivative control. This indicates the dynamics of the Power take-off unit needs to be considered in designing the control to obtain the robustness