Optimal feedback control for dynamic systems with state constraints: An exact penalty approach

In this paper, we consider a class of nonlinear dynamic systems with terminal state and continuous inequality constraints. Our aim is to design an optimal feedback controller that minimizes total system cost and ensures satisfaction of all constraints. We first formulate this problem as a semi-infinite optimization problem. We then show that by using a new exact penalty approach, this semi-infinite optimization problem can be converted into a sequence of nonlinear programming problems, each of which can be solved using standard gradient-based optimization methods.We conclude the paper by discussing applications of our work to glider control

Optimal switching instants for a switched-capacitor DC/DC power converter

We consider a switched-capacitor DC/DC power converter with variable switching instants. The determination of optimal switching instants giving low output ripple and strong load regulation is posed as a non-smooth dynamic optimization problem. By introducing a set of auxiliary differential equations and applying a time-scaling transformation, we formulate an equivalent optimization problem with semi-infinite constraints. Existing algorithms can be applied to solve this smooth semi-infinite optimization problem. The existence of an optimal solution is also established. For illustration, the optimal switching instants for a practical switched-capacitor DC/DC power converter are determined using this approach

A neighboring extremal solution for an optimal switched impulsive control problem

This paper presents a neighboring extremal solution for a class of optimal switched impulsive control problems with perturbations in the initial state, terminal condition and system's parameters. The sequence of mode's switching is pre-specified, and the decision variables, i.e. the switching times and parameters of the system involved, have inequality constraints. It is assumed that the active status of these constraints is unchanged with the perturbations. We derive this solution by expanding the necessary conditions for optimality to first-order and then solving the resulting multiple-point boundary-value problem by the backward sweep technique. Numerical simulations are presented to illustrate this solution method

Optimal control of impulsive switched systems with minimum subsystem durations

This paper presents a new computational approach for solving optimal control problems governed by impulsive switched systems. Such systems consist of multiple subsystems operating in succession, with possible instantaneous state jumps occurring when the system switches from one subsystem to another. The control variables are the subsystem durations and a set of system parameters influencing the state jumps. In contrast with most other papers on the control of impulsive switched systems, we do not require every potential subsystem to be active during the time horizon (it may be optimal to delete certain subsystems, especially when the optimal number of switches is unknown). However, any active subsystem must be active for a minimum non-negligible duration of time. This restriction leads to a disjoint feasible region for the subsystem durations. The problem of choosing the subsystem durations and the system parameters to minimize a given cost function is a non-standard optimal control problem that cannot be solved using conventional techniques. By combining a time-scaling transformation and an exact penalty method, we develop a computational algorithm for solving this problem. We then demonstrate the effectiveness of this algorithm by considering a numerical example on the optimization of shrimp harvesting operations

Control parameterization for optimal control problems with continuous inequality constraints: New convergence results

Control parameterization is a powerful numerical technique for solving optimal control problems with general nonlinear constraints. The main idea of control parameterization is to discretize the control space by approximating the control by a piecewise-constant or piecewise-linear function, thereby yielding an approximate nonlinear programming problem. This approximate problem can then be solved using standard gradient-based optimization techniques. In this paper, we consider the control parameterization method for a class of optimal control problems in which the admissible controls are functions of bounded variation and the state and control are subject to continuous inequality constraints. We show that control parameterization generates a sequence of suboptimal controls whose costs converge to the true optimal cost. This result has previously only been proved for the case when the admissible controls are restricted to piecewise continuous functions

Optimal Control of Nonlinear Switched Systems: Computational Methods and Applications

A switched system is a dynamic system that operates by switching between different subsystems or modes. Such systems exhibit both continuous and discrete characteristics—a dual nature that makes designing effective control policies a challenging task. The purpose of this paper is to review some of the latest computational techniques for generating optimal control laws for switched systems with nonlinear dynamics and continuous inequality constraints. We discuss computational strategiesfor optimizing both the times at which a switched system switches from one mode to another (the so-called switching times) and the sequence in which a switched system operates its various possible modes (the so-called switching sequence). These strategies involve novel combinations of the control parameterization method, the timescaling transformation, and bilevel programming and binary relaxation techniques. We conclude the paper by discussing a number of switched system optimal control models arising in practical applications

A unified parameter identification method for nonlinear time-delay systems

This paper deals with the problem of identifying unknown time-delays and model parameters in a general nonlinear time-delay system. We propose a unified computational approach that involves solving a dynamic optimization problem, whose cost function measures the discrepancy between predicted and observed system output, to determine optimal values for the unknown quantities. Our main contribution is to show that the partial derivatives of this cost function can be computed by solving a set of auxiliary time-delay systems. On this basis, the parameter identification problem can be solved using existing gradient-based optimization techniques. We conclude the paper with two numerical simulations

The control parameterization method for nonlinear optimal control: A survey

The control parameterization method is a popular numerical technique for solving optimal control problems. The main idea of control parameterization is to discretize the control space by approximating the control function by a linear combination of basis functions. Under this approximation scheme, the optimal control problem is reduced to an approximate nonlinear optimization problem with a finite number of decision variables. This approximate problem can then be solved using nonlinear programming techniques. The aim of this paper is to introduce the fundamentals of the control parameterization method and survey its various applications to non-standard optimal control problems. Topics discussed include gradient computation, numerical convergence, variable switching times, and methods for handling state constraints. We conclude the paper with some suggestions for future research

Optimal control strategies for tuberculosis treatment: a case study in Angola

We apply optimal control theory to a tuberculosis model given by a system of ordinary differential equations. Optimal control strategies are proposed to minimize the cost of interventions. Numerical simulations are given using data from Angola.Comment: This is a preprint of a paper whose final and definite form will appear in the international journal Numerical Algebra, Control and Optimization (NACO). Paper accepted for publication 15-March-201

Numerical solution of a pursuit-evasion differential game involving two spacecraft in low earth orbit

This paper considers a spacecraft pursuit-evasion problem taking place in low earth orbit. The problem is formulated as a zero-sum differential game in which there are two players, a pursuing spacecraft that attempts to minimize a payoff, and an evading spacecraft that attempts to maximize the same payoff. We introduce two associated optimal control problems and show that a saddle point for the differential game exists if and only if the two optimal control problems have the same optimal value. Then, on the basis of this result, we propose two computational methods for determining a saddle point solution: a semi-direct control parameterization method (SDCP method), which is based on a piecewise-constant control approximation scheme, and a hybrid method, which combines the new SDCP method with the multiple shooting method. Simulation results show that the proposed SDCP and hybrid methodsare superior to the semi-direct collocation nonlinear programming method (SDCNLP method), which is widely used to solve pursuit-evasion problems in the aerospace field