Optimal state-feedback quadratic regulation of linear hybrid automata

For linear hybrid automata, namely switched linear autonomous systems whose mode of operation is determined by a controlled automaton, in this paper we face the problem of optimal control, where the objective is to minimize a quadratic performance index over an infinite time horizon. The quantities to be optimized are the sequence of switching times and the sequence of modes (or ”locations”), under the following constraints: the sequence of modes has a finite length; the discrete dynamics of the automaton restricts the possible switches from a given location to the next location, with a cost associated to each switch; the time interval between two consecutive switching times is greater than a fixed quantity. We show how a state-feedback solution can be computed off-line through a numerical procedure

Global optimization of hybrid systems

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Chemical Engineering, 2006.Includes bibliographical references (p. 339-353).Systems that exhibit both discrete state and continuous state dynamics are called hybrid systems. In most nontrivial cases, these two aspects of system behavior interact to such a significant extent that they cannot be decoupled effectively by any kind of abstraction and must be analyzed simultaneously. Hybrid system models are important in many areas of science and engineering, including flip-flops and latching relays, manufacturing systems, air-traffic management systems, controller synthesis, switched systems, chemical process systems, signaling and decision making mechanisms in (biological) cells, robotic systems, safety interlock systems, and embedded systems. The primary focus of this thesis is to explore deterministic methods for the global optimization of hybrid systems. While the areas of modeling, simulation and sensitivity analysis of hybrid systems have received much attention, there are many challenging difficulties associated with the optimization of such systems. The contents of this thesis represent the first steps toward deterministic global optimization of hybrid systems in the continuous time domain. There are various reasons for wanting to solve optimization problems globally.(cont.) In particular, there are many applications which demand that the global solution be found, for example, formal safety verification problems and parameter estimation problems. In the former case, a suboptimal local solution could falsely indicate that all safety specifications are met, leading to disastrous consequences if, in actuality, a global solution exists which provides a counter example that violates some safety specification. In the latter case, a suboptimal local solution could falsely indicate that a proposed model structure did not match experimental data in a statistically significant manner, leading to the false rejection of a valid model structure. In addition, for many optimization problems in engineering, the presence of nonlinear equality constraints makes the optimization problem nonconvex such that local optimization methods can often fail to produce a single feasible point, even though the problem is indeed feasible. The control parameterization framework is employed for the solution of the optimization problem with continuous time hybrid systems embedded. A major difficulty of such a framework lies in the fact that the mode sequence of the embedded hybrid system changes in the space of the optimization decision variables for most nontrivial problems.(cont.) This makes the resulting optimization problem nonsmooth because the parametric sensitivities of the hybrid system do not exist everywhere, thus invalidating efficient gradient based optimization solvers. In this thesis, the general optimization problem is decomposed into three subproblems, and tackled individually: (a) when the mode sequence is fixed, and the transition times are fixed; (b) when the mode sequence is allowed to vary, and the transition times are fixed; and (c) when the mode sequence is fixed, and the transition times are allowed to vary. Because even these subproblems are nontrivial to solve, this thesis focuses on hybrid systems with linear time varying ordinary differential equations describing the continuous dynamics, and proposes various methods to exploit the linear structure. However, in the course of solving the last subproblem, a convexity theory for general, nonlinear hybrid systems is developed, which can be easily extended for general, nonlinear hybrid systems. Subproblem (a) is the easiest to solve. A convexity theory is presented that allows convex relaxations of general, nonconvex Bolza type functions to be constructed for the optimization problem. This allows a deterministic branch-and-bound framework to be employed for the global optimization of the subproblem.(cont.) Subproblems (b) and (c) are much more difficult to solve, and require the exploitation of structure. For subproblem (b), a hybrid superstructure is proposed that enables the linear structure to be retained. A branch-and-cut framework with a novel dynamic bounds tightening heuristic is proposed, and it is shown that the generation of cuts from dynamic bounds tightening can have a dramatic impact on the solution of the problem. For subproblem (c), a time transformation is employed to transform the problem into one with fixed transition times, but nonlinear dynamics. A convexity theory is developed for constructing convex relaxations of general, nonconvex Bolza type functions with the nonlinear hybrid system embedded, along with the development of bounding methods, based on the theory of differential inequalities. A novel bounding technique that exploits the time transformation is also introduced, which can provide much tighter bounds than that furnished utilizing differential inequalities.by Cha Kun Lee.Ph.D

Optimal Switching Of 1-dof Oscillating Systems

This paper considers the class of hybrid linear second-order oscillating systems, in which two parameters are free to be assigned in a finite set of values. The control task is to decide, at any time instant, the value of the parameters as a function of the system state vector, in order to minimize a quadratic functional over an infinite horizon. The problem lends itself to cope with a variety of important applications, in diverse engineering fields. In the paper a numerical algorithm to compute the optimal switching rule is presented. Then the algorithm is applied to a simplified model of a vehicle suspension system with the aim of minimizing the chassis acceleration (comfort-oriented control). © Springer-Verlag Berlin Heidelberg 2007.4416 LNCS118130Branicky, M.S., Multiple Lyapunov functions and other analysis tools for switched and hybrid systems (1998) IEEE Trans. Automat. Contr, 43, pp. 475-482Hespanha, J.P., Uniform stability of switched linear systems : Extensions of LaSalle's principle (2004) IEEE Trans. Automat. Contr, 49, pp. 470-482Hockerman-Frommer, J., Kulkarni, S.R., Ramadge, P.J., Controller switching based on output predictions errors (1998) IEEE Trans. Automat. Contr, 43, pp. 596-607Johansson, M., Rantzer, A., Computation of piecewise quadratic Lyapunov functions for hybrid systems (1998) IEEE Trans. Automat. Contr, 43, pp. 555-559Ye, H., Michel, A.N., Hou, L., Stability theory for hybrid dynamical systems (1998) IEEE Trans. Automat. Contr, 43, pp. 461-474DeCarlo, R.A., Branicky, M.S., Pettersson, S., Lennartson, B., Perspectives and results on the stability and stabilizability of hybrid systems (2000) Proceedings of the IEEE, 88 (7), pp. 1069-1082Liberzon, D., Morse, A.S., Basic problems in stability and design of switched systems (1999) IEEE Control Systems Magazine, 19, pp. 59-70Liberzon, D., (2003) Switching in Systems and Control, , BirkhauserGeromel, J.C., Colaneri, P., Stabilization of continuous-time switched linear systems (2006) SIAM J. Control Optim, , to appearSussmann, H., New theories of set-valued differentials and new versuions of the maximum principle of optimal control theory, in Nonlinear Control in the year 2000, A. Isidori, F. Lamnabhi-Lagarrige, W. Respondek Eds, Vol2, pp- 487-526, Springer verlag, 2001Egerstedt, M., Ogren, P., Shakernia, O., Ligeros, J., Toward optimal control of switched linear systems (2000) Proc. 39th IEEE CDC, pp. 587-592Riedinger, P., Iung, C., Kratz, F., An optimal control approach for hybrid systems (2003) European J. of Contr, 49 (5), pp. 449-458Xuping, X., Antsaklis, P.J., Results and Perspectives on Computational Methods for Optimal Control of Switched Systems (2003) Sixth International Workshop on Hybrid Systems Computation and Control (HSCC), , Prague, Czech RepublicS. Bengea and R. DeCarlo, Optimal control of switching system, Automatica, 41, no. 2, pp. 11.27, 2005Giua, A., Seatzu, C. and Van der Mee, C.M., Optimal control of autonomous linear systems switched with a preassigned finite sequence, in Proc. of the ISIC,pp. 144-149, 2001Bemporad, A., Corona, D., Giua, A. and Seatzu, C., Optimal state feedback quadratic regulation of linear hybrid automata, in Proc. of the IFAC ADHS, pp. 407-412, 2003Seatzu, C., Corona, D., Giua, A., bemporad, A., Optimal control of continuous time switched affine systems (2006) IEEE Trans. on Automatic Control, 51 (5), pp. 726-741Athans, M., Falb, P., (1966) Optimal Control: An Introduction to the Theory and its Applications, , New York: McGraw-HillSavaresi, S.M., Silani, E., Bittanti, S., Acceleration-Driven- Damper (ADD): An optimal control algorithm for confort-oriented semiactive suspensions (2006) Trans. of the ASME, 127, pp. 218-228Geromel, J.C., Colaneri, P., Bolzern, P., Dynamic output feedback control of switched linear systems (2006), submittedWilliams, R.A., Automotive active suspensions, part I: Basic principles (1997) IMechE, 211, pp. 415-42