Stochastic Nonlinear Model Predictive Control with Efficient Sample Approximation of Chance Constraints

This paper presents a stochastic model predictive control approach for nonlinear systems subject to time-invariant probabilistic uncertainties in model parameters and initial conditions. The stochastic optimal control problem entails a cost function in terms of expected values and higher moments of the states, and chance constraints that ensure probabilistic constraint satisfaction. The generalized polynomial chaos framework is used to propagate the time-invariant stochastic uncertainties through the nonlinear system dynamics, and to efficiently sample from the probability densities of the states to approximate the satisfaction probability of the chance constraints. To increase computational efficiency by avoiding excessive sampling, a statistical analysis is proposed to systematically determine a-priori the least conservative constraint tightening required at a given sample size to guarantee a desired feasibility probability of the sample-approximated chance constraint optimization problem. In addition, a method is presented for sample-based approximation of the analytic gradients of the chance constraints, which increases the optimization efficiency significantly. The proposed stochastic nonlinear model predictive control approach is applicable to a broad class of nonlinear systems with the sufficient condition that each term is analytic with respect to the states, and separable with respect to the inputs, states and parameters. The closed-loop performance of the proposed approach is evaluated using the Williams-Otto reactor with seven states, and ten uncertain parameters and initial conditions. The results demonstrate the efficiency of the approach for real-time stochastic model predictive control and its capability to systematically account for probabilistic uncertainties in contrast to a nonlinear model predictive control approaches.Comment: Submitted to Journal of Process Contro

Stochastic MPC with Distributionally Robust Chance Constraints

In this paper we discuss distributional robustness in the context of stochastic model predictive control (SMPC) for linear time-invariant systems. We derive a simple approximation of the MPC problem under an additive zero-mean i.i.d. noise with quadratic cost. Due to the lack of distributional information, chance constraints are enforced as distributionally robust (DR) chance constraints, which we opt to unify with the concept of probabilistic reachable sets (PRS). For Wasserstein ambiguity sets, we propose a simple convex optimization problem to compute the DR-PRS based on finitely many disturbance samples. The paper closes with a numerical example of a double integrator system, highlighting the reliability of the DR-PRS w.r.t. the Wasserstein set and performance of the resulting SMPC.Comment: Extended version with proofs; accepted for presentation at the 21st IFAC World Congress 202

A stochastic output-feedback MPC scheme for distributed systems

In this paper, we present a novel stochastic output-feedback MPC scheme for distributed systems with additive process and measurement noise. The chance constraints are treated with the concept of probabilistic reachable sets, which, under an unimodality assumption on the disturbance distributions are guaranteed to be satisfied in closed-loop. By conditioning the initial state of the optimization problem on feasibility, the fundamental property of recursive feasibility is ensured. Closed-loop chance constraint satisfaction, recursive feasibility and convergence to an asymptotic average cost bound are proven. The paper closes with a numerical example of three interconnected subsystems, highlighting the chance constraint satisfaction and average cost compared to a centralized setting.Comment: 2020 American Control Conferenc

Risk Management using Model Predictive Control

Forward planning and risk management are crucial for the success of any system or business dealing with the uncertainties of the real world. Previous approaches have largely assumed that the future will be similar to the past, or used simple forecasting techniques based on ad-hoc models. Improving solutions requires better projection of future events, and necessitates robust forward planning techniques that consider forecasting inaccuracies. This work advocates risk management through optimal control theory, and proposes several techniques to combine it with time-series forecasting. Focusing on applications in foreign exchange (FX) and battery energy storage systems (BESS), the contributions of this thesis are three-fold. First, a short-term risk management system for FX dealers is formulated as a stochastic model predictive control (SMPC) problem in which the optimal risk-cost profiles are obtained through dynamic control of the dealers’ positions on the spot market. Second, grammatical evolution (GE) is used to automate non-linear time-series model selection, validation, and forecasting. Third, a novel measure for evaluating forecasting models, as a part of the predictive model in finite horizon optimal control applications, is proposed. Using both synthetic and historical data, the proposed techniques were validated and benchmarked. It was shown that the stochastic FX risk management system exhibits better risk management on a risk-cost Pareto frontier compared to rule-based hedging strategies, with up to 44.7% lower cost for the same level of risk. Similarly, for a real-world BESS application, it was demonstrated that the GE optimised forecasting models outperformed other prediction models by at least 9%, improving the overall peak shaving capacity of the system to 57.6%

Risk Management using Model Predictive Control

Forward planning and risk management are crucial for the success of any system or business dealing with the uncertainties of the real world. Previous approaches have largely assumed that the future will be similar to the past, or used simple forecasting techniques based on ad-hoc models. Improving solutions requires better projection of future events, and necessitates robust forward planning techniques that consider forecasting inaccuracies. This work advocates risk management through optimal control theory, and proposes several techniques to combine it with time-series forecasting. Focusing on applications in foreign exchange (FX) and battery energy storage systems (BESS), the contributions of this thesis are three-fold. First, a short-term risk management system for FX dealers is formulated as a stochastic model predictive control (SMPC) problem in which the optimal risk-cost profiles are obtained through dynamic control of the dealers’ positions on the spot market. Second, grammatical evolution (GE) is used to automate non-linear time-series model selection, validation, and forecasting. Third, a novel measure for evaluating forecasting models, as a part of the predictive model in finite horizon optimal control applications, is proposed. Using both synthetic and historical data, the proposed techniques were validated and benchmarked. It was shown that the stochastic FX risk management system exhibits better risk management on a risk-cost Pareto frontier compared to rule-based hedging strategies, with up to 44.7% lower cost for the same level of risk. Similarly, for a real-world BESS application, it was demonstrated that the GE optimised forecasting models outperformed other prediction models by at least 9%, improving the overall peak shaving capacity of the system to 57.6%

Randomized Model Predictive Control for Stochastic Linear Systems

This paper is concerned with the design of state-feedback control laws for linear time invariant systems that are subject to stochastic additive disturbances, and probabilistic constraints on the states. The design is based on a stochastic Model Predictive Control (MPC) approach, for which a randomization technique is applied in order to find a sub-optimal solution to the underlying, generally non-convex chance constrained program. The proposed method yields a linear or quadratic program to be solved online at each time step, whose complexity is the same as that of a nominal MPC problem, i.e. if no disturbances were present. Furthermore, it is shown how the quality of the sub-optimal solution can be improved through a procedure for the removal of sampled constraints a-posteriori, at the price of increased online computation efforts. Finally, this randomized approach can be combined with further constraint tightening, in order to guarantee recursive feasibility for the closed loop system

Randomized Model Predictive Control for Stochastic Linear Systems

This paper is concerned with the design of state-feedback control laws for linear time invariant systems that are subject to stochastic additive disturbances, and probabilistic constraints on the states. The design is based on a stochastic Model Predictive Control (MPC) approach, for which a randomization technique is applied in order to find a sub-optimal solution to the underlying, generally non-convex chance constrained program. The proposed method yields a linear or quadratic program to be solved online at each time step, whose complexity is the same as that of a nominal MPC problem, i.e. if no disturbances were present. Furthermore, it is shown how the quality of the sub-optimal solution can be improved through a procedure for the removal of sampled constraints a-posteriori, at the price of increased online computation efforts. Finally, this randomized approach can be combined with further constraint tightening, in order to guarantee recursive feasibility for the closed loop system