Online-Computation Approach to Optimal Control of Noise-Affected Nonlinear Systems with Continuous State and Control Spaces

© 2007 EUCA.A novel online-computation approach to optimal control of nonlinear, noise-affected systems with continuous state and control spaces is presented. In the proposed algorithm, system noise is explicitly incorporated into the control decision. This leads to superior results compared to state-of-the-art nonlinear controllers that neglect this influence. The solution of an optimal nonlinear controller for a corresponding deterministic system is employed to find a meaningful state space restriction. This restriction is obtained by means of approximate state prediction using the noisy system equation. Within this constrained state space, an optimal closed-loop solution for a finite decision-making horizon (prediction horizon) is determined within an adaptively restricted optimization space. Interleaving stochastic dynamic programming and value function approximation yields a solution to the considered optimal control problem. The enhanced performance of the proposed discrete-time controller is illustrated by means of a scalar example system. Nonlinear model predictive control is applied to address approximate treatment of infinite-horizon problems by the finite-horizon controller

Model predictive control techniques for hybrid systems

This paper describes the main issues encountered when applying model predictive control to hybrid processes. Hybrid model predictive control (HMPC) is a research field non-fully developed with many open challenges. The paper describes some of the techniques proposed by the research community to overcome the main problems encountered. Issues related to the stability and the solution of the optimization problem are also discussed. The paper ends by describing the results of a benchmark exercise in which several HMPC schemes were applied to a solar air conditioning plant.Ministerio de Eduación y Ciencia DPI2007-66718-C04-01Ministerio de Eduación y Ciencia DPI2008-0581

Adaptive dynamic programming-based algorithm for infinite-horizon linear quadratic stochastic optimal control problems

This paper investigates an infinite-horizon linear quadratic stochastic (LQS) optimal control problem for a class of continuous-time stochastic systems. By employing the technique of adaptive dynamic programming (ADP), we propose a novel model-free policy iteration (PI) algorithm. Without needing all information of the system coefficient matrices, the proposed PI algorithm iterates by using the data of the input and system state collected on a fixed time interval. Finally, a numerical example is presented to demonstrate the feasibility of the obtained algorithm

On the Potential Use of Adaptive Control Methods for Improving Adaptive Natural Resource Management

The paradigm of adaptive natural resource management (AM), in which experiments are used to learn about uncertain aspects of natural systems, is gaining prominence as the preferred technique for administration of large-scale environmental projects. To date, however, tools consistent with economic theory have yet to be used to either evaluate AM strategies or improve decision-making in this framework. Adaptive control (AC) techniques provide such an opportunity. This paper demonstrates the conceptual link between AC methods, the alternative treatment of realized information during a planning horizon, and AM practices; shows how the different assumptions about the treatment of observational information can be represented through alternative dynamic programming model structures; and provides a means of valuing alternative treatments of information and augmenting traditional benefit-cost analysis through a decomposition of the value function. The AC approach has considerable potential to help managers prioritize experiments, plan AM programs, simulate potential AM paths, and justify decisions based on an objective valuation framework.adaptive control, adaptive management, dynamic programming, value of experimentation, value of information, Resource /Energy Economics and Policy,