Optimization Algorithms as Robust Feedback Controllers

Mathematical optimization is one of the cornerstones of modern engineering research and practice. Yet, throughout all application domains, mathematical optimization is, for the most part, considered to be a numerical discipline. Optimization problems are formulated to be solved numerically with specific algorithms running on microprocessors. An emerging alternative is to view optimization algorithms as dynamical systems. Besides being insightful in itself, this perspective liberates optimization methods from specific numerical and algorithmic aspects and opens up new possibilities to endow complex real-world systems with sophisticated self-optimizing behavior. Towards this goal, it is necessary to understand how numerical optimization algorithms can be converted into feedback controllers to enable robust "closed-loop optimization". In this article, we focus on recent control designs under the name of "feedback-based optimization" which implement optimization algorithms directly in closed loop with physical systems. In addition to a brief overview of selected continuous-time dynamical systems for optimization, our particular emphasis in this survey lies on closed-loop stability as well as the robust enforcement of physical and operational constraints in closed-loop implementations. To bypass accessing partial model information of physical systems, we further elaborate on fully data-driven and model-free operations. We highlight an emerging application in autonomous reserve dispatch in power systems, where the theory has transitioned to practice by now. We also provide short expository reviews of pioneering applications in communication networks and electricity grids, as well as related research streams, including extremum seeking and pertinent methods from model predictive and process control, to facilitate high-level comparisons with the main topic of this survey

Modelling and control of a waste to energy plant : waste bed temperature control using a feedback control law

In this dissertation the waste incineration process has been described, an overview of the state of the art control methodologies given and a new approach, based on input/output linearization and extremum seeking has been presented. This approach has been tested on a model appositely designed. The results have shown that it is possible to control the waste bed temperature to certain reference values, with robustness against changes in the waste composition. It is furthermore possible to identify reference values for the waste bed temperature such as the steam ow rate is maximized, while at the same time fulfilling operational constraints

Nondisturbing extremum seeking control for multi-agent industrial systems

Industrial applications of extremum seeking control (ESC) can be a hit and miss affair. Although a gain in performance can be achieved, the dither applied to excite the system causes unwanted fluctuations in the performance of the system. The fluctuations in systems with a single extremum seeking loop are generally small. However, for systems with many extremum seeking loops, the fluctuations in each loop may add up to an intolerable amount of fluctuation in the total performance. In this article, we propose a method to cancel the dither-induced fluctuations in the overall system performance to a large extent by smartly constructing the dither signals in each extremum seeking loop using a centralized coordinator. The novelty of our method lies in the direct calculation of the dither signals that avoids the heavy computations required by other methods. Moreover, we provide a solvability analysis for the problem of cancelling dither-induced fluctuations in the total performance of the system. Furthermore, a complete stability analysis of the overall ESC scheme with dither coordination is given.publishedVersio

Advanced control and optimisation of DC-DC converters with application to low carbon technologies

Prompted by a desire to minimise losses between power sources and loads, the aim of this Thesis is to develop novel maximum power point tracking (MPPT) algorithms to allow for efficient power conversion within low carbon technologies. Such technologies include: thermoelectric generators (TEG), photovoltaic (PV) systems, fuel cells (FC) systems, wind turbines etc. MPPT can be efficiently achieved using extremum seeking control (ESC) also known as perturbation based extremum seeking control. The basic idea of an ESC is to search for an extrema in a closed loop fashion requiring only a minimum of a priori knowledge of the plant or system or a cost function. In recognition of problems that accompany ESC, such as limit cycles, convergence speed, and inability to search for global maximum in the presence local maxima this Thesis proposes novel schemes based on extensions of ESC. The first proposed scheme is a variance based switching extremum seeking control (VBS-ESC), which reduces the amplitude of the limit cycle oscillations. The second scheme proposed is a state dependent parameter extremum seeking control (SDP-ESC), which allows the exponential decay of the perturbation signal. Both the VBS-ESC and the SDP-ESC are universal adaptive control schemes that can be applied in the aforementioned systems. Both are suitable for local maxima search. The global maximum search scheme proposed in this Thesis is based on extensions of the SDP-ESC. Convergence to the global maximum is achieved by the use of a searching window mechanism which is capable of scanning all available maxima within operating range. The ability of the proposed scheme to converge to the global maximum is demonstrated through various examples. Through both simulation and experimental studies the benefit of the SDP-ESC has been consistently demonstrated

Investigation of Some Self-Optimizing Control Problems for Net-Zero Energy Buildings

Green buildings are sustainable buildings designed to be environmentally responsible and resource efficient. The Net-Zero Energy Building (NZEB) concept is anchored on two pillars: reducing the energy consumption and enhancing the local energy generation. In other words, efficient operation of the existing building equipment and efficient power generation of building integrated renewable energy sources are two important factors of NZEB development. The heating, ventilation and air conditioning (HVAC) systems are an important class of building equipment that is responsible for large portion of building energy usage, while the building integrated photovoltaic (BIPV) system is well received as the key technology for local generation of clean power. Building system operation is a low-investment practice that aims low operation and maintenance cost. However, building HVAC and BIPV are systems subject to complicated intrinsic processes and highly variable environmental conditions and occupant behavior. Control, optimization and monitoring of such systems desire simple and effective approaches that require the least amount of model information and the use of smallest number but most robust sensor measurements. Self-optimizing control strategies promise a competitive platform for control, optimization and control integrated monitoring for building systems, and especially for the development of cost-effective NZEB. This dissertation study endorses this statement with three aspects of work relevant to building HVAC and BIPV, which could contribute several small steps towards the ramification of the self-optimizing control paradigm. This dissertation study applies self-optimizing control techniques to improve the energy efficiency of NZEB from two aspects. First, regarding the building HVAC efficiency, the dither based extremum seeking control (DESC) scheme is proposed for energy efficient operation of the chilled-water system typically used in the commercial building ventilation and air conditioning (VAC) systems. To evaluate the effectiveness of the proposed control strategy, Modelica based dynamic simulation model of chilled water chiller-tower plant is developed, which consists of a screw chiller and a mechanical-draft counter-flow wet cooling tower. The steady-state performance of the cooling tower model is validated with the experimental data in a classic paper and good agreement is observed. The DESC scheme takes the total power consumption of the chiller compressor and the tower fan as feedback, and uses the fan speed setting as the control input. The inner loop controllers for the chiller operation include two proportional-integral (PI) control loops for regulating the evaporator superheat and the chilled water temperature. Simulation was conducted on the whole dynamic simulation model with different environment conditions. The simulation results demonstrated the effectiveness of the proposed ESC strategy under abrupt changes of ambient conditions and load changes. The potential for energy savings of these cases are also evaluated. The back-calculation based anti-windup ESC is also simulated for handling the integral windup problem due to actuator saturation. Second, both maximum power point tracking (MPPT) and control integrated diagnostics are investigated for BIPV with two different extremum seeking control strategies, which both would contribute to the reduction of the cost of energy (COE). In particular, the Adaptive Extremum Seeking Control (AESC) is applied for PV MPPT, which is based on a PV model with known model structure but unknown nonlinear characteristics for the current-voltage relation. The nonlinear uncertainty is approximated by a radial basis function neural network (RBFNN). A Lyapunov based inverse optimal design technique is applied to achieve parameter estimation and gradient based extremum seeking. Simulation study is performed for scenarios of temperature change, irradiance change and combined change of temperature and irradiance. Successful results are observed for all cases. Furthermore, the AESC simulation is compared to the DESC simulation, and AESC demonstrates much faster transient responses under various scenarios of ambient changes. Many of the PV degradation mechanisms are reflected as the change of the internal resistance. A scheme of detecting the change of PV internal shunt resistance is proposed using the available signals in the DESC based MPPT with square-wave dither. The impact of the internal resistance on the transient characteristics of step responses is justified by using the small-signal transfer function analysis. Simulation study is performed for both the single-string and multi-string PV examples, and both cases have demonstrated successful results. Monotonic relationship between integral error indices and the shunt internal resistance is clearly observed. In particular, for the multi-string, the inter-channel coupling is weak, which indicates consistent monitoring for multi-string operation. The proposed scheme provides the online monitoring ability of the internal resistance condition without any additional sensor, which benefits further development of PV degradation detection techniques

Sampled-data extremum-seeking framework for constrained optimization of nonlinear dynamical systems

Most extremum-seeking control (ESC) approaches focus solely on the problem of finding the extremum of some unknown, steady-state input–output map, providing parameter settings that lead to optimal steady-state system performance. However, many industrial applications also have to deal with constraints on operating conditions due to, e.g., actuator limitations, limitations on tunable system parameters, or constraints on measurable variables. In particular, constraints on measurable variables are typically unknown in terms of their relationship with the tunable system parameters. In addition, the constraints on system inputs as a result of the constraints on measurable variables may conflict with the otherwise optimal operational condition, and hence should be taken into account in the data-based optimization approach. In this work, we propose a sampled-data extremum-seeking framework for the constrained optimization of a class of nonlinear dynamical systems with measurable constrained variables. In this framework, barrier function methods are employed, exploiting both the objective function and constraint functions which are available through output measurement only. We show, under the assumption that the parametric initialization yield operating conditions that do not violate the constraints, that (1) the resulting closed-loop dynamics is stable, (2) constraint satisfaction of the inputs is guaranteed for all iterations of the optimization process, and (3) constrained optimization is achieved. We illustrate the working principle of the proposed framework by means of an industrial case study of the constrained optimization of extreme ultraviolet light generation in a laser-produced plasma source within a state-of-the-art lithography system.</p

Sampled-data extremum-seeking framework for constrained optimization of nonlinear dynamical systems

Most extremum-seeking control (ESC) approaches focus solely on the problem of finding the extremum of some unknown, steady-state input–output map, providing parameter settings that lead to optimal steady-state system performance. However, many industrial applications also have to deal with constraints on operating conditions due to, e.g., actuator limitations, limitations on tunable system parameters, or constraints on measurable variables. In particular, constraints on measurable variables are typically unknown in terms of their relationship with the tunable system parameters. In addition, the constraints on system inputs as a result of the constraints on measurable variables may conflict with the otherwise optimal operational condition, and hence should be taken into account in the data-based optimization approach. In this work, we propose a sampled-data extremum-seeking framework for the constrained optimization of a class of nonlinear dynamical systems with measurable constrained variables. In this framework, barrier function methods are employed, exploiting both the objective function and constraint functions which are available through output measurement only. We show, under the assumption that the parametric initialization yield operating conditions that do not violate the constraints, that (1) the resulting closed-loop dynamics is stable, (2) constraint satisfaction of the inputs is guaranteed for all iterations of the optimization process, and (3) constrained optimization is achieved. We illustrate the working principle of the proposed framework by means of an industrial case study of the constrained optimization of extreme ultraviolet light generation in a laser-produced plasma source within a state-of-the-art lithography system.</p