A hierarchical MPC scheme for interconnected systems

This paper describes a hierarchical control scheme for interconnected systems. The higher layer of the control structure is designed with robust Model Predictive Control (MPC) based on a reduced order dynamic model of the overall system and is aimed at optimizing long-term performance, while at the lower layer local regulators acting at a higher frequency are designed for the full order models of the subsystems to refine the control action. A simulation experiment concerning the control of the temperature inside a building is reported to witness the potentialities of the proposed approach

Reinforcement Learning Based on Real-Time Iteration NMPC

Reinforcement Learning (RL) has proven a stunning ability to learn optimal policies from data without any prior knowledge on the process. The main drawback of RL is that it is typically very difficult to guarantee stability and safety. On the other hand, Nonlinear Model Predictive Control (NMPC) is an advanced model-based control technique which does guarantee safety and stability, but only yields optimality for the nominal model. Therefore, it has been recently proposed to use NMPC as a function approximator within RL. While the ability of this approach to yield good performance has been demonstrated, the main drawback hindering its applicability is related to the computational burden of NMPC, which has to be solved to full convergence. In practice, however, computationally efficient algorithms such as the Real-Time Iteration (RTI) scheme are deployed in order to return an approximate NMPC solution in very short time. In this paper we bridge this gap by extending the existing theoretical framework to also cover RL based on RTI NMPC. We demonstrate the effectiveness of this new RL approach with a nontrivial example modeling a challenging nonlinear system subject to stochastic perturbations with the objective of optimizing an economic cost.Comment: accepted for the IFAC World Congress 202

Temperature control of open-cathode PEM fuel cells

Proper temperature control of Proton Exchange Membrane (PEM) Fuel Cells is a crucial factor for optimizing fuel cell performance. A robust temperature controller is required for optimal water management of PEM fuel cells. This paper describes a model-based characterization of the equilibrium points of an open-cathode fuel cell system as the baseline for proper controller design, highlighting the relation between fuel cell temperature, humidification and performance. Phase plane analysis of the nonlinear model versus a linearized model around different points of operation shows the potential of approximating the nonlinear system behavior with a linear model. The methodology for the system analysis presented in this paper finally serves for the development of control schemes using robust control techniques. The designed controller is validated in simulation with the nonlinear plant model.Postprint (published version

An Economic Model-Based Predictive Control to Manage the Users' Thermal Comfort in a Building

The goal of maintaining users' thermal comfort conditions in indoor environments may require complex regulation procedures and a proper energy management. This problem is being widely analyzed, since it has a direct effect on users' productivity. This paper presents an economic model-based predictive control (MPC) whose main strength is the use of the day-ahead price (DAP) in order to predict the energy consumption associated with the heating, ventilation and air conditioning (HVAC). In this way, the control system is able to maintain a high thermal comfort level by optimizing the use of the HVAC system and to reduce, at the same time, the energy consumption associated with it, as much as possible. Later, the performance of the proposed control system is tested through simulations with a non-linear model of a bioclimatic building room. Several simulation scenarios are considered as a test-bed. From the obtained results, it is possible to conclude that the control system has a good behavior in several situations, i.e., it can reach the users' thermal comfort for the analyzed situations, whereas the HVAC use is adjusted through the DAP; therefore, the energy savings associated with the HVAC is increased.Spanish Ministry of Science and Innovation [DPI2014-56364-C2-1-R]; EU-ERDF funds; Competitiveness and ERDF funds; Fundacion Iberdrola Espana; Portuguese Foundation for Science & Technology, through IDMEC, under LAETA [ID/EMS/50022/2013

Learning-based Predictive Control Approach for Real-time Management of Cyber-physical Systems

Cyber-physical systems (CPSs) are composed of heterogeneous, and networked hardware and software components tightly integrated with physical elements [72]. Large-scale CPSs are composed of complex components, subject to uncertainties [89], as though their design and development is a challenging task. Achieving reliability and real-time adaptation to changing environments are some of the challenges involved in large-scale CPSs development [51]. Addressing these challenges requires deep insights into control theory and machine learning. This research presents a learning-based control approach for CPSs management, considering their requirements, specifications, and constraints. Model-based control approaches, such as model predictive control (MPC), are proven to be efficient in the management of CPSs [26]. MPC is a control technique that uses a prediction model to estimate future dynamics of the system and generate an optimal control sequence over a prediction horizon. The main benefit of MPC in CPSs management comes from its ability to take the predictions of system’s environmental conditions and disturbances into account [26]. In this dissertation, centralized and distributed MPC strategies are designed for the management of CPSs. They are implemented for the thermal management of a CPS case study, smart building. The control goals are optimizing system efficiency (lower thermal power consumption in the building), and improving users’ convenience (maintaining desired indoor thermal conditions in the building). Model-based control strategies are advantageous in the management of CPSs due to their ability to provide system robustness and stability. The performance of a model-based controller strongly depends on the accuracy of the model as a representation of the system dynamics [26]. Accurate modeling of large-scale CPSs is difficult (due to the existence of unmodeled dynamics and uncertainties in the modeling process); therefore, modelbased control approach is not practical for these systems [6]. By incorporating machine learning with model-based control strategies, we can address CPS modeling challenges while preserving the advantages of model-based control methods. In this dissertation, a learning-based modeling strategy incorporated with a model-based control approach is proposed to manage energy usage and maintain thermal, visual, and olfactory performance in buildings. Neural networks (NNs) are used to learn the building’s performance criteria, occupant-related parameters, environmental conditions, and operation costs. Control inputs are generated through the model-based predictive controller and based on the learned parameters, to achieve the desired performance. In contrast to the existing building control systems presented in the literature, the proposed management system integrates current and future information of occupants (convenience, comfort, activities), building energy trends, and environment conditions (environmental temperature, humidity, and light) into the control design. This data is synthesized and evaluated in each instance of decision-making process for managing building subsystems. Thus, the controller can learn complex dynamics and adapt to the changing environment, to achieve optimal performance while satisfying problem constraints. Furthermore, while many prior studies in the filed are focused on optimizing a single aspect of buildings (such as thermal management), and little attention is given to the simultaneous management of all building objectives, our proposed management system is developed considering all buildings’ physical models, environmental conditions, comfort specifications, and occupants’ preferences, and can be applied to various building management applications. The proposed control strategy is implemented to manage indoor conditions and energy consumption in a building, simulated in EnergyPlus software. In addition, for comparison purposes, we designed and simulated a baseline controller for the building under the same conditions

Optimizing heart rate regulation for safe exercise

Safe exercise protocols are critical for effective rehabilitation programs. This paper aims to develop a novel control strategy for an automated treadmill system to reduce the danger of injury during cardiac rehabilitation. We have developed a control-oriented nonparametric Hammerstein model for the control of heart rate during exercises by using support vector regression and correlation analysis. Based on this nonparametric model, a model predictive controller has been built. In order to guarantee the safety of treadmill exercise during rehabilitation, this new automated treadmill system is capable of optimizing system performance over predefined ranges of speed and acceleration. The effectiveness of the proposed approach was demonstrated with six subjects by having their heart rate track successfully a predetermined heart rate. © 2009 Biomedical Engineering Society