70 research outputs found

    Reinforcement Learning Based Control for Heating Ventilation and Air-conditioning

    Get PDF

    Design of an Online Optimisation Tool for Smart Home Heating Control

    Get PDF
    The performance of model predictive smart home heating control (SHHC) heavily depends on the accuracy of the initial setup for individual building characteristics. Since owners or renters of residential buildings are predominantly not experts, users’ acceptance of SHHC requires ease of use in the setup and minimal user intervention (e.g. only declaration of preferences), but at the same time high reliability of the initial parameter settings and flexibility to handle different preferences. In contrast, the training time of self-learning SHHC (e.g. based on artificial neural networks) to reach a reliable control status could conflict with the users’ request for comfortable heating from the very beginning. Dealing with this trade-off, this paper follows the tradition of design science research and presents a prototype of an online optimisation tool (OOT) for SHHC. The OOT is multi objective (e.g. minimising lifecycle energy (cost) or carbon emissions) under constraints such as thermal comfort. While the OOT is based on a discrete dynamic model, its self-adaptation is accelerated by a database of physically simulated characteristic buildings, which allows parameter setting at the beginning by a similarity measurement. The OOT artefact provides a base for empirically testing advantages of different SHHC design alternatives

    Model Predictive Evolutionary Temperature Control via Neural-Network-Based Digital Twins

    Get PDF
    In this study, we propose a population-based, data-driven intelligent controller that leverages neural-network-based digital twins for hypothesis testing. Initially, a diverse set of control laws is generated using genetic programming with the digital twin of the system, facilitating a robust response to unknown disturbances. During inference, the trained digital twin is utilized to virtually test alternative control actions for a multi-objective optimization task associated with each control action. Subsequently, the best policy is applied to the system. To evaluate the proposed model predictive control pipeline, experiments are conducted on a multi-mode heat transfer test rig. The objective is to achieve homogeneous cooling over the surface, minimizing the occurrence of hot spots and energy consumption. The measured variable vector comprises high dimensional infrared camera measurements arranged as a sequence (655,360 inputs), while the control variable includes power settings for fans responsible for convective cooling (3 outputs). Disturbances are induced by randomly altering the local heat loads. The findings reveal that by utilizing an evolutionary algorithm on measured data, a population of control laws can be effectively learned in the virtual space. This empowers the system to deliver robust performance. Significantly, the digital twin-assisted, population-based model predictive control (MPC) pipeline emerges as a superior approach compared to individual control models, especially when facing sudden and random changes in local heat loads. Leveraging the digital twin to virtually test alternative control policies leads to substantial improvements in the controller’s performance, even with limited training data

    Transfer learning for smart buildings: A critical review of algorithms, applications, and future perspectives

    Get PDF
    Smart buildings play a crucial role toward decarbonizing society, as globally buildings emit about one-third of greenhouse gases. In the last few years, machine learning has achieved a notable momentum that, if properly harnessed, may unleash its potential for advanced analytics and control of smart buildings, enabling the technique to scale up for supporting the decarbonization of the building sector. In this perspective, transfer learning aims to improve the performance of a target learner exploiting knowledge in related environments. The present work provides a comprehensive overview of transfer learning applications in smart buildings, classifying and analyzing 77 papers according to their applications, algorithms, and adopted metrics. The study identified four main application areas of transfer learning: (1) building load prediction, (2) occupancy detection and activity recognition, (3) building dynamics modeling, and (4) energy systems control. Furthermore, the review highlighted the role of deep learning in transfer learning applications that has been used in more than half of the analyzed studies. The paper also discusses how to integrate transfer learning in a smart building's ecosystem, identifying, for each application area, the research gaps and guidelines for future research directions

    Fairness-Aware Data-Driven Building Models (DDBMs) and Their Application in Model Predictive Controller (MPC)

    Get PDF
    In recent years, the massive data collection in buildings has paved the way for the development of accurate data-driven building models (DDBMs) for various applications. However, due to the variation in data volume of different conditions, existing DDBMs may present distinct accuracy for different users/occupants or periods/conditions. Accuracy variation among users or periods may creates unfairness problems (i.e., algorithmic biases created by data-driven models). This thesis explores and tackles this research problem called fairness-aware prediction of DDBMs. This thesis first presents a comprehensive review of the entire process involved in developing a DDBM and emphasizes the research gap on achieving fairness in DDBMs. As the first research that introduces fairness concepts into the building engineering domain, this thesis summarizes three types of commonly used fairness definitions. Among these concepts, achieving Type I and Type II fairness in DDBMs shows the beneficial for enabling users to do authority management, achieving uniform predictive performance under different periods or situations, and preserving fairness for different users. In addition, this thesis reviews the commonly used fairness improvement methods for data-driven models. Then, with the aim of improving fairness for DDBMs to have uniform predictive performance under different conditions and letting MPCs in buildings get optimal control signals based on fair prediction, this research proposes fairness improvement methods for both classification problems and regression problems in the building engineering domain and integrates fairness-aware DDBMs into model predictive controllers (MPCs). This work is separated into three tasks: 1) Task A: For classification problems, four kinds of pre-processing methods are proposed to balance the training dataset. 2) Task B: For regression problems, four in-processing methods, which incorporate fairness-related constraints or penalties into the optimization objective function during the training process of data-driven models, are studied. 3) Task C: The fairness improvement methods proposed in Task A and Task B will be integrated into MPCs. Case studies are conducted to implement the proposed fairness improvement methods to DDBMs for apartments, develop and integrate the fairness-aware DDBMs into MPCs to get the optimal set-point temperature for controlling the electrically heated floor system (EHF, a heating system with energy storage ability) in a bungalow building. The results show that 1) The proposed pre-processing methods could improve the predictive accuracy of minority conditions and increase fairness in terms of the accuracy rate between different conditions. 2) The proposed in-processing methods could achieve user-defined trade-off between accuracy and fairness. The Type II fairness is achieved by increasing the predictive performance similarity between different conditions. 3) Although improving predictive fairness would decrease the overall predictive accuracy, fairness-aware data-driven based MPCs would not decrease the cost saving and peak shifting ability, compared to the traditional MPC without considering fairness

    Scaling energy management in buildings with artificial intelligence

    Get PDF
    L'abstract è presente nell'allegato / the abstract is in the attachmen

    Control and management of energy storage systems in microgrids

    Get PDF
    The rate of integration of the renewable energy sources in modern grids have significantly increased in the last decade. These intermittent, non-dispatchable renewable sources, though environment friendly tend to be grid unfriendly. This is precisely due to the issues pertaining to grid congestion, voltage regulation and stability of grids being reported as a result of the incorporation of renewable sources. In this scenario, the use of energy storage systems (ESS ) in electric grids is being widely proposed to overcome these issues. However, integrating energy storage systems alone will not compensate for the issue created by renewable generation. The control and management of the ESS should be done optimally so that their full capabilities are exploited to overcome the issues in the power grids and to ensure their lower cost of investment by prolonging ESS lifetime through minimising degradation. Motivated by this aspect this Ph.D work focusses on developing an efficient, optimal control and management strategy for ESS in a microgrid, especially hybrid ESS. The Ph.D work addresses this issue by proposing a hierarchical control scheme comprising of a lower power management and higher energy management stage with contributions in each stage. In the power management stage this work focusses on improving aspects of real time control of power converters interfacing ESS to grid and the microgrid system as whole. The work proposes control systems with improved dynamic behaviour for power converters based on the reset control framework. In the microgrid control the work presents a primary+secondary control scheme with improved voltage regulation performance under disturbances, using an observer. The real time power splitting strategies among hybrid ESS accounting for the ESS operating efficiencies and degradation mechanisms will also be addressed in the primary+secondary control of power management stage. The design criteria, stability and robustness analysis will be carried out, along with simulation or experimental verifications. In the higher level energy management stage, the contribution of this work involves application of an economic MPC framework for the management of ESS in microgrids. The work specifically addresses the problems of mitigating grid congestion from renewable power feed-in, minimising ESS degradation and maximising self consumption of generated renewable energy using the MPC based energy management system. A survey of the forecasting methods that can be used for MPC will be carried out and a neural network based forecasting unit for time series prediction will be developed. The practical issue of accounting for forecasting error in the decision making of MPC will be addressed and impact of the resulting conservative decision making on the system performance will be analysed. The improvement in performance with the proposed energy management scheme will be demonstrated and quantified.La integración de las fuentes de energía renovables en las redes modernas ha aumentado significativamente en la última década. Estas fuentes renovables, aunque muy convenientes para el medio ambiente son de naturaleza intermitente, y son no panificables, cosa que genera problemas en la red de distribución. Esto se debe precisamente a los problemas relacionados con la congestión de la red y la regulación del voltaje. En este escenario, el uso de sistemas de almacenamiento de energía (ESS) en redes eléctricas está siendo ampliamente propuesto para superar estos problemas. Sin embargo, la integración de sistemas de almacenamiento de energía por sí solos no compensará el problema creado por la generación renovable. El control y la gestión del ESS deben realizarse de manera óptima, de modo que se aprovechen al máximo sus capacidades para superar los problemas en las redes eléctricas, garantizar un coste de inversión razonable y prolongar la vida útil del ESS minimizando su degradación. Motivado por esta problemática, esta tesis doctoral se centra en desarrollar una estrategia de control y gestión eficiente para los ESS integrados en una microrred, especialmente cuando se trata de ESS de naturaleza. El trabajo de doctorado propone un esquema de control jerárquico compuesto por un control de bajo nivel y una parte de gestión de energía operando a más alto nivel. El trabajo realiza aportaciones en los dos campos. En el control de bajo nivel, este trabajo se centra en mejorar aspectos del control en tiempo real de los convertidores que interconectan el ESS con la red y el sistema de micro red en su conjunto. El trabajo propone sistemas de control con comportamiento dinámico mejorado para convertidores de potencia desarrollados en el marco del control de tipo reset. En el control de microrred, el trabajo presenta un esquema de control primario y uno secundario con un rendimiento de regulación de voltaje mejorado bajo perturbaciones, utilizando un observador. Además, el trabajo plantea estrategias de reparto del flujo de potencia entre los diferentes ESS. Durante el diseño de estos algoritmos de control se tienen en cuenta los mecanismos de degradación de los diferentes ESS. Los algoritmos diseñados se validarán mediante simulaciones y trabajos experimentales. En el apartado de gestión de energía, la contribución de este trabajo se centra en la aplicación del un control predictivo económico basado en modelo (EMPC) para la gestión de ESS en microrredes. El trabajo aborda específicamente los problemas de mitigar la congestión de la red a partir de la alimentación de energía renovable, minimizando la degradación de ESS y maximizando el autoconsumo de energía renovable generada. Se ha realizado una revisión de los métodos de predicción del consumo/generación que pueden usarse en el marco del EMPC y se ha desarrollado un mecanismo de predicción basado en el uso de las redes neuronales. Se ha abordado el análisis del efecto del error de predicción sobre el EMPC y el impacto que la toma de decisiones conservadoras produce en el rendimiento del sistema. La mejora en el rendimiento del esquema de gestión energética propuesto se ha cuantificado.La integració de les fonts d'energia renovables a les xarxes modernes ha augmentat significativament en l’última dècada. Aquestes fonts renovables, encara que molt convenients per al medi ambient són de naturalesa intermitent, i són no panificables, cosa que genera problemes a la xarxa de distribució. Això es deu precisament als problemes relacionats amb la congestió de la xarxa i la regulació de la tensió. En aquest escenari, l’ús de sistemes d'emmagatzematge d'energia (ESS) en xarxes elèctriques està sent àmpliament proposat per superar aquests problemes. No obstant això, la integració de sistemes d'emmagatzematge d'energia per si sols no compensarà el problema creat per la generació renovable. El control i la gestió de l'ESS s'han de fer de manera _optima, de manera que s'aprofitin al màxim les seves capacitats per superar els problemes en les xarxes elèctriques, garantir un cost d’inversió raonable i allargar la vida útil de l'ESS minimitzant la seva degradació. Motivat per aquesta problemàtica, aquesta tesi doctoral es centra a desenvolupar una estratègia de control i gestió eficient per als ESS integrats en una microxarxa, especialment quan es tracta d'ESS de natura híbrida. El treball de doctorat proposa un esquema de control jeràrquic compost per un control de baix nivell i una part de gestió d'energia operant a més alt nivell. El treball realitza aportacions en els dos camps. En el control de baix nivell, aquest treball es centra a millorar aspectes del control en temps real dels convertidors que interconnecten el ESS amb la xarxa i el sistema de microxarxa en el seu conjunt. El treball proposa sistemes de control amb comportament dinàmic millorat per a convertidors de potència desenvolupats en el marc del control de tipus reset. En el control de micro-xarxa, el treball presenta un esquema de control primari i un de secundari de regulació de voltatge millorat sota pertorbacions, utilitzant un observador. A més, el treball planteja estratègies de repartiment de el flux de potència entre els diferents ESS. Durant el disseny d'aquests algoritmes de control es tenen en compte els mecanismes de degradació dels diferents ESS. Els algoritmes dissenyats es validaran mitjanant simulacions i treballs experimentals. En l'apartat de gestió d'energia, la contribució d'aquest treball se centra en l’aplicació de l'un control predictiu econòmic basat en model (EMPC) per a la gestió d'ESS en microxarxes. El treball aborda específicament els problemes de mitigar la congestió de la xarxa a partir de l’alimentació d'energia renovable, minimitzant la degradació d'ESS i maximitzant l'autoconsum d'energia renovable generada. S'ha realitzat una revisió dels mètodes de predicció del consum/generació que poden usar-se en el marc de l'EMPC i s'ha desenvolupat un mecanisme de predicció basat en l’ús de les xarxes neuronals. S'ha abordat l’anàlisi de l'efecte de l'error de predicció sobre el EMPC i l'impacte que la presa de decisions conservadores produeix en el rendiment de el sistema. La millora en el rendiment de l'esquema de gestió energètica proposat s'ha quantificat
    • …
    corecore