Data Mining for Prosumers Aggregation considering the Self-Generation

Several challenges arrive with electrical power restructuring, liberalized electricity markets emerge, aiming to improve the system’s efficiency while offering new economic solutions. Privatization and liberalization of previously nationally owned systems are examples of the transformations that have been applied. Microgrids and smart grids emerge and new business models able to cope with new opportunities start being developed. New types of players appear, allowing aggregating a diversity of entities, e.g. generation, storage, electric vehicles, and consumers, Virtual Power Players (VPPs) are a new type of player that allows aggregating a diversity of players to facilitate their participation in the electricity markets. A major task of VPPs is the remuneration of generation and services (maintenance, market operation costs and energy reserves), as well as charging energy consumption. The paper proposes a normalization method that supports a clustering methodology for the remuneration and tariffs definition. This model uses a clustering algorithm, applied on normalized load values, the value of the micro production, generated in the bus associated to the same load, was subtracted from the value of the consumption of that load. This calculation is performed in a real smart grid on buses with associated micro production. This allows the creation of sub-groups of data according to their correlations. The clustering process is evaluated so that the number of data sub-groups that brings the most added value for the decision making process is found, according to players characteristics.The present work has been developed under the EUREKA - ITEA2 Project FUSE-IT (ITEA-13023), Project GREEDI (ANI|P2020 17822), and has received funding from FEDER Funds through COMPETE program and from National Funds through FCT under the project UID/EEA/00760/2013.info:eu-repo/semantics/publishedVersio

Effective demand response gathering and deployment in smart grids for intensive renewable integration using aggregation and machine learning

Tesis por compendio de publicaciones.[EN] Distributed generation, namely renewables-based technologies, have emerged as a crucial component in the transition to mitigate the effects of climate change, providing a decentralized approach to electricity production. However, the volatile behavior of distributed generation has created new challenges in maintaining system balance and reliability. In this context, the demand response concept and corresponding programs arise giving the local energy communities prominence. In demand response concept, it is expected an empowerment of the consumer in the electricity sector. This has a significant impact on grid operations and brings complex interactions due to the volatile behavior, privacy concerns, and lack of consumer knowledge in the energy market context. For this, aggregators play a crucial role addressing these challenges. It is crucial to develop tools that allow the aggregators helping consumers to make informed decisions, maximize the benefits of their flexibility resources, and contribute to the overall success of grid operations. This thesis, through innovative solutions and resorting to artificial intelligence models, addresses the integration of renewables, promoting fair participation among all demand response providers. The thesis ultimately results in an innovative decision support system - MAESTRO, the Machine learning Assisted Energy System management Tool for Renewable integration using demand respOnse. MAESTRO is composed by a set of diversified models that together contribute for handling the complexity of managing energy communities with distributed generation resources, demand response providers, energy storage systems and electric vehicles. This PhD thesis comprises a comprehensive analysis of state-of-the-art techniques, system design and development, experimental results, and key findings. In this research were published twenty-six scientific papers, in both international journals and conference proceedings. Contributions to international projects and Portuguese projects was accomplished. [ES] La generación distribuida, en particular las tecnologías basadas en energías renovables, se ha convertido en un componente crucial en la transición para mitigar los efectos del cambio climático, al proporcionar un enfoque descentralizado para la producción de electricidad. Sin embargo, el comportamiento volátil de la generación distribuida ha generado nuevos desafíos para mantener el equilibrio y la confiabilidad del sistema. En este contexto, surge el concepto de respuesta de la demanda y los programas correspondientes, otorgando prominencia a las comunidades energéticas locales. En el concepto de "respuesta a la demanda" (DR por sus siglas en inglés), se espera un empoderamiento del consumidor en el sector eléctrico. Esto tiene un impacto significativo en la operación de la red y genera interacciones complejas debido al comportamiento volátil, las preocupaciones de privacidad y la falta de conocimiento del consumidor en el contexto del mercado energético. Para esto, los agregadores desempeñan un papel crucial al abordar estos desafíos. Es fundamental desarrollar herramientas que permitan a los agregadores ayudar a los consumidores a tomar decisiones informadas, maximizar los beneficios de sus recursos de flexibilidad y contribuir al éxito general de las operaciones de la red. Esta tesis, a través de soluciones innovadoras y utilizando modelos de inteligencia artificial, aborda la integración de energías renovables, promoviendo una participación justa entre todos los proveedores de respuesta de la demanda. La tesis resulta en última instancia en un sistema de apoyo a la toma de decisiones innovador: MAESTRO, Machine learning Assisted Energy System management Tool for Renewable integration using demand respOnse. MAESTRO está compuesto por un conjunto de modelos diversificados que contribuyen juntos para manejar la complejidad de la gestión de comunidades energéticas con recursos de generación distribuida, proveedores de respuesta de la demanda, sistemas de almacenamiento de energía y vehículos eléctricos. Esta tesis de doctorado comprende un análisis exhaustivo de las técnicas de vanguardia, el diseño y desarrollo del sistema, los resultados experimentales y los hallazgos clave. En esta investigación se publicaron veintiséis artículos científicos, tanto en revistas internacionales como en actas de conferencias. Se lograron contribuciones a proyectos internacionales y proyectos portugueses. [POR] A produção distribuída, nomeadamente as tecnologias baseadas em energias renováveis, emergiram como um componente crucial na transição para mitigar os efeitos das alterações climáticas, proporcionando uma abordagem descentralizada à produção de eletricidade. No entanto, o comportamento volátil da geração distribuída criou desafios na manutenção do equilíbrio e da fiabilidade do sistema. Nesse contexto, surge o conceito de resposta à procura e os programas correspondentes, conferindo proeminência às comunidades energéticas locais. No conceito de resposta à procura, espera-se um empoderamento do consumidor no setor elétrico. Isso tem um impacto significativo nas operações da rede e gera interações complexas devido ao comportamento volátil, preocupações com a privacidade e falta de conhecimento dos consumidores no contexto do mercado energético. Para isso, os agregadores desempenham um papel crucial ao lidar com esses desafios. É fundamental desenvolver ferramentas que permitam aos agregadores ajudar os consumidores a tomar decisões informadas, maximizar os benefícios de seus recursos de flexibilidade e contribuir para o sucesso global das operações da rede. Esta tese de doutoramento, através de soluções inovadoras e recorrendo a modelos de inteligência artificial, aborda a integração de energias renováveis, promovendo uma participação justa entre todos os fornecedores de resposta à procura. A tese resulta, em última instância, num sistema inovador de apoio à tomada de decisões - MAESTRO, Machine learning Assisted Energy System management Tool for Renewable integration using demand respOnse. A ferramenta MAESTRO é composta por um conjunto de modelos diversificados que, em conjunto, contribuem para lidar com a complexidade da gestão de comunidades energéticas com recursos de geração distribuída, fornecedores de resposta à procura, sistemas de armazenamento de energia e veículos elétricos. Esta tese de doutoramento abrange uma análise abrangente de técnicas de ponta, design e desenvolvimento do sistema, resultados experimentais e descobertas-chave. Nesta pesquisa, foram publicados vinte e seis artigos científicos, tanto em revistas internacionais como em atas de conferências. Foram realizadas contribuições para projetos internacionais e projetos portugueses

Business models in the Smart Grid: challenges, opportunities and proposals for prosumer profitability.

Considering that non-renewable energy resources are dwindling, the smart grid turns out to be one of the most promising and compelling systems for the future of energy. Not only does it combine efficient energy consumption with avant-garde technologies related to renewable energies, but it is also capable of providing several beneficial utilities, such as power monitoring and data provision. When smart grid end users turn into prosumers, they become arguably the most important value creators within the smart grid and a decisive agent of change in terms of electricity usage. There is a plethora of research and development areas related to the smart grid that can be exploited for new business opportunities, thus spawning another branch of the so-called ?green economy? focused on turning smart energy usage into a profitable business. This paper deals with emerging business models for smart grid prosumers, their strengths and weaknesses and puts forward new prosumer-oriented business models, along with their value propositions

Coalitional Game Theory based Value Sharing in Energy Communities

This paper presents a coalitional game for value sharing in energy communities (ECs). It is proved that the game is super-additive, and the grand coalition effectively increases the global payoff. It is also proved that the model is balanced and thus, it has a nonempty core. This means there always exists at least one value sharing mechanism that makes the grand coalition stable. Therefore, prosumers will always achieve lower bills if they join to form larger ECs. A counterexample is presented to demonstrate that the game is not convex and value sharing based on Shapley values does not necessarily ensure the stability of the coalition. To find a stabilizing value sharing mechanism that belongs to the core of the game, the worst-case excess minimization concept is applied. In this concept, however, size of the optimization problem increases exponentially with respect to the number of members in EC. To make the problem computationally tractable, the idea of clustering members based on their generation/load profiles and considering the same profile and share for members in the same cluster is proposed here. K-means algorithm is used for clustering prosumers’ profiles. This way, the problem would have several redundant constraints that can be removed. The redundant constraints are identified and removed via the generalized Llewellyn’s rules. Finally, value sharing in an apartment building in the southern part of Finland in the metropolitan area is studied to demonstrate effectiveness of the method

Characterization of new flexible players: Deliverable D3.2

Project TradeRES - New Markets Design & Models for 100% Renewable Power Systems: https://traderes.eu/about/ABSTRACT: The subject matter of this report is the analysis of the electricity markets’ actors’ scene, through the identification of actor classes and the characterisation of actors from a behavioural and an operational perspective. The technoeconomic characterization of market participants aims to support the upcoming model enhancements by aligning the agent-based model improvements with the modern market design challenges and the contemporary characteristics of players. This work has been conducted in the context of task T3.2, which focuses on the factorization of the distinctive operational and behavioural characteristics of players in market structures. Traditional parties have been considered together with new and emerging roles, while special focus has been given on new actors related to flexible technologies and demand-side response. Among the main objectives have been the characterization of individual behaviours, objectives and requirements of different electricity market players, considering both the traditional entities and the new distributed ones, and the detailed representation of the new actors.N/

When energy trading meets blockchain in electrical power system: The state of the art

With the rapid growth of renewable energy resources, energy trading has been shifting from the centralized manner to distributed manner. Blockchain, as a distributed public ledger technology, has been widely adopted in the design of new energy trading schemes. However, there are many challenging issues in blockchain-based energy trading, e.g., low efficiency, high transaction cost, and security and privacy issues. To tackle these challenges, many solutions have been proposed. In this survey, the blockchain-based energy trading in the electrical power system is thoroughly investigated. Firstly, the challenges in blockchain-based energy trading are identified and summarized. Then, the existing energy trading schemes are studied and classified into three categories based on their main focuses: energy transaction, consensus mechanism, and system optimization. Blockchain-based energy trading has been a popular research topic, new blockchain architectures, models and products are continually emerging to overcome the limitations of existing solutions, forming a virtuous circle. The internal combination of different blockchain types and the combination of blockchain with other technologies improve the blockchain-based energy trading system to better satisfy the practical requirements of modern power systems. However, there are still some problems to be solved, for example, the lack of regulatory system, environmental challenges and so on. In the future, we will strive for a better optimized structure and establish a comprehensive security assessment model for blockchain-based energy trading system.This research was funded by Beijing Natural Science Foundation (grant number 4182060).Scopu

Discussion on drivers and proposition of approaches to support the transition of traditional electricity consumers to prosumers

In recent years, traditional power systems have undergone a significant transition, mainly related to the massive penetration of Renewable Energy Sources (RES). More specifically, the transformation of residential consumers into prosumers has been challenging to the traditional operation of electricity markets. This transition brings new challenges and opportunities to the power system, leading to new Business Model (BM). One widely discussed change is related to a consumer-centric or prosumer-driven approach, promoting increased participation of small consumers in power systems. The present thesis aims at discussing the recent BMs as enablers of the increasing prosumers’ role in the energy market and power system worldwide, deepening the discussion with a holistic view of the Brazilian context. To do so, it defines the main features of prosumers and their general related regulation as well as possible market designs within power systems. Moreover, the work intends to contribute to the knowledge, identification and understanding of the main regulatory barriers and enablers for the development of those BMs in the Brazilian energy market. In addition, it discusses enabling technologies to properly create the conditions that sustain new prosumer-driven markets. Then, it presents a comprehensive review of existing and innovative BMs and a discussion on their future roles in modern power systems and, in the Brazilian regulatory framework seeking to guide the decisions for the country to develop its political and regulatory environment in the future. Moreover, a set of recommendations for promoting these BMs in the power system worldwide is provided along with policy recommendations to promote prosumers aggregation in the Brazilian energy sector. An important conclusion is that, even though economically possible, not all innovative BMs can spread around the world due to regulatory issues. Seeking to further explore one of the prosumer-driven approaches presented and the challenges imposed by this innovative BM, a study of energy and reserve markets based on the Peer-to-Peer (P2P) structure is carried out. This structure is very promising for the prosumers’ promotion but presents some challenges for the network operation. A critical challenge is to ensure that network constraints are not violated due to energy trades between peers and neither due to the use of reserve capacity. Therefore, two methodologies are proposed. First, is proposed a three-step approach (P2PTDF), using Topological Distribution Factors (TDF) to penalize peers responsible for violations that may occur in the network constraints, ensuring a feasible solution. Second, it is proposed a new integrated prosumers-DSO approach applied in P2P energy and reserve tradings that also ensures the feasibility of both energy and reserve transactions under network constraints. The proposed approach includes the estimation of reserve requirements based on the RES uncertain behavior from historical generation data, which allows identifying RES patterns. The proposed models are assessed through a case study that uses a 14-bus system, under the technical and economic criteria. The results show that the approaches can ensure a feasible network operation.Nos últimos anos, os sistemas tradicionais de energia passaram por uma transição significativa, principalmente relacionada à penetração massiva de fontes de energia renováveis (do inglês, Renewable energy sources-RES). Mais especificamente, a transformação de consumidores residenciais em prosumidores tem desafiado a atual operação do mercado de energia elétrica. Essa transição traz novos desafios e oportunidades para o sistema elétrico, levando a novos modelos de negócios (do inglês, Business Models-BM). Uma mudança amplamente discutida está relacionada a uma abordagem centrada no consumidor ou direcionada ao prossumidor, promovendo maior participação de pequenos consumidores nos sistemas de energia. A presente tese tem como objetivo discutir os recentes BMs como facilitadores do crescente papel dos prosumidores no mercado de energia e no sistema elétrico mundial, aprofundando a discussão com uma visão holística do contexto brasileiro. Para tanto, define as principais características dos prosumidores e sua regulamentação geral relacionada, bem como possíveis designs de mercado dentro dos sistemas de energia. Além disso, o trabalho pretende contribuir para o conhecimento, identificação e compreensão das principais barreiras regulatórias e facilitadoras para o desenvolvimento desses BMs no mercado brasileiro de energia. Assim como, discutir as tecnologias importantes para criar adequadamente as condições que sustentam novos mercados orientados ao consumidor final. Em seguida, apresenta uma revisão abrangente dos BMs existentes e inovadores e uma discussão sobre seus papéis futuros nos sistemas de energia modernos e, no quadro regulatório brasileiro, buscando orientar as decisões para que o país desenvolva seu ambiente político e regulatório no futuro. Além disso, um conjunto de recomendações para promover esses BMs no sistema de energia em todo o mundo é fornecido juntamente com recomendações de políticas para promover a agregação de prosumidores no setor de energia brasileiro. Uma conclusão importante é que, mesmo sendo economicamente possível, nem todos os BMs inovadores podem se espalhar pelo mundo devido a obstáculos regulatórias. Buscando explorar ainda mais uma das abordagens orientadas ao prosumidor apresentadas e os desafios impostos por este BM inovador, é realizado um estudo dos mercados de energia e de reserva com base na estrutura ponto a ponto (do inglês, peer-to-peer-P2P). Esta estrutura é muito promissora para a promoção dos prosumidores mas apresenta alguns desafios para o funcionamento da rede. Um desafio crítico é garantir que as restrições da rede não sejam violadas devido a negociações de energia entre pares e nem devido ao uso da capacidade de reserva. Portanto, duas metodologias são propostas. Primeiramente, é proposta uma abordagem em três passos (P2PTDF), utilizando Fatores de Distribuição Topológica (do inglês, Topological Distribution Factors-TDF ) para penalizar os peers responsáveis por violações que possam ocorrer nas restrições da rede, garantindo uma solução viável. Em segundo lugar, é proposta uma nova abordagem integrada de prosumidores-DSO aplicada em transações P2P de energia e reserva que também garante a viabilidade de transações de energia e reserva sob restrições de rede. A abordagem proposta inclui a estimativa dos requisitos de reserva com base no comportamento incerto da RES a partir de dados históricos de geração, o que permite identificar padrões de RES. Os modelos propostos são avaliados através de um estudo de caso que utiliza um sistema de 14 barras, sob os critérios técnico e econômico. Os resultados mostram que as abordagens podem garantir uma operação de rede viável abrangendo energia e mercados de reserva