Contextual Simulated Annealing Q-Learning for Pre-negotiation of Agent-Based Bilateral Negotiations

Electricity markets are complex environments, which have been suffering continuous transformations due to the increase of renewable based generation and the introduction of new players in the system. In this context, players are forced to re-think their behavior and learn how to act in this dynamic environment in order to get as much benefit as possible from market negotiations. This paper introduces a new learning model to enable players identifying the expected prices of future bilateral agreements, as a way to improve the decision-making process in deciding the opponent players to approach for actual negotiations. The proposed model introduces a con-textual dimension in the well-known Q-Learning algorithm, and includes a simulated annealing process to accelerate the convergence process. The proposed model is integrated in a multi-agent decision support system for electricity market players negotiations, enabling the experimentation of results using real data from the Iberian electricity market.This work has received funding from the European Union's Horizon 2020 research and innovation programme under project DOMINOES (grant agreement No 771066) and from FEDER Funds through COMPETE program and from National Funds through FCT under the project UID/EEA/00760/2019.info:eu-repo/semantics/publishedVersio

Comparing nuclear power trajectories in Germany and the UK: from ‘regimes' to ‘democracies’ in sociotechnical transitions and Discontinuities

This paper focuses on arguably the single most striking contrast in contemporary major energy politics in Europe (and even the developed world as a whole): the starkly differing civil nuclear policies of Germany and the UK. Germany is seeking entirely to phase out nuclear power by 2022. Yet the UK advocates a ‘nuclear renaissance’, promoting the most ambitious new nuclear construction programme in Western Europe.Here,this paper poses a simple yet quite fundamental question: what are the particular divergent conditions most strongly implicated in the contrasting developments in these two countries. With nuclear playing such an iconic role in historical discussions over technological continuity and transformation, answering this may assist in wider understandings of sociotechnical incumbency and discontinuity in the burgeoning field of‘sustainability transitions’. To this end, an ‘abductive’ approach is taken: deploying nine potentially relevant criteria for understanding the different directions pursued in Germany and the UK. Together constituted by 30 parameters spanning literatures related to socio-technical regimes in general as well as nuclear technology in particular, the criteria are divided into those that are ‘internal’ and ‘external’ to the ‘focal regime configuration’ of nuclear power and associated ‘challenger technologies’ like renewables. It is ‘internal’ criteria that are emphasised in conventional sociotechnical regime theory, with ‘external’ criteria relatively less well explored. Asking under each criterion whether attempted discontinuation of nuclear power would be more likely in Germany or the UK, a clear picture emerges. ‘Internal’ criteria suggest attempted nuclear discontinuation should be more likely in the UK than in Germany– the reverse of what is occurring. ‘External’ criteria are more aligned with observed dynamics –especially those relating to military nuclear commitments and broader ‘qualities of democracy’. Despite many differences of framing concerning exactly what constitutes ‘democracy’, a rich political science literature on this point is unanimous in characterising Germany more positively than the UK. Although based only on a single case,a potentially important question is nonetheless raised as to whether sociotechnical regime theory might usefully give greater attention to the general importance of various aspects of democracy in constituting conditions for significant technological discontinuities and transformations. If so, the policy implications are significant. A number of important areas are identified for future research, including the roles of diverse understandings and specific aspects of democracy and the particular relevance of military nuclear commitments– whose under-discussion in civil nuclear policy literatures raises its own questions of democratic accountability

Coordination or harmonisation? Feasible pathways for a European RES strategy beyond 2020

With Directive 2009/28/EC, the European Parliament and Council have laid the grounds for the policy framework for renewable energy sources (RES) in the European Union until 2020. The aim of this paper is to look more closely beyond 2020, well in advance, contrasting and analysing potential RES policy options that are currently being discussed. Generally the assessment includes RES in all energy sectors but a topical focus is put on renewable electricity, specifically within the discussion of policy options for a harmonisation of RES support. The results of the policy assessment indicate that cooperation and coordination among Member States appear beneficial to tackle current problems in RES markets, and fruitful for the period beyond 2020. By contrast, >simplistic approaches> to RES policy harmonisation, for example via a uniform RES certificate trading, are not suitable to ensure substantial future RES growth.Peer Reviewe