Modelling and analysing the impact of local flexibility on the business cases of electricity retailers

Demand side response are proposed to incentivise customers to shift their electricity usage from peak demand periods to off-peak demand periods and to curtail their electricity usage during peak demand periods, which show great potential to reduce the peak loads, electricity prices, customers’ bills and further stabilize the power systems. The investigation of this effect on the pricing strategies and the profits of electricity retailers has recently emerged as a highly interesting research area. However, the state-of-the-art, bi-level optimization modelling approach makes the unrealistic assumption that retailers treat wholesale market prices as exogenous, fixed parameters. On the other hand, distributed energy resources (DER) in electricity markets are proposed to bring the significant operating flexibility which can support system balancing and reduce demand peaks, thereby limiting the balancing costs of conventional generators and the investments costs of new generation and network assets. And, local energy markets (LEM) have recently attracted great interest as they enable effective coordination of small-scale DER at the customer side, and avoidance of distribution network reinforcements. However, the introduction of LEM has also significant implications on the strategic interactions between the customers and incumbent electricity retailers, which has not been explored. Furthermore, a specific demand response technology of electric vehicles (EV) exhibits the potential to support system balancing and limit demand peaks, thus improving significantly the cost-effectiveness of low-carbon electricity systems. And the effective pricing of EV charging by aggregators constitutes a key problem towards the realization of the significant EV flexibility potential in deregulated electricity systems and has been addressed by previous work through bi-level optimization formulations. However, the solution approach adopted in previous work cannot capture the discrete nature of the EV charging / discharging levels. Furthermore, aggregators suffering from communication and privacy limitations are hard to acquire the perfect knowledge of EV operating characteristics and traveling patterns. Given such a context, this thesis aims at addressing the above challenges and proposing strategic retail pricing-based energy response programs to study the interactions between the electricity retailer / aggregator and its served flexible customers / EV based on game theoretic modeling and learning based approaches. We conduct the research in three different application scenarios: 1) This thesis proposes a novel bi-level optimization problem which represents endogenously the wholesale market clearing process as an additional lower-level problem, thus capturing the realistic implications of a retailer’s pricing strategies and the resulting demand response on the wholesale market prices. This bi-level optimization problem is solved through converting it to a single-level Mathematical Programs with Equilibrium Constraints (MPEC). The scope of the examined case studies is threefold. First of all, they demonstrate the interactions between the retailer, the flexible consumers and the wholesale market and analyse the fundamental effects of the consumers’ time-shifting flexibility on the retailer’s revenue from the consumers, its cost in the wholesale market, and its overall profit. Furthermore, they analyse how these effects of demand flexibility depend on the retailer’s relative size in the market and the strictness of the regulatory framework. Finally, they highlight the added value of the proposed bi-level model by comparing its outcomes against the state-of-the-art bi-level modelling approach. 2) This thesis explores for the first time the interaction between electricity retailer and LEM by proposing a novel bi-level optimization problem, which captures the pricing decisions of a strategic retailer in the upper-level problem and the response of both independent customers and the LEM (both including flexible consumers, micro- generators and energy storages) in the lower-level problems. Since the lower-level problem representing the LEM is non-convex, a new analytical approach is employed for solving the developed bi-level optimization problem. The examined case studies demonstrate that the introduction of an LEM reduces the customers’ energy dependency on the retailer and limits the retailer’s strategic potential of exploiting the customers through large differentials between buy and sell prices. As a result, the profit of the retailer is significantly reduced while the customers, primarily the LEM participants and to a lower extent non-participating customer, achieve significant economic benefits. 3) This thesis proposes a reinforcement learning (RL) method that the EV aggregator gradually learns how to improve its pricing strategies by utilizing experiences acquired from its repeated interactions with the EV and the wholesale market. Although RL can tackle the challenge of imperfect information and MPEC reformulation, the state-of-the- art RL methods require discretization of state and / or action spaces and thus exhibit limitations in terms of solution optimality and computational requirements. This thesis proposes a novel deep reinforcement learning (DRL) method to solve the examined EV pricing problem, combining deep deterministic policy gradient (DDPG) principles with a prioritized experience replay (PER) strategy, and setting up the problem in multi-dimensional continuous state and action spaces. Case studies demonstrate that the proposed method outperforms state-of-the-art RL methods in terms of both solution optimality and computational requirements, and comprehensively analyze the economic impacts of smart-charging and vehicle-to-grid (V2G) flexibility on both aggregators and EV owners.Open Acces

N-(2,4-Dinitro­phen­yl)dehydro­abietyl­amine

In the crystal structure of the title compound, C26H33N3O4, there are two crystallographically independent mol­ecules. The two cyclohexane rings are trans-fused; the ring neighboring the phenyl group is in a half-chair conformation and the other is in a chair conformation. The two nitro groups and the benzene ring of the dinitro­phenyl group are almost coplanar. Intra­molecular N—H⋯O hydrogen bonds and weak inter­molecular C—H⋯O hydrogen bonds are observed

Review of Application of Surface Electromyography Signals in Muscle Fatigue Research

Muscle fatigue is a physiological phenomenon that occurs when muscles are overused or continuously loaded during exercise or labor. Currently, analyzing the fatigue mechanism is still a complex and multi-layered research problem. In recent years, research methods focusing on surface electromyographic (sEMG) signals have garnered significant attention. The application of advanced signal processing techniques and machine learning algorithms has enhanced the precision of interpreting surface electromyographic data, deepening our understanding of the mechanisms underlying muscle fatigue. This, in turn, provides crucial scientific support for improving athletic performance, preventing sports injuries, and enhancing rehabilitation treatments.This comprehensive review of muscle fatigue research based on surface electromyographic signals covers various aspects. First, the definition of muscle fatigue and currently commonly used detection methods are explained, and the characteristics and application scope of various methods are pointed out; Secondly, the EMG characteristics that characterize muscle fatigue are introduced in detail from linear characteristics such as time domain, frequency domain, time-frequency domain and the use of nonlinear parameters, and the advantages and limitations of these characteristics are also discussed; Thirdly, combining fatigue characteristics as input data, the classification algorithms commonly used for muscle fatigue are explored, and the applicable conditions, advantages and disadvantages of each algorithm are accurately summarized from the aspects of machine learning and deep learning algorithms; Finally, the challenges faced by muscle fatigue research at this stage are pointed out, and on the basis of proposing feasible solutions, the future research directions are prospected

Coordinated Electric Vehicle Active and Reactive Power Control for Active Distribution Networks

The deployment of renewable energy in power systems may raise serious voltage instabilities. Electric vehicles (EVs), owing to their mobility and flexibility characteristics, can provide various ancillary services including active and reactive power. However, the distributed control of EVs under such scenarios is a complex decision-making problem with enormous dynamics and uncertainties. Most existing literature employs model-based approaches to formulate the active and reactive power control problems, which require full models and are time-consuming. This paper proposes a multi-agent reinforcement learning method featuring actor-critic networks and a parameter sharing framework to solve the EVs coordinated active and reactive power control problem towards both demand-side response and voltage regulations. The proposed method can further enhance the learning stability and scalability with privacy perseverance via the location marginal prices. Simulation results based on a modified IEEE 15-bus network are developed to validate its effectiveness in providing system charging and voltage regulation services

Construction of a Vibrio alginolyticus hopPmaJ (hop) mutant and evaluation of its potential as a live attenuated vaccine in orange-spotted grouper (Epinephelus coioides)

Vibrio alginolyticus, a bacterial pathogen in fish and humans, expresses a type III secretion system (T3SS) that is critical for pathogen virulence and disease development. However, little is known about the associated effectors (T3SEs) and their physiological role. In this study, the T3SE gene hopPmaJ (hop) was cloned from V. alginolyticus wild-type strain HY9901 and the mutant strain HY9901Δhop was constructed by the in-frame deletion method. The results showed that the deduced amino acid sequence of V. alginolyticus HopPmaJ shared 78–98% homology with other Vibrio spp. In addition, the HY9901Δhop mutant showed an attenuated swarming phenotype and a 2600-fold decrease in the virulence to grouper. However, the HY9901Δhop mutant showed no difference in morphology, growth, biofilm formation and ECPase activity. Finally, grouper vaccinated via intraperitoneal (IP) injection with HY9901Δhop induced a high antibody titer with a relative percent survival (RPS) value of 84% after challenging with the wild-type HY9901. Real-time PCR assays showed that vaccination with HY9901Δhop enhanced the expression of immune-related genes, including MHC-Iα, MHC-IIα, IgM, and IL-1β after vaccination, indicating that it is able to induce humoral and cell-mediated immune response in grouper. These results demonstrate that the HY9901Δhop mutant could be used as an effective live vaccine to combat V. alginolyticus in grouper

Learning Knowledge-Enhanced Contextual Language Representations for Domain Natural Language Understanding

Knowledge-Enhanced Pre-trained Language Models (KEPLMs) improve the performance of various downstream NLP tasks by injecting knowledge facts from large-scale Knowledge Graphs (KGs). However, existing methods for pre-training KEPLMs with relational triples are difficult to be adapted to close domains due to the lack of sufficient domain graph semantics. In this paper, we propose a Knowledge-enhanced lANGuAge Representation learning framework for various clOsed dOmains (KANGAROO) via capturing the implicit graph structure among the entities. Specifically, since the entity coverage rates of closed-domain KGs can be relatively low and may exhibit the global sparsity phenomenon for knowledge injection, we consider not only the shallow relational representations of triples but also the hyperbolic embeddings of deep hierarchical entity-class structures for effective knowledge fusion.Moreover, as two closed-domain entities under the same entity-class often have locally dense neighbor subgraphs counted by max point biconnected component, we further propose a data augmentation strategy based on contrastive learning over subgraphs to construct hard negative samples of higher quality. It makes the underlying KELPMs better distinguish the semantics of these neighboring entities to further complement the global semantic sparsity. In the experiments, we evaluate KANGAROO over various knowledge-aware and general NLP tasks in both full and few-shot learning settings, outperforming various KEPLM training paradigms performance in closed-domains significantly.Comment: emnlp 202

Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach

The large-scale integration of distributed energy resources into the energy industry enables the fast transition to a decarbonized future but raises some potential challenges of insecure and unreliable operations. Multi-energy Microgrids (MEMGs), as localized small multi-energy systems, can effectively integrate a variety of energy components with multiple energy sectors, which have been recently recognized as a valid solution to improve the operational security and reliability. As a result, a massive amount of research has been conducted to investigate MEMG energy management problems, including both model-based optimization and model-free learning approaches. Compared to optimization approaches, reinforcement learning is being widely deployed in MEMG energy management problems owing to its ability to handle highly dynamic and stochastic processes without knowing any system knowledge. However, it is still difficult for conventional model-free reinforcement learning methods to capture the physical constraints of the MEMG model, which may therefore destroy its secure operation. To address this research challenge, this paper proposes a novel safe reinforcement learning method by learning a dynamic security assessment rule to abstract a physical-informed safety layer on top of the conventional model-free reinforcement learning energy management policy, which can respect all the physical constraints through mathematically solving an action correction formulation. In this setting, the secure energy management of the MEMG can be guaranteed for both training and test procedures. Extensive case studies based on two integrated systems (i.e., a small 6-bus power and 7-node gas network, and a large 33-bus power and 20-node gas network) are carried out to verify the superior performance of the proposed physical-informed reinforcement learning method in achieving a cost-effective MEMG energy management performance while respecting all the physical constraints, compared to conventional reinforcement learning and optimization approaches

Experimental Realization of a Quantum Refrigerator Driven by Indefinite Causal Orders

Indefinite causal order (ICO) is playing a key role in recent quantum technologies. Here, we experimentally study quantum thermodynamics driven by ICO on nuclear spins using the nuclear magnetic resonance system. We realize the ICO of two thermalizing channels to exhibit how the mechanism works, and show that the working substance can be non-classically cooled or heated albeit it undergoes thermal contacts with reservoirs of the same temperature. Moreover, we construct a single cycle of the ICO refrigerator, and evaluate its efficiency by measuring the work consumption and the heat energy extracted from the low-temperature reservoir. Unlike classical refrigerators in which the efficiency is perversely higher the closer the temperature of the high-temperature and low-temperature reservoirs are to each other, the ICO refrigerator's efficiency of performance is always bounded to small values due to the non-unit success probability in projecting the ancillary qubit to the preferable subspace. Our experiment demonstrates that the ICO process may offer a new resource with non-classical heat exchange, and paves the way towards construction of quantum refrigerators on a quantum system.Comment: 5 pages, 4 figure