20 research outputs found
Multilingual Nonce Dependency Treebanks: Understanding how LLMs represent and process syntactic structure
We introduce SPUD (Semantically Perturbed Universal Dependencies), a
framework for creating nonce treebanks for the multilingual Universal
Dependencies (UD) corpora. SPUD data satisfies syntactic argument structure,
provides syntactic annotations, and ensures grammaticality via
language-specific rules. We create nonce data in Arabic, English, French,
German, and Russian, and demonstrate two use cases of SPUD treebanks. First, we
investigate the effect of nonce data on word co-occurrence statistics, as
measured by perplexity scores of autoregressive (ALM) and masked language
models (MLM). We find that ALM scores are significantly more affected by nonce
data than MLM scores. Second, we show how nonce data affects the performance of
syntactic dependency probes. We replicate the findings of M\"uller-Eberstein et
al. (2022) on nonce test data and show that the performance declines on both
MLMs and ALMs wrt. original test data. However, a majority of the performance
is kept, suggesting that the probe indeed learns syntax independently from
semantics.Comment: Our software is available at https://github.com/davidarps/spu
Microgrid energy management and monitoring systems: A comprehensive review
Microgrid (MG) technologies offer users attractive characteristics such as enhanced power quality, stability, sustainability, and environmentally friendly energy through a control and Energy Management System (EMS). Microgrids are enabled by integrating such distributed energy sources into the utility grid. The microgrid concept is proposed to create a self-contained system composed of distributed energy resources capable of operating in an isolated mode during grid disruptions. With the Internet of Things (IoT) daily technological advancements and updates, intelligent microgrids, the critical components of the future smart grid, are integrating an increasing number of IoT architectures and technologies for applications aimed at developing, controlling, monitoring, and protecting microgrids. Microgrids are composed of various distributed generators (DG), which may include renewable and non-renewable energy sources. As a result, a proper control strategy and monitoring system must guarantee that MG power is transferred efficiently to sensitive loads and the primary grid. This paper evaluates MG control strategies in detail and classifies them according to their level of protection, energy conversion, integration, benefits, and drawbacks. This paper also shows the role of the IoT and monitoring systems for energy management and data analysis in the microgrid. Additionally, this analysis highlights numerous elements, obstacles, and issues regarding the long-term development of MG control technologies in next-generation intelligent grid applications. This paper can be used as a reference for all new microgrid energy management and monitoring research