Adaptive Load Balancing: A Study in Multi-Agent Learning

We study the process of multi-agent reinforcement learning in the context of load balancing in a distributed system, without use of either central coordination or explicit communication. We first define a precise framework in which to study adaptive load balancing, important features of which are its stochastic nature and the purely local information available to individual agents. Given this framework, we show illuminating results on the interplay between basic adaptive behavior parameters and their effect on system efficiency. We then investigate the properties of adaptive load balancing in heterogeneous populations, and address the issue of exploration vs. exploitation in that context. Finally, we show that naive use of communication may not improve, and might even harm system efficiency.Comment: See http://www.jair.org/ for any accompanying file

Estimation and detection of transmission line characteristics in the copper access network

The copper access-network operators face the challenge of developing and maintaining cost-effective digital subscriber line (DSL) services that are competitive to other broadband access technologies. The way forward is dictated by the demand of ever increasing data rates on the twisted-pair copper lines. To meet this demand, a relocation of the DSL transceivers in cabinets closer to the customers are often necessary combined with a joint expansion of the accompanying optical-fiber backhaul network. The equipment of the next generation copper network are therefore becoming more scattered and geographically distributed, which increases the requirements of automated line qualification with fault detection and localization. This scenario is addressed in the first five papers of this dissertation where the focus is on estimation and detection of transmission line characteristics in the copper access network. The developed methods apply model-based optimization with an emphasis on using low-order modeling and a priori information of the given problem. More specifically, in Paper I a low-order and causal cable model is derived based on the Hilbert transform. This model is successfully applied in three contributions of this dissertation. In Paper II, a class of low-complexity unbiased estimators for the frequency-dependent characteristic impedance is presented that uses one-port measurements only. The so obtained characteristic impedance paves the way for enhanced time domain reflectometry (a.k.a. TDR) on twisted-pair lines. In Paper III, the problem of estimating a nonhomogeneous and dispersive transmission line is investigated and a space-frequency optimization approach is developed for the DSL application. The accompanying analysis shows which parameters are of interest to estimate and further suggests the introduction of the concept capacitive length that overcomes the necessity of a priori knowledge of the physical line length. In Paper IV, two methods are developed for detection and localization of load coils present in so-called loaded lines. In Paper V, line topology identification is addressed with varying degree of a priori information. In doing so, a model-based optimization approach is employed that utilizes multi-objective evolutionary computation based on one/two-port measurements. A complement to transceiver relocation that potentially enhances the total data throughput in the copper access network is dynamic spectrum management (DSM). This promising multi-user transmission technique aims at maximizing the transmission rates, and/or minimizing the power consumption, by mitigating or cancelling the dominating crosstalk interference between twisted-pair lines in the same cable binder. Hence the spectral utilization is improved by optimizing the transmit signals in order to minimize the crosstalk interference. However, such techniques rely on accurate information of the (usually) unknown crosstalk channels. This issue is the main focus of Paper VI and VII of this dissertation in which Paper VI deals with estimation of the crosstalk channels between twisted-pair lines. More specifically, an unbiased estimator for the square-magnitude of the crosstalk channels is derived from which a practical procedure is developed that can be implemented with standardized DSL modems already installed in the copper access network. In Paper VII the impact such a non-ideal estimator has on the performance of DSM is analyzed and simulated. Finally, in Paper VIII a novel echo cancellation algorithm for DMT-based DSL modems is presented

Contributions on DC microgrid supervision and control strategies for efficiency optimization through battery modeling, management, and balancing techniques

Aquesta tesi presenta equips, models i estratègies de control que han estat desenvolupats amb l'objectiu final de millorar el funcionament d'una microxarxa CC. Es proposen dues estratègies de control per a millorar l'eficiència dels convertidors CC-CC que interconnecten les unitats de potència de la microxarxa amb el bus CC. La primera estratègia, Control d'Optimització de Tensió de Bus centralitzat, administra la potència del Sistema d'Emmagatzematge d'Energia en Bateries de la microxarxa per aconseguir que la tensió del bus segueixi la referència dinàmica de tensió òptima que minimitza les pèrdues dels convertidors. La segona, Optimització en Temps Real de la Freqüència de Commutació, consisteix a operar localment cada convertidor a la seva freqüència de commutació òptima, minimitzant les seves pèrdues. A més, es proposa una nova topologia d'equilibrador actiu de bateries mitjançant un únic convertidor CC-CC i s'ha dissenyat la seva estratègia de control. El convertidor CC-CC transfereix càrrega cel·la a cel·la, emprant encaminament de potència a través d'un sistema d'interruptors controlats. L'estratègia de control de l'equalitzador aconsegueix un ràpid equilibrat del SOC evitant sobrecompensar el desequilibri. Finalment, es proposa un model simple de degradació d'una cel·la NMC amb elèctrode negatiu de grafit. El model combina la simplicitat d'un model de circuit equivalent, que explica la dinàmica ràpida de la cel·la, amb un model físic del creixement de la capa Interfase Sòlid-Electròlit (SEI), que prediu la pèrdua de capacitat i l'augment de la resistència interna a llarg termini. El model proposat quantifica la incorporació de liti al rang de liti ciclable necessària per a aconseguir els límits de OCV després de la pèrdua de liti ciclable en la reacció secundària. El model de degradació SEI pot emprar-se per a realitzar un control predictiu de bateries orientat a estendre la seva vida útil.Aquesta tesi presenta equips, models i estratègies de control que han estat desenvolupats amb l'objectiu final de millorar el funcionament d'una microxarxa CC. Es proposen dues estratègies de control per a millorar l'eficiència dels convertidors CC-CC que interconnecten les unitats de potència de la microxarxa amb el bus CC. La primera estratègia, Control d'Optimització de Tensió de Bus centralitzat, administra la potència del Sistema d'Emmagatzematge d'Energia en Bateries de la microxarxa per aconseguir que la tensió del bus segueixi la referència dinàmica de tensió òptima que minimitza les pèrdues dels convertidors. La segona, Optimització en Temps Real de la Freqüència de Commutació, consisteix a operar localment cada convertidor a la seva freqüència de commutació òptima, minimitzant les seves pèrdues. A més, es proposa una nova topologia d'equilibrador actiu de bateries mitjançant un únic convertidor CC-CC i s'ha dissenyat la seva estratègia de control. El convertidor CC-CC transfereix càrrega cel·la a cel·la, emprant encaminament de potència a través d'un sistema d'interruptors controlats. L'estratègia de control de l'equalitzador aconsegueix un ràpid equilibrat del SOC evitant sobrecompensar el desequilibri. Finalment, es proposa un model simple de degradació d'una cel·la NMC amb elèctrode negatiu de grafit. El model combina la simplicitat d'un model de circuit equivalent, que explica la dinàmica ràpida de la cel·la, amb un model físic del creixement de la capa Interfase Sòlid-Electròlit (SEI), que prediu la pèrdua de capacitat i l'augment de la resistència interna a llarg termini. El model proposat quantifica la incorporació de liti al rang de liti ciclable necessària per a aconseguir els límits de OCV després de la pèrdua de liti ciclable en la reacció secundària. El model de degradació SEI pot emprar-se per a realitzar un control predictiu de bateries orientat a estendre la seva vida útil.This dissertation presents a set of equipment, models and control strategies, that have been developed with the final goal of improving the operation of a DC microgrid. Two control strategies are proposed to improve the efficiency of the DC-DC converters that interface the microgrid’s power units with the DC bus. The first strategy is centralized Bus Voltage Optimization Control, which manages the power of the microgrid’s Battery Energy Storage System to make the bus voltage follow the optimum voltage dynamic reference that minimizes the converters’ losses. The second control strategy is Online Optimization of Switching Frequency, which consists in locally operating each converter at its optimum switching frequency, again minimizing power losses. The two proposed optimization strategies have been validated in simulations. Moreover, a new converter-based active balancing topology has been proposed and its control strategy has been designed. This equalizer topology consists of a single DC-DC converter that performs cell-to-cell charge transfer employing power routing via controlled switches. The control strategy of the equalizer has been designed to achieve rapid SOC balancing while avoiding imbalance overcompensation. Its performance has been validated in simulation. Finally, a simple degradation model of an NMC battery cell with graphite negative electrode is proposed. The model combines the simplicity of an equivalent circuit model, which explains the fast dynamics of the cell, with a physical model of the Solid-Electrolyte Interphase (SEI) layer growth process, which predicts the capacity loss and the internal resistance rise in the long term. The proposed model fine-tunes the capacity loss prediction by accounting for the incorporation of unused lithium reserves of both electrodes into the cyclable lithium range to reach the OCV limits after the side reaction has consumed cyclable lithium. The SEI degradation model can be used to perform predictive control of batteries oriented toward extending their lifetime

Technology for large space systems: A bibliography with indexes (supplement 10)

The bibliography lists 408 reports, articles and other documents introduced into the NASA scientific and technical information system to provide helpful information to the researcher, manager, and designer in technology development and mission design in the area of large space system technology. Subject matter is grouped according to systems, interactive analysis and design, structural and thermal analysis and design, structural concepts and control systems, electronics, advanced materials, assembly concepts, propulsion, and solar power satellite systems

Efficiency-based hp-refinement for finite element methods

Two efficiency-based grid refinement strategies are investigated for adaptive finite element solution of partial differential equations. In each refinement step, the elements are ordered in terms of decreasing local error, and the optimal fraction of elements to be refined is deter- mined based on e±ciency measures that take both error reduction and work into account. The goal is to reach a pre-specified bound on the global error with a minimal amount of work. Two efficiency measures are discussed, 'work times error' and 'accuracy per computational cost'. The resulting refinement strategies are first compared for a one-dimensional model problem that may have a singularity. Modified versions of the efficiency strategies are proposed for the singular case, and the resulting adaptive methods are compared with a threshold-based refinement strategy. Next, the efficiency strategies are applied to the case of hp-refinement for the one-dimensional model problem. The use of the efficiency-based refinement strategies is then explored for problems with spatial dimension greater than one. The work times error strategy is inefficient when the spatial dimension, d, is larger than the finite element order, p, but the accuracy per computational cost strategy provides an efficient refinement mechanism for any combination of d and p

Information Geometry

This Special Issue of the journal Entropy, titled “Information Geometry I”, contains a collection of 17 papers concerning the foundations and applications of information geometry. Based on a geometrical interpretation of probability, information geometry has become a rich mathematical field employing the methods of differential geometry. It has numerous applications to data science, physics, and neuroscience. Presenting original research, yet written in an accessible, tutorial style, this collection of papers will be useful for scientists who are new to the field, while providing an excellent reference for the more experienced researcher. Several papers are written by authorities in the field, and topics cover the foundations of information geometry, as well as applications to statistics, Bayesian inference, machine learning, complex systems, physics, and neuroscience