Two-Layer Load Balancing for Onedata System

The recent years have significantly changed the perception of web services and data storages, as clouds became a big part of IT market. New challenges appear in the field of scalable web systems, which become bigger and more complex. One of them is designing load balancing algorithms that could allow for optimal utilization of servers' resources in large, distributed systems. This paper presents an algorithm called Two-Level Load Balancing, which has been implemented and evaluated in onedata - a global data access system. A study of onedata architecture, request types and use cases has been performed to determine the requirements of load balancing set by similar, highly scalable distributed systems. The algorithm was designed to match these requirements, and it was achieved by using a synergy of DNS and internal dispatcher load balancing. Test results show that the algorithm does not introduce considerable overheads and maintains the performance of the system on high level, even in cases when its servers are not equally loaded

Policy-based SLA storage management model for distributed data storage services

There is  high demand for storage related services supporting scientists in their research activities. Those services are expected to provide not only capacity but also features allowing for more flexible and cost efficient usage. Such features include easy multiplatform data access, long term data retention, support for performance and cost differentiating of SLA restricted data access. The paper presents a policy-based SLA storage management model for distributed data storage services. The model allows for automated management of distributed data aimed at QoS provisioning with no strict resource reservation. The problem of providing  users with the required QoS requirements is complex, and therefore the model implements heuristic approach  for solving it. The corresponding system architecture, metrics and methods for SLA focused storage management are developed and tested in a real, nationwide environment

Using Redis supported by NVRAM in HPC applications

Nowadays, the efficiency of a storage systems is a bottleneck in many moern HPC clusters. High performance in traditional approach – processing using files – is often difficult to obtain because of model complexity and its read/write patterns. Alternative approach is applying a key-value database, which usually has low latency and scales well. On the other hand, many key-value stores suffer from limitation of memory capacity and vulnerability to serious faiures, which is caused by processing in RAM. Moreover, some research suggests, that scientific data models are not applicable to storage structures of key-value databases. In this paper, the author proposes resolving mentioned issues by replacing RAM with NVRAM. Practical example is based on Redis NoSQL. The article contains also a three domain specific APIs, that show the idea bhind transformation from HPC data model to Redis structures, as well as two micro-benchmarks results

Voltage Stability and Reactive Power Provision in a Decentralizing Energy System: A Techno-economic Analysis

Electricity grids require the ancillary services frequency control, grid operation, re-establishment of supply and voltage stability for a proper operation. Historically, conventional power plants in the transmission grid were the main source providing these services. An increasing share of decentralized renewable energy in the electricity mix causes decreasing dispatch times for conventional power plants and may consequently lead to a partial replacement of these technologies. Decentralized energy sources are technically capable of providing ancillary services. This work focuses on the provision of reactive power for voltage stability from decentralized sources. The aim is to answer the question of how voltage stability and reactive power management can be achieved in a future electricity system with increasing shares of decentralized renewable energy sources in an economical and efficient way. A methodology that takes reactive power and voltage stability in an electricity system into account is developed. It allows for the evaluation of the economic benefits of different reactive power supply options. A non-linear and a linearized techno-economic grid model are formulated for this purpose. The analysis reveals an increasing importance of reactive power from the distribution grid in future development scenarios, in particular if delays in grid extension are taken into account. The bottom-up assessment indicates a savings potential of up to 40 mio. EUR per year if reactive power sources in the distribution grid provide reactive power in a controlled manner. Although these savings constitute only a small portion of the total cost of the electricity system, reactive power from decentralized energy sources contributes to the change towards a system based on renewable energy sources. A comparison of different reactive power remuneration mechanisms shows that a variety of approaches exist that could replace the inflexible mechanisms of obligatory provision and penalized consumption of reactive power that are mostly in place nowadays