VM-MAD: a cloud/cluster software for service-oriented academic environments

The availability of powerful computing hardware in IaaS clouds makes cloud computing attractive also for computational workloads that were up to now almost exclusively run on HPC clusters. In this paper we present the VM-MAD Orchestrator software: an open source framework for cloudbursting Linux-based HPC clusters into IaaS clouds but also computational grids. The Orchestrator is completely modular, allowing flexible configurations of cloudbursting policies. It can be used with any batch system or cloud infrastructure, dynamically extending the cluster when needed. A distinctive feature of our framework is that the policies can be tested and tuned in a simulation mode based on historical or synthetic cluster accounting data. In the paper we also describe how the VM-MAD Orchestrator was used in a production environment at the FGCZ to speed up the analysis of mass spectrometry-based protein data by cloudbursting to the Amazon EC2. The advantages of this hybrid system are shown with a large evaluation run using about hundred large EC2 nodes.Comment: 16 pages, 5 figures. Accepted at the International Supercomputing Conference ISC13, June 17--20 Leipzig, German

A simulator for the control network of smart grid architectures

C

Lessons Learned from a Decade of Providing Interactive, On-Demand High Performance Computing to Scientists and Engineers

For decades, the use of HPC systems was limited to those in the physical sciences who had mastered their domain in conjunction with a deep understanding of HPC architectures and algorithms. During these same decades, consumer computing device advances produced tablets and smartphones that allow millions of children to interactively develop and share code projects across the globe. As the HPC community faces the challenges associated with guiding researchers from disciplines using high productivity interactive tools to effective use of HPC systems, it seems appropriate to revisit the assumptions surrounding the necessary skills required for access to large computational systems. For over a decade, MIT Lincoln Laboratory has been supporting interactive, on-demand high performance computing by seamlessly integrating familiar high productivity tools to provide users with an increased number of design turns, rapid prototyping capability, and faster time to insight. In this paper, we discuss the lessons learned while supporting interactive, on-demand high performance computing from the perspectives of the users and the team supporting the users and the system. Building on these lessons, we present an overview of current needs and the technical solutions we are building to lower the barrier to entry for new users from the humanities, social, and biological sciences.Comment: 15 pages, 3 figures, First Workshop on Interactive High Performance Computing (WIHPC) 2018 held in conjunction with ISC High Performance 2018 in Frankfurt, German

Residential distributed generation : decision support software to evaluate opportunities in the residential market : a thesis submitted in partial fulfilment of the requirement for the degree of Masters of Engineering at Massey University, Palmerston North, New Zealand /

The residential market in New Zealand consumes a significant proportion of our electricity production and is one of the fastest growing sectors. As a vertically integrated generator retailer in the New Zealand electricity industry, Meridian Energy Ltd is concerned at retaining and growing their customer base. They recognise that utilisation of emerging distributed generation [DG] technologies can provide a competitive advantage in the market place. A decision tool was developed to help Meridian identify opportunities within the residential market for applications of DG. The model compares the cost to serve a household's energy needs using a business as usual case with a DG case on an annual basis for a single household or a neighbourhood. A modular approach was used for ease of development and to enable future enhancements. The main modules were: load profile development, DG technology, operation control, costing and a calculation engine. The load profile module estimated space heating/cooling, water heating and other electrical loads for each 30 minute period for 8 representative days of a year based on national end-use statistics and a set of 40 reference profiles. A Gamma distribution was used to simulate diversity between houses. The calculation engine computed the amount of demand that could be met by the DG technologies and hence the residual demand or surplus for export. The pricing module estimated the annual cost including aspects such as: capital cost, fuel cost, maintenance, value of export and cost of import. The technology modules allowed different DG technologies, as well as a range of parameters to be selected. It included renewable energy resource modelling. The performance module allowed different operation control of the heat engine technologies including: base load, electrical peaking, heat peaking, load following (heat-led) and load following(electricity-led). The model was implemented using Microsoft Visual Basic for Applications, in Excel. A series of user-forms were developed to enable the model to be run with a minimum of user input. Three case studies were undertaken. In the first, five technology types were modelled, with the heat pump and Stirling engine looking the most promising. The second case study involved these two technologies in a Christchurch urban area study. A hypothetical network analysis showed the benefit that these technologies could have in reducing peak loading on the network. The third case study examined the sensitivity of the results to the value of specific variables. Load size and capital cost had the strongest influence on NPV

Smart Solutions: Smart Grid Demokit

Treball desenvolupat dins el marc del programa 'European Project Semester'.The purpose of this report is to justify the design choices of the smart grid demo kit. Something had to be designed to make a smart grid clear for people who have little knowledge about smart grids. The product had to be appealing and clear for people to understand. And eventually should be usable, for example, on an information market. The first part of the research consisted of looking how to shape the whole system. How the 'tiles' had to look to be interactive for users and what they should feature. One part of this was doing research to get to know more about the already existing knowledge amount users. Another research investigated what appeals the most to the users. After this, a concept was created in compliance with the group and the client. The concept consists of hexagonal tiles, each with a different function: houses, solar panels, wind turbines, factories and energy storages. These tiles are all different parts of a smart grid. When combining these tiles, it can be made clear to users how smart grids work. The tiles are fabricated using a combination of 3D printing and laser cutting. The tiles have laser cut symbols on top of them to show what part of the smart grid they are. Digital LED strips are on top of the tiles to show the direction of the energy flow, and the colors indicate if the tile is producing or consuming power from the grid. The tiles are connected to each other by the so called “grid blocks”. These blocks make up the central power grid and are also lighting up by LED strips. Each tile is equipped with a microcontroller which controls the LED strips and makes it possible for the different tiles to “talk” with each other. Using this, the central tile knows which tiles are connected to the system. The central tile controls all tiles and runs the simulation of the smart grid. For further development of the project, it can be investigated how to control and adjust the system from an external system, for example by a tablet. The final product consists of five tiles connected by seven grid blocks which show how a smart grid works