Automated Experiments for Deriving Performance-relevant Properties of Software Execution Environments

The execution environment can play a crucial role when analyzing the performance of a software system. However, detecting execution environment properties and integrating such properties into performance analyses is a manual, error-prone task. In this thesis, a novel approach for detecting performance-relevant properties of the software execution environment is presented. These properties are automatically detected using predefined experiments and integrated into performance prediction tools

Predicting software performance in symmetric multi-core and multiprocessor Environments

With today\u27s rise of multi-core processors, concurrency becomes a ubiquitous challenge in software development.Performance prediction methods have to reflect the influence of multiprocessing environments on software performance in order to help software architects to find potential performance problems during early development phases. In this thesis, we address the influence of the operating system scheduler on software performance in symmetric multiprocessing environments

Learning Queuing Networks by Recurrent Neural Networks

It is well known that building analytical performance models in practice is difficult because it requires a considerable degree of proficiency in the underlying mathematics. In this paper, we propose a machine-learning approach to derive performance models from data. We focus on queuing networks, and crucially exploit a deterministic approximation of their average dynamics in terms of a compact system of ordinary differential equations. We encode these equations into a recurrent neural network whose weights can be directly related to model parameters. This allows for an interpretable structure of the neural network, which can be trained from system measurements to yield a white-box parameterized model that can be used for prediction purposes such as what-if analyses and capacity planning. Using synthetic models as well as a real case study of a load-balancing system, we show the effectiveness of our technique in yielding models with high predictive power

Control Architecture Modeling for Future Power Systems

Uncontrollable power generation, distributed energy resources, controllable demand, etc. are fundamental aspects of energy systems largely based on renewable energy supply. These technologies have in common that they contradict the conventional categories of electric power system operation. As their introduction has proceeded incrementally in the past, operation strategies of the power system could be adapted. For example much more wind power could be integrated than originally anticipated, largely due to the flexibility reserves already present in the power system, and the possibility of interregional electricity exchange. However, at the same time, it seems that the overall system design cannot keep up by simply adapting in response to changes, but that also new strategies have to be designed in anticipation. Changes to the electricity markets have been suggested to adapt to the limited predictability of wind power, and several new control strategies have been proposed, in particular to enable the control of distributed energy resources, including for example, distributed generation or electric vehicles. Market designs addressing the procurement of balancing resources are highly dependent on the operation strategies specifying the resource requirements. How should one decide which control strategy and market configuration is best for a future power system? Most research up to this point has addressed single isolated aspects of this design problem. Those of the ideas that fit with current markets and operation concepts are lucky; they can be evaluated on the present design. But how could they be evaluated on a potential future power system? Approaches are required that support the design and evaluation of power system operation and control in context of future energy scenarios. This work addresses this challenge, not by providing a universal solution, but by providing basic modeling methodology that enables better problem formulation and by suggesting an approach to addressing the general chicken/egg problem of planning and re-design of system operation and control. The dissertation first focuses on the development of models, diagrams, that support the conceptual design of control and operation strategies, where a central theme is the focus on modeling system goals and functions rather than system structure. The perspective is then shifted toward long-term energy scenarios and adaptation of power system operation, considering the integration of energy scenario models with the re-design of operation strategies. The main contributions in the first part are, firstly, by adaptation of an existing functional modeling approach called Multilevel Flow Modeling (MFM) to the power systems domain, identifying the means-ends composition of control levels and development of principles for the consistent modeling of control structures, a formalization of control-as-a-service; secondly, the formal mapping of fluctuating and controllable resources to a multi-scale and multi-stage representation of control and operation structures; and finally the application to some concrete study cases, including a present system balancing, and proposed control structures such as Microgrids and Cells. In the second part, the main contributions are the outline of a formation strategy, integrating the design and model-based evaluation of future power system operation concepts with iterative energy scenario development. Finally, a new modeling framework for development and evaluation of power system operation in context of energy-storage based power system balancing is introduced.<br/

Automated Experiments for Deriving Performance-relevant Properties of Software Execution Environments

The software execution environment can play a crucial role when analyzing the performance of a software system. In this book, a novel approach for the automated detection of performance-relevant properties of the execution environment is presented. The properties are detected using predefined experiments and integrated into performance prediction tools. The approach is applied to experiments for detecting different CPU, OS, and virtualization properties, and validated in different case studies

Experimental analysis of computer system dependability

This paper reviews an area which has evolved over the past 15 years: experimental analysis of computer system dependability. Methodologies and advances are discussed for three basic approaches used in the area: simulated fault injection, physical fault injection, and measurement-based analysis. The three approaches are suited, respectively, to dependability evaluation in the three phases of a system's life: design phase, prototype phase, and operational phase. Before the discussion of these phases, several statistical techniques used in the area are introduced. For each phase, a classification of research methods or study topics is outlined, followed by discussion of these methods or topics as well as representative studies. The statistical techniques introduced include the estimation of parameters and confidence intervals, probability distribution characterization, and several multivariate analysis methods. Importance sampling, a statistical technique used to accelerate Monte Carlo simulation, is also introduced. The discussion of simulated fault injection covers electrical-level, logic-level, and function-level fault injection methods as well as representative simulation environments such as FOCUS and DEPEND. The discussion of physical fault injection covers hardware, software, and radiation fault injection methods as well as several software and hybrid tools including FIAT, FERARI, HYBRID, and FINE. The discussion of measurement-based analysis covers measurement and data processing techniques, basic error characterization, dependency analysis, Markov reward modeling, software-dependability, and fault diagnosis. The discussion involves several important issues studies in the area, including fault models, fast simulation techniques, workload/failure dependency, correlated failures, and software fault tolerance