Service workload patterns for QoS-driven cloud resource management

Cloud service providers negotiate SLAs for customer services they offer based on the reliability of performance and availability of their lower-level platform infrastructure. While availability management is more mature, performance management is less reliable. In order to support a continuous approach that supports the initial static infrastructure configuration as well as dynamic reconfiguration and auto-scaling, an accurate and efficient solution is required. We propose a prediction technique that combines a workload pattern mining approach with a traditional collaborative filtering solution to meet the accuracy and efficiency requirements. Service workload patterns abstract common infrastructure workloads from monitoring logs and act as a part of a first-stage high-performant configuration mechanism before more complex traditional methods are considered. This enhances current reactive rule-based scalability approaches and basic prediction techniques by a hybrid prediction solution. Uncertainty and noise are additional challenges that emerge in multi-layered, often federated cloud architectures. We specifically add log smoothing combined with a fuzzy logic approach to make the prediction solution more robust in the context of these challenges

Wavelet Shrinkage Based Image Denoising using Soft Computing

Noise reduction is an open problem and has received considerable attention in the literature for several decades. Over the last two decades, wavelet based methods have been applied to the problem of noise reduction and have been shown to outperform the traditional Wiener filter, Median filter, and modified Lee filter in terms of root mean squared error (MSE), peak signal noise ratio (PSNR) and other evaluation methods. In this research, two approaches for the development of high performance algorithms for de-noising are proposed, both based on soft computing tools, such as fuzzy logic, neural networks, and genetic algorithms. First, an improved additive noise reduction method for digital grey scale nature images, which uses an interval type-2 fuzzy logic system to shrink wavelet coefficients, is proposed. This method is an extension of a recently published approach for additive noise reduction using a type-1 fuzzy logic system based wavelet shrinkage. Unlike the type-1 fuzzy logic system based wavelet shrinkage method, the proposed approach employs a thresholding filter to adjust the wavelet coefficients according to the linguistic uncertainty in neighborhood values, inter-scale dependencies and intra-scale correlations of wavelet coefficients at different resolutions by exploiting the interval type-2 fuzzy set theory. Experimental results show that the proposed approach can efficiently and rapidly remove additive noise from digital grey scale images. Objective analysis and visual observations show that the proposed approach outperforms current fuzzy non-wavelet methods and fuzzy wavelet based methods, and is comparable with some recent but more complex wavelet methods, such as Hidden Markov Model based additive noise de-noising method. The main differences between the proposed approach and other wavelet shrinkage based approaches and the main improvements of the proposed approach are also illustrated in this thesis. Second, another improved method of additive noise reduction is also proposed. The method is based on fusing the results of different filters using a Fuzzy Neural Network (FNN). The proposed method combines the advantages of these filters and has outstanding ability of smoothing out additive noise while preserving details of an image (e.g. edges and lines) effectively. A Genetic Algorithm (GA) is applied to choose the optimal parameters of the FNN. The experimental results show that the proposed method is powerful for removing noise from natural images, and the MSE of this approach is less, and the PSNR of is higher, than that of any individual filters which are used for fusion. Finally, the two proposed approaches are compared with each other from different point of views, such as objective analysis in terms of mean squared error(MSE), peak signal to noise ratio (PSNR), image quality index (IQI) based on quality assessment of distorted images, and Information Theoretic Criterion (ITC) based on a human vision model, computational cost, universality, and human observation. The results show that the proposed FNN based algorithm optimized by GA has the best performance among all testing approaches. Important considerations for these proposed approaches and future work are discussed

IMPROVING UNDERSTANDABILITY AND UNCERTAINTY MODELING OF DATA USING FUZZY LOGIC SYSTEMS

The need for automation, optimality and efficiency has made modern day control and monitoring systems extremely complex and data abundant. However, the complexity of the systems and the abundance of raw data has reduced the understandability and interpretability of data which results in a reduced state awareness of the system. Furthermore, different levels of uncertainty introduced by sensors and actuators make interpreting and accurately manipulating systems difficult. Classical mathematical methods lack the capability to capture human knowledge and increase understandability while modeling such uncertainty. Fuzzy Logic has been shown to alleviate both these problems by introducing logic based on vague terms that rely on human understandable terms. The use of linguistic terms and simple consequential rules increase the understandability of system behavior as well as data. Use of vague terms and modeling data from non-discrete prototypes enables modeling of uncertainty. However, due to recent trends, the primary research of fuzzy logic have been diverged from the basic concept of understandability. Furthermore, high computational costs to achieve robust uncertainty modeling have led to restricted use of such fuzzy systems in real-world applications. Thus, the goal of this dissertation is to present algorithms and techniques that improve understandability and uncertainty modeling using Fuzzy Logic Systems. In order to achieve this goal, this dissertation presents the following major contributions: 1) a novel methodology for generating Fuzzy Membership Functions based on understandability, 2) Linguistic Summarization of data using if-then type consequential rules, and 3) novel Shadowed Type-2 Fuzzy Logic Systems for uncertainty modeling. Finally, these presented techniques are applied to real world systems and data to exemplify their relevance and usage

Computational intelligence based complex adaptive system-of-systems architecture evolution strategy

The dynamic planning for a system-of-systems (SoS) is a challenging endeavor. Large scale organizations and operations constantly face challenges to incorporate new systems and upgrade existing systems over a period of time under threats, constrained budget and uncertainty. It is therefore necessary for the program managers to be able to look at the future scenarios and critically assess the impact of technology and stakeholder changes. Managers and engineers are always looking for options that signify affordable acquisition selections and lessen the cycle time for early acquisition and new technology addition. This research helps in analyzing sequential decisions in an evolving SoS architecture based on the wave model through three key features namely; meta-architecture generation, architecture assessment and architecture implementation. Meta-architectures are generated using evolutionary algorithms and assessed using type II fuzzy nets. The approach can accommodate diverse stakeholder views and convert them to key performance parameters (KPP) and use them for architecture assessment. On the other hand, it is not possible to implement such architecture without persuading the systems to participate into the meta-architecture. To address this issue a negotiation model is proposed which helps the SoS manger to adapt his strategy based on system owners behavior. This work helps in capturing the varied differences in the resources required by systems to prepare for participation. The viewpoints of multiple stakeholders are aggregated to assess the overall mission effectiveness of the overarching objective. An SAR SoS example problem illustrates application of the method. Also a dynamic programing approach can be used for generating meta-architectures based on the wave model. --Abstract, page iii

Proceedings. 22. Workshop Computational Intelligence, Dortmund, 6. - 7. Dezember 2012

Dieser Tagungsband enthält die Beiträge des 22. Workshops "Computational Intelligence" des Fachausschusses 5.14 der VDI/VDE-Gesellschaft für Mess- und Automatisierungstechnik (GMA) der vom 6. - 7. Dezember 2012 in Dortmund stattgefunden hat. Die Schwerpunkte sind Methoden, Anwendungen und Tools für - Fuzzy-Systeme, - Künstliche Neuronale Netze, - Evolutionäre Algorithmen und - Data-Mining-Verfahren sowie der Methodenvergleich anhand von industriellen Anwendungen und Benchmark-Problemen

A type-2 fuzzy logic based goal-driven simulation for optimising field service delivery

This thesis develops an intelligent system capable of incorporating the conditions that drive operational activity while implementing the means to handle unexpected factors to protect business sustainability. This solution aims to optimise field service operations in the utility-based industry, especially within one of the world's leading communications services companies, namely BT (British Telecom), which operates in highly regulated and competitive markets. Notably, the telecommunication sector is an essential driver of economic activity. Consequently, intelligent solutions must incorporate the ability to explain their underlying algorithms that power their final decisions to humans. In this regard, this thesis studies the following research gaps: the lack of integrated solutions that go beyond isolated monolithic architectures, the lack of agile end-to-end frameworks for handling uncertainty while business targets are defined, current solutions that address target-oriented problems do not incorporate explainable methodologies; as a result, limited explainability features result in inapplicability for highly regulated industries, and most tools do not support scalability for real-world scenarios. Hence, the need for an integrated, intelligent solution to address these target-oriented simulation problems. This thesis aims to reduce the gaps mentioned above by exploiting fuzzy logic capabilities such as mimicking human thinking and handling uncertainty. Moreover, this thesis also finds support in the Explainable AI field, particularly in the strategies and characteristics to deploy more transparent intelligent solutions that humans can understand. Hence, these foundations support the thesis to unlock explainability, transparency and interpretability. This thesis develops a series of techniques with the following features: the formalisation of an end-to-end framework that dynamically learns form data, the implementation of a novel fuzzy membership correlation analysis approach to enhance performance, the development of a novel fuzzy logic-based method to evaluate the relevancy of inputs, the modelling of a robust optimisation method for operational sustainability in the telecommunications sector, the design of an agile modelling approach for scalability and consistency, the formalisation of a novel fuzzy-logic system for goal-driven simulation for achieving specific business targets before being implemented in real-life conditions, and a novel simulation environment that incorporates visual tools to enhance interpretability while moving from conventional simulation to a target-oriented model. The proposed tool was developed based on data from BT, reflecting their real-world operational conditions. The data was protected and anonymised in compliance with BT’s sharing of information regulations. The techniques presented in the development of this thesis yield significant improvements aligned to institutional targets. Precisely, as detailed in Section 9.5, the proposed system can model a reduction between 3.78% and 5.36% of footprint carbon emission due to travel times for jobs completion on customer premises for specific geographical areas. The proposed framework allows generating simulation scenarios 13 times faster than conventional approaches. As described in Section 9.6, these improvements contribute to increased productivity and customer satisfaction metrics regarding keeping appointment times, completing orders in the promised timeframe or fixing faults when agreed by an estimated 2.6%. The proposed tool allows to evaluate decisions before acting; as detailed in Section 9.7, this contributes to the ‘promoters’ minus ‘detractors’ across business units measure by an estimated 1%

Informational Paradigm, management of uncertainty and theoretical formalisms in the clustering framework: A review

Fifty years have gone by since the publication of the first paper on clustering based on fuzzy sets theory. In 1965, L.A. Zadeh had published “Fuzzy Sets” [335]. After only one year, the first effects of this seminal paper began to emerge, with the pioneering paper on clustering by Bellman, Kalaba, Zadeh [33], in which they proposed a prototypal of clustering algorithm based on the fuzzy sets theory

Data Clustering for Fuzzyfier Value Derivation

The fuzzifier value m is improving significant factor for achieving the accuracy of data. Therefore, in this chapter, various clustering method is introduced with the definition of important values for clustering. To adaptively calculate the appropriate purge value of the gap type −2 fuzzy c-means, two fuzzy values m1 and m2 are provided by extracting information from individual data points using a histogram scheme. Most of the clustering in this chapter automatically obtains determination of m1 and m2 values that depended on existent repeated experiments. Also, in order to increase efficiency on deriving valid fuzzifier value, we introduce the Interval type-2 possibilistic fuzzy C-means (IT2PFCM), as one of advanced fuzzy clustering method to classify a fixed pattern. In Efficient IT2PFCM method, proper fuzzifier values for each data is obtained from an algorithm including histogram analysis and Gaussian Curve Fitting method. Using the extracted information form fuzzifier values, two modified fuzzifier value m1 and m2 are determined. These updated fuzzifier values are used to calculated the new membership values. Determining these updated values improve not only the clustering accuracy rate of the measured sensor data, but also can be used without additional procedure such as data labeling. It is also efficient at monitoring numerous sensors, managing and verifying sensor data obtained in real time such as smart cities

Towards Better Performance in the Face of Input Uncertainty while Maintaining Interpretability in AI

Uncertainty is a pervasive element of many real-world applications and very often existing sources of uncertainty (e.g. atmospheric conditions, economic parameters or precision of measurement devices) have a detrimental impact on the input and ultimately results of decision-support systems. Thus, the ability to handle input uncertainty is a valuable component of real-world decision-support systems. There is a vast amount of literature on handling of uncertainty through decision-support systems. While they handle uncertainty and deliver a good performance, providing an insight into the decision process (e.g. why or how results are produced) is another important asset in terms of having trust in or providing a ‘debugging’ process in given decisions. Fuzzy set theory provides the basis for Fuzzy Logic Systems which are often associated with the ability for handling uncertainty and possessing mechanisms for providing a degree of interpretability. Specifically, Non-Singleton Fuzzy Logic Systems are essential in dealing with uncertainty that affects input which is one of the main sources of uncertainty in real-world systems. Therefore, in this thesis, we comprehensively explore enhancing non-singleton fuzzy logic systems capabilities considering both capturing-handling uncertainty and also maintaining interpretability. To that end the following three key aspects are investigated; (i) to faithfully map input uncertainty to outputs of systems, (ii) to propose a new framework to provide the ability for dynamically adapting system on-the-fly in changing real-world environments. (iii) to maintain level of interpretability while leveraging performance of systems. The first aspect is to leverage mapping uncertainty from input to outputs of systems through the interaction between input and antecedent fuzzy sets i.e. firing strengths. In the context of Non-Singleton Fuzzy Logic Systems, recent studies have shown that the standard technique for determining firing strengths risks information loss in terms of the interaction of the input uncertainty and antecedent fuzzy sets. This thesis explores and puts forward novel approaches to generating firing strengths which faithfully map the uncertainty affecting system inputs to outputs. Time-series forecasting experiments are used to evaluate the proposed alternative firing strength generating technique under different levels of input uncertainty. The analysis of the results shows that the proposed approach can also be a suitable method to generate appropriate firing levels which provide the ability to map different uncertainty levels from input to output of FLS that are likely to occur in real-world circumstances. The second aspect is to provide dynamic adaptive behaviours to systems at run-time in changing conditions which are common in real-world environments. Traditionally, in the fuzzification step of Non-Singleton Fuzzy Logic Systems, approaches are generally limited to the selection of a single type of input fuzzy sets to capture the input uncertainty, whereas input uncertainty levels tend to be inherently varying over time in the real-world at run-time. Thus, in this thesis, input uncertainty is modelled -where it specifically arises- in an online manner which can provide an adaptive behaviour to capture varying input uncertainty levels. The framework is presented to generate Type-1 or Interval Type-2 input fuzzy sets, called ADaptive Online Non-singleton fuzzy logic System (ADONiS). In the proposed framework, an uncertainty estimation technique is utilised on a sequence of observations to continuously update the input fuzzy sets of non-singleton fuzzy logic systems. Both the type-1 and interval type-2 versions of the ADONiS frameworks remove the limitation of the selection of a specific type of input fuzzy sets. Also this framework enables input fuzzy sets to be adapted to unknown uncertainty levels which is not perceived at the design stage of the model. Time-series forecasting experiments are implemented and results show that our proposed framework provides performance advantages over traditional counterpart approaches, particularly in environments that include high variation in noise levels, which are common in real-world applications. In addition, the real-world medical application study is designed to test the deployability of the ADONiS framework and to provide initial insight in respect to its viability in replacing traditional approaches. The third aspect is to maintain levels of interpretability, while increasing performance of systems. When a decision-support model delivers a good performance, providing an insight of the decision process is also an important asset in terms of trustworthiness, safety and ethical aspects etc. Fuzzy logic systems are considered to possess mechanisms which can provide a degree of interpretability. Traditionally, while optimisation procedures provide performance benefits in fuzzy logic systems, they often cause alterations in components (e.g. rule set, parameters, or fuzzy partitioning structures) which can lead to higher accuracy but commonly do not consider the interpretability of the resulting model. In this thesis, the state of the art in fuzzy logic systems interpretability is advanced by capturing input uncertainty in the fuzzification -where it arises- and by handling it the inference engine step. In doing so, while the performance increase is achieved, the proposed methods limit any optimisation impact to the fuzzification and inference engine steps which protects key components of FLSs (e.g. fuzzy sets, rule parameters etc.) and provide the ability to maintain the given level of interpretability