An Effiecient Approach for Resource Auto-Scaling in Cloud Environments

Cloud services have become more popular among users these days. Automatic resource provisioning for cloud services is one of the important challenges in cloud environments. In the cloud computing environment, resource providers shall offer required resources to users automatically without any limitations. It means whenever a user needs more resources, the required resources should be dedicated to the users without any problems. On the other hand, if resources are more than user’s needs extra resources should be turn off temporarily and turn back on whenever they needed. In this paper, we propose an automatic resource provisioning approach based on reinforcement learning for auto-scaling resources according to Markov Decision Process (MDP). Simulation Results show that the rate of Service Level Agreement (SLA) violation and stability that the proposed approach better performance compared to the similar approaches

Symbiotic service composition in distributed sensor networks

To cope with the evergrowing number of colocated networks and the density they exhibit, we introduce symbiotic networks-networks that intelligently share resources and autonomously adapt to the dynamicity thereof. By allowing the software services provided in such networks to operate in an equally symbiotic manner, new opportunities for the so-called service compositions arise, which take advantage of the multitude of services and combine them to achieve goals set out by the individual networks. To accommodate services in large-scale symbiotic networks, including wireless sensor networks, we propose a software platform which autonomously constructs and orchestrates such compositions. Furthermore, upon changes in the infrastructure, the platform responds by adapting compositions to reflect the changed context. To enable the interaction between services offered by arbitrary partners, the platform deploys ontologies to achieve a common vocabulary and semantic rules to express the policies imposed by the networks involved. By applying the platform to typical scenarios from the field of sensor-augmented cargo transportation and logistics, we illustrate its applicability and, through performance evaluation, show a significant increase in process efficiency. Additionally, by means of a generic problem generator, we quantify the scalability of our platform and show the importance of an appropriate priority function, one of the core constituents of our service composition approach

Towards Automated Network Configuration Management

Modern networks are designed to satisfy a wide variety of competing goals related to network operation requirements such as reachability, security, performance, reliability and availability. These high level goals are realized through a complex chain of low level configuration commands performed on network devices. As networks become larger, more complex and more heterogeneous, human errors become the most significant threat to network operation and the main cause of network outage. In addition, the gap between high-level requirements and low-level configuration data is continuously increasing and difficult to close. Although many solutions have been introduced to reduce the complexity of configuration management, network changes, in most cases, are still manually performed via low--level command line interfaces (CLIs). The Internet Engineering Task Force (IETF) has introduced NETwork CONFiguration (NETCONF) protocol along with its associated data--modeling language, YANG, that significantly reduce network configuration complexity. However, NETCONF is limited to the interaction between managers and agents, and it has weak support for compliance to high-level management functionalities. We design and develop a network configuration management system called AutoConf that addresses the aforementioned problems. AutoConf is a distributed system that manages, validates, and automates the configuration of IP networks. We propose a new framework to augment NETCONF/YANG framework. This framework includes a Configuration Semantic Model (CSM), which provides a formal representation of domain knowledge needed to deploy a successful management system. Along with CSM, we develop a domain--specific language called Structured Configuration language to specify configuration tasks as well as high--level requirements. CSM/SCL together with NETCONF/YANG makes a powerful management system that supports network--wide configuration. AutoConf supports two levels of verifications: consistency verification and behavioral verification. We apply a set of logical formalizations to verifying the consistency and dependency of configuration parameters. In behavioral verification, we present a set of formal models and algorithms based on Binary Decision Diagram (BDD) to capture the behaviors of forwarding control lists that are deployed in firewalls, routers, and NAT devices. We also adopt an enhanced version of Dyna-Q algorithm to support dynamic adaptation of network configuration in response to changes occurred during network operation. This adaptation approach maintains a coherent relationship between high level requirements and low level device configuration. We evaluate AutoConf by running several configuration scenarios such as interface configuration, RIP configuration, OSPF configuration and MPLS configuration. We also evaluate AutoConf by running several simulation models to demonstrate the effectiveness and the scalability of handling large-scale networks

Service Level Agreement-based adaptation management for Internet Service Provider (ISP) using Fuzzy Q-learning

Internet access is the vital catalyst for online users, and the number of mobile subscribers is predicted to grow from dramatically in the next few years. This huge demand is the main issue facing the Internet Service Providers (ISPs) who need to handle users’ expectations along with their current resources. An adaptive mechanism within the ISPs architecture is a promising solution to handle such situation. A Service Level Agreement (SLA)is the legal catalyst to monitor any contract violation between end users and ISPs and is embedded within a Quality of Service (QoS) framework. It strengthens and advances the quality of control over the user’s application and network resources and can be further stretched to fulfill the QoS terms through negotiation and re-negotiation. Moreover, the present literature does not focus on the combination of rule-based approaches and adaptation together to update the established learning repository. Therefore, this mainstream of this research in the context of SLAs is to fill in this gap by addressing the combination of rule-base uncertainties and iteration of the learning ability. The key to the proposed architecture is the utilization of self - * capabilities designed to have self-management over uncertainties and the provision of self-adaptive interactions. Thus, the Monitor, Analyse, Plan, Execute and Knowledge Base (MAPE-K) approach is able to deal with this problem together with the integration of Fuzzy and Q-Learning algorithms. The proposed architecture is in the context of autonomic computing. An adaptation manager is the main proposed component to update admission control on the ISP current resources and the ability to manage SLAs. A general methodology type-2 fuzzy logic is applied to ensure the uncertainties and precise decision-making are well addressed in this research. The proposed solution, demonstrating Q-Learning works adaptive with QoS parameters, e.g. Latency, Availability and Packet Loss. With the combination of fuzzy and Q-Learning, we demonstrate that the proposed adaptation manager is able to handle the uncertainties and learning abilities. Q-Learning is able to identify the initial state from various ISPs iterations and update them with appropriate actions, reflecting the reward configurations. The higher the iterations process the higher is the increase the learning ability,rewards and exploration probability. The research outcomes benefit the SLA framework by incorporating the information for SLA policies and Service Level Objectives (SLOs). Lastly, an important contribution is the ability to demonstrate that the MAPE-K approach is a contender for ISP SLA-based frameworks for QoS provision