Feedback-control & queueing theory-based resource management for streaming applications

Recent advances in sensor technologies and instrumentation have led to an extraordinary growth of data sources and streaming applications. A wide variety of devices, from smart phones to dedicated sensors, have the capability of collecting and streaming large amounts of data at unprecedented rates. A number of distinct streaming data models have been proposed. Typical applications for this include smart cites & built environments for instance, where sensor-based infrastructures continue to increase in scale and variety. Understanding how such streaming content can be processed within some time threshold remains a non-trivial and important research topic. We investigate how a cloud-based computational infrastructure can autonomically respond to such streaming content, offering Quality of Service guarantees. We propose an autonomic controller (based on feedback control and queueing theory) to elastically provision virtual machines to meet performance targets associated with a particular data stream. Evaluation is carried out using a federated Cloud-based infrastructure (implemented using CometCloud) – where the allocation of new resources can be based on: (i) differences between sites, i.e. types of resources supported (e.g. GPU vs. CPU only), (ii) cost of execution; (iii) failure rate and likely resilience, etc. In particular, we demonstrate how Little’s Law –a widely used result in queuing theory– can be adapted to support dynamic control in the context of such resource provisioning

DRS: Dynamic Resource Scheduling for Real-Time Analytics over Fast Streams

In a data stream management system (DSMS), users register continuous queries, and receive result updates as data arrive and expire. We focus on applications with real-time constraints, in which the user must receive each result update within a given period after the update occurs. To handle fast data, the DSMS is commonly placed on top of a cloud infrastructure. Because stream properties such as arrival rates can fluctuate unpredictably, cloud resources must be dynamically provisioned and scheduled accordingly to ensure real-time response. It is quite essential, for the existing systems or future developments, to possess the ability of scheduling resources dynamically according to the current workload, in order to avoid wasting resources, or failing in delivering correct results on time. Motivated by this, we propose DRS, a novel dynamic resource scheduler for cloud-based DSMSs. DRS overcomes three fundamental challenges: (a) how to model the relationship between the provisioned resources and query response time (b) where to best place resources; and (c) how to measure system load with minimal overhead. In particular, DRS includes an accurate performance model based on the theory of \emph{Jackson open queueing networks} and is capable of handling \emph{arbitrary} operator topologies, possibly with loops, splits and joins. Extensive experiments with real data confirm that DRS achieves real-time response with close to optimal resource consumption.Comment: This is the our latest version with certain modificatio

Multi-agent quality of experience control

In the framework of the Future Internet, the aim of the Quality of Experience (QoE) Control functionalities is to track the personalized desired QoE level of the applications. The paper proposes to perform such a task by dynamically selecting the most appropriate Classes of Service (among the ones supported by the network), this selection being driven by a novel heuristic Multi-Agent Reinforcement Learning (MARL) algorithm. The paper shows that such an approach offers the opportunity to cope with some practical implementation problems: in particular, it allows to face the so-called “curse of dimensionality” of MARL algorithms, thus achieving satisfactory performance results even in the presence of several hundreds of Agents

Service oriented networking for multimedia applications in broadband wireless networks

Extensive efforts have been focused on deploying broadband wireless networks. Providing mobile users with high speed network connectivity will let them run various multimedia applications on their wireless devices. In order to successfully deploy and operate broadband wireless networks, it is crucial to design efficient methods for supporting various services and applications in broadband wireless networks. Moreover, the existing access-oriented networking solutions are not able to fully address all the issues of supporting various applications with different quality of service requirements. Thus, service-oriented networking has been recently proposed and has gained much attention. This dissertation discusses the challenges and possible solutions for supporting multimedia applications in broadband wireless networks. The service requirements of different multimedia applications such as video streaming and Voice over IP (VoIP) are studied and some novel service-oriented networking solutions for supporting these applications in broadband wireless networks are proposed. The performance of these solutions is examined in WiMAX networks which are the promising technology for broadband wireless access in the near future. WiMAX networks are based on the IEEE 802.16 standards which have defined different Quality of Service (QoS) classes to support a broad range of applications with varying service requirements to mobile and stationary users. The growth of multimedia traffic that requires special quality of service from the network will impose new constraints on network designers who should wisely allocate the limited resources to users based on their required quality of service. An efficient resource management and network design depends upon gaining accurate information about the traffic profile of user applications. In this dissertation, the access level traffic profile of VoIP applications are studied first, and then a realistic distribution model for VoIP traffic is proposed. Based on this model, an algorithm to allocate resources for VoIP applications in WiMAX networks is investigated. Later, the challenges and possible solutions for transmitting MPEG video streams in wireless networks are discussed. The MPEG traffic model adopted by the WiMAX Forum is introduced and different application-oriented solutions for enhancing the performance of wireless networks with respect to MPEG video streaming applications are explained. An analytical framework to verify the performance of the proposed solutions is discoursed, and it is shown that the proposed solutions will improve the efficiency of VoIP applications and the quality of streaming applications over wireless networks. Finally, conclusions are drawn and future works are discussed