A Case for Cooperative and Incentive-Based Coupling of Distributed Clusters

Research interest in Grid computing has grown significantly over the past five years. Management of distributed resources is one of the key issues in Grid computing. Central to management of resources is the effectiveness of resource allocation as it determines the overall utility of the system. The current approaches to superscheduling in a grid environment are non-coordinated since application level schedulers or brokers make scheduling decisions independently of the others in the system. Clearly, this can exacerbate the load sharing and utilization problems of distributed resources due to suboptimal schedules that are likely to occur. To overcome these limitations, we propose a mechanism for coordinated sharing of distributed clusters based on computational economy. The resulting environment, called \emph{Grid-Federation}, allows the transparent use of resources from the federation when local resources are insufficient to meet its users' requirements. The use of computational economy methodology in coordinating resource allocation not only facilitates the QoS based scheduling, but also enhances utility delivered by resources.Comment: 22 pages, extended version of the conference paper published at IEEE Cluster'05, Boston, M

A Taxonomy of Workflow Management Systems for Grid Computing

With the advent of Grid and application technologies, scientists and engineers are building more and more complex applications to manage and process large data sets, and execute scientific experiments on distributed resources. Such application scenarios require means for composing and executing complex workflows. Therefore, many efforts have been made towards the development of workflow management systems for Grid computing. In this paper, we propose a taxonomy that characterizes and classifies various approaches for building and executing workflows on Grids. We also survey several representative Grid workflow systems developed by various projects world-wide to demonstrate the comprehensiveness of the taxonomy. The taxonomy not only highlights the design and engineering similarities and differences of state-of-the-art in Grid workflow systems, but also identifies the areas that need further research.Comment: 29 pages, 15 figure

Cost Based Optimization of Job Allocation in Computational Grids

Computational grids are distributed systems composed of heterogeneous computing resources which are distributed geographically and administratively. These highly scalable systems are designed to meet the large computational demands of many users from scientific and business orientations. Grid computing is a powerful concept, its chief appeal being the ability to make sure all of a resource’s computing power is used. In a grid world, the idle time of hundreds or thousands of resources could be harnessed and rented out to anyone who needed a massive infusion of processing power. First, the architecture of a grid system is presented. The design gives a mathematical model of the grid system for efficiently allocating the grids resources. The challenges faced for optimal job allocation motivate the exploration in optimizing grid resource allocations. We have extensively surveyed the current state of art in this area. A grid server coordinates the job allocation for the grid users and helps to select the best resources for a job among different possible resource offers with the best prices offered. Interaction between grid users and the resources require a mediator that uses different paradigm to communicate the needs of the two parties in terms of performance requirements, timing constraints, price charged etc. A game theoretic bargaining approach is studied to agree upon standard prices. We have implemented various job allocation schemes in computational grids based on the mathematical modeling of the grid system and bargaining protocol with the objective function of optimizing the cost. The performance of the schemes have been analyzed and compared. A new model for job allocation in computational grids has been proposed, for job allocation based on the clustering of resources

A theoretical and computational basis for CATNETS

The main content of this report is the identification and definition of market mechanisms for Application Layer Networks (ALNs). On basis of the structured Market Engineering process, the work comprises the identification of requirements which adequate market mechanisms for ALNs have to fulfill. Subsequently, two mechanisms for each, the centralized and the decentralized case are described in this document. These build the theoretical foundation for the work within the following two years of the CATNETS project. --Grid Computing