Research and development of accounting system in grid environment

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.The Grid has been recognised as the next-generation distributed computing paradigm by seamlessly integrating heterogeneous resources across administrative domains as a single virtual system. There are an increasing number of scientific and business projects that employ Grid computing technologies for large-scale resource sharing and collaborations. Early adoptions of Grid computing technologies have custom middleware implemented to bridge gaps between heterogeneous computing backbones. These custom solutions form the basis to the emerging Open Grid Service Architecture (OGSA), which aims at addressing common concerns of Grid systems by defining a set of interoperable and reusable Grid services. One of common concerns as defined in OGSA is the Grid accounting service. The main objective of the Grid accounting service is to ensure resources to be shared within a Grid environment in an accountable manner by metering and logging accurate resource usage information. This thesis discusses the origins and fundamentals of Grid computing and accounting service in the context of OGSA profile. A prototype was developed and evaluated based on OGSA accounting-related standards enabling sharing accounting data in a multi-Grid environment, the World-wide Large Hadron Collider Grid (WLCG). Based on this prototype and lessons learned, a generic middleware solution was also implemented as a toolkit that eases migration of existing accounting system to be standard compatible.Engineering and Physical Sciences Research Council (EPSRC), Stanford Universit

DRIVER Technology Watch Report

This report is part of the Discovery Workpackage (WP4) and is the third report out of four deliverables. The objective of this report is to give an overview of the latest technical developments in the world of digital repositories, digital libraries and beyond, in order to serve as theoretical and practical input for the technical DRIVER developments, especially those focused on enhanced publications. This report consists of two main parts, one part focuses on interoperability standards for enhanced publications, the other part consists of three subchapters, which give a landscape picture of current and surfacing technologies and communities crucial to DRIVER. These three subchapters contain the GRID, CRIS and LTP communities and technologies. Every chapter contains a theoretical explanation, followed by case studies and the outcomes and opportunities for DRIVER in this field

D3.1. Architecture and design of the platform

This document aims to establish the requirements and the technological basis and design of the PANACEA platform. These are the main goals of the document: - Survey the different technological approaches that can be used in PANACEA. - Specify some guidelines for the metadata. - Establish the requirements for the platform. - Make a Common Interface proposal for the tools. - Propose a format for the data to be exchanged by the tools (Travelling Object). - Choose the technologies that will be used to develop the platform. - Propose a workplan

Research and development of accounting system in grid environment

The Grid has been recognised as the next-generation distributed computing paradigm by seamlessly integrating heterogeneous resources across administrative domains as a single virtual system. There are an increasing number of scientific and business projects that employ Grid computing technologies for large-scale resource sharing and collaborations. Early adoptions of Grid computing technologies have custom middleware implemented to bridge gaps between heterogeneous computing backbones. These custom solutions form the basis to the emerging Open Grid Service Architecture (OGSA), which aims at addressing common concerns of Grid systems by defining a set of interoperable and reusable Grid services. One of common concerns as defined in OGSA is the Grid accounting service. The main objective of the Grid accounting service is to ensure resources to be shared within a Grid environment in an accountable manner by metering and logging accurate resource usage information. This thesis discusses the origins and fundamentals of Grid computing and accounting service in the context of OGSA profile. A prototype was developed and evaluated based on OGSA accounting-related standards enabling sharing accounting data in a multi-Grid environment, the World-wide Large Hadron Collider Grid (WLCG). Based on this prototype and lessons learned, a generic middleware solution was also implemented as a toolkit that eases migration of existing accounting system to be standard compatible.EThOS - Electronic Theses Online ServiceEngineering and Physical Sciences Research Council (EPSRC)Stanford UniversityGBUnited Kingdo

Grid Resources, Services and Data ­ Towards a Semantic Grid System

Howard Temin, who died on February 9, 1994, was driven by the genetic preoccupations of the “phage group” to an insight that was fundamental to thedevelopment of contemporary cellular biology. Howard went to Caltech in 1955 to begin graduate studies, and there developed a unique scientific style, blending the influences of Max Delbrück and Renato Dulbecco. His work was marked by a devotion to understanding the genetic issues posed by cancer-inducing viruses. This focus on genetics put him firmly in the traditions of American science dating back to the beginning of the century, and his concern with virus-induced cancer also built on a rich past. But Howard‘s fierce belief in himself, his deep scholarship, and his remarkable insight allowed him to realize a synthesis that made him one of the most creative scientists of the twentieth century

Towards self-resource discovery and selection models in grid computing

Global computational grids nowadays are suffered from ossification problems due to the following fundamental challenges related to different existing solutions in grid computing: scalability, adaptability, security, reliability, availability and manageability.The management difficulty is due to heterogeneity, dynamicity and locality of the resources within global grid networks.Large-scale grids make the fundamental problem of resource discovery a great challenge.This paper presents a self-resource discovery mechanism (SRDM) that achieves efficient grid resource discovery and takes advantage of the strengths of both hierarchy and decentralized approaches that were previously developed for grid based P2P resource discovery.P2P systems offer potential strengths such as self-organization, self-healing, and robustness to failure or attacks. Unfortunately, the majority of existing Distributed Hash Table (DHT) based P2P overlays are lacking of attributes range queries that are familiar in resource discovery lookups.The proposed model builds an effective distributed hierarchy that providing scalable, decentralized resource discovery and allocation as well as load balancing for distributed computing using large scale pools of heterogeneous computers. Fundamentally, SRDM employs the spatial index and partitions the overlay space to build a distributed quad tree; each computational resource in the network can calculate its Nodepower.Next, it encodes the information about each node’s available computational resources power in the structure of the links connecting the nodes in the network.This distributed encoding is self-organized, with each node managing its in-degree and local connectivity via its available Nodepower.Assignment of incoming jobs to nodes with the freest resources is also accomplished by sampling it

Towards self-resource discovery and selection models in grid computing

Global computational grids nowadays are suffered from ossification problems due to the following fundamental challenges related to different existing solutions in grid computing: scalability, adaptability, security, reliability, availability and manageability.The management difficulty is due to heterogeneity, dynamicity and locality of the resources within global grid networks.Large-scale grids make the fundamental problem of resource discovery a great challenge.This paper presents a self-resource discovery mechanism (SRDM) that achieves efficient grid resource discovery and takes advantage of the strengths of both hierarchy and decentralized approaches that were previously developed for grid based P2P resource discovery.P2P systems offer potential strengths such as self-organization, self-healing, and robustness to failure or attacks. Unfortunately, the majority of existing Distributed Hash Table (DHT) based P2P overlays are lacking of attributes range queries that are familiar in resource discovery lookups.The proposed model builds an effective distributed hierarchy that providing scalable, decentralized resource discovery and allocation as well as load balancing for distributed computing using large scale pools of heterogeneous computers. Fundamentally, SRDM employs the spatial index and partitions the overlay space to build a distributed quad tree; each computational resource in the network can calculate its Nodepower.Next, it encodes the information about each node’s available computational resources power in the structure of the links connecting the nodes in the network.This distributed encoding is self-organized, with each node managing its in-degree and local connectivity via its available Nodepower.Assignment of incoming jobs to nodes with the freest resources is also accomplished by sampling it