From grids to clouds: a collective intelligence study for inter-cooperated infrastructures

Recently, more effort has been put into developing interoperable and distributed environments that offer users exceptional opportunities for utilizing resources over the internet. By utilising grids and clouds, resource consumers and providers, they gain significant benefits by either using or purchasing the computer processing capacities and the information provided by data centres. On the other hand, the collective intelligence paradigm is characterized as group based intelligence that emerges from the collaboration of many individuals, who in turn, define a coordinated knowledge model. It is envisaged that such a knowledge model could be of significant advantage if it is incorporated within the grid and cloud community. The dynamic load and access balancing of the grid and cloud data centres and the collective intelligence provides multiple opportunities, involving resource provisioning and development of scalable and heterogeneous applications. The contribution of this paper is that by utilizing grid and cloud resources, internal information stored within a public profile of each participant, resource providers as well as consumers, can lead to an effective mobilization of improved skills of members. We aim to unify the grid and cloud functionality as consumable computational power, for a) discussing the supreme advantages of such on-line resource utilization and provisioning models and b) analyzing the impact of the collective intelligence in the future trends of the aforementioned technologies

A Computational Field Framework for Collaborative Task Execution in Volunteer Clouds

The increasing diffusion of cloud technologies is opening new opportunities for distributed and collaborative computing. Volunteer clouds are a prominent example, where participants join and leave the platform and collaborate by sharing their computational resources. The high dynamism and unpredictability of such scenarios call for decentralized self-* approaches to guarantee QoS. We present a simulation framework for collaborative task execution in volunteer clouds and propose one concrete instance based on Ant Colony Optimization, which is validated through a set of simulation experiments based on Google workload data

A mobile agent strategy for grid interoperable virtual organisations

During the last few years much effort has been put into developing grid computing and proposing an open and interoperable framework for grid resources capable of defining a decentralized control setting. Such environments may define new rules and actions relating to internal Virtual Organisation (VO) members and therefore posing new challenges towards to an extended cooperation model of grids. More specifically, VO policies from the viewpoint of internal knowledge and capabilities may be expressed in the form of intelligent agents thus providing a more autonomous solution of inter-communicating members. In this paper we propose an interoperable mobility agent model that performs migration to any interacting VO member and by traveling within each domain allows the discovery of resources dynamically. The originality of our approach is the mobility mechanism based on traveling and migration which stores useful information during the route to each visited individual. The method is considered under the Foundation for Intelligent Physical Agents (FIPA) standard which provides an on demand resource provisioning model for autonomous mobile agents. Finally the decentralization of the proposed model is achieved by providing each member with a public profile of personal information which is available upon request from any interconnected member during the resource discovery process

Personal mobile grids with a honeybee inspired resource scheduler

This thesis was submitted for the degree of Doctor of Philosophy and awarded by Brunel University.The overall aim of the thesis has been to introduce Personal Mobile Grids (PMGrids) as a novel paradigm in grid computing that scales grid infrastructures to mobile devices and extends grid entities to individual personal users. In this thesis, architectural designs as well as simulation models for PM-Grids are developed. The core of any grid system is its resource scheduler. However, virtually all current conventional grid schedulers do not address the non-clairvoyant scheduling problem, where job information is not available before the end of execution. Therefore, this thesis proposes a honeybee inspired resource scheduling heuristic for PM-Grids (HoPe) incorporating a radical approach to grid resource scheduling to tackle this problem. A detailed design and implementation of HoPe with a decentralised self-management and adaptive policy are initiated. Among the other main contributions are a comprehensive taxonomy of grid systems as well as a detailed analysis of the honeybee colony and its nectar acquisition process (NAP), from the resource scheduling perspective, which have not been presented in any previous work, to the best of our knowledge. PM-Grid designs and HoPe implementation were evaluated thoroughly through a strictly controlled empirical evaluation framework with a well-established heuristic in high throughput computing, the opportunistic scheduling heuristic (OSH), as a benchmark algorithm. Comparisons with optimal values and worst bounds are conducted to gain a clear insight into HoPe behaviour, in terms of stability, throughput, turnaround time and speedup, under different running conditions of number of jobs and grid scales. Experimental results demonstrate the superiority of HoPe performance where it has successfully maintained optimum stability and throughput in more than 95% of the experiments, with HoPe achieving three times better than the OSH under extremely heavy loads. Regarding the turnaround time and speedup, HoPe has effectively achieved less than 50% of the turnaround time incurred by the OSH, while doubling its speedup in more than 60% of the experiments. These results indicate the potential of both PM-Grids and HoPe in realising futuristic grid visions. Therefore considering the deployment of PM-Grids in real life scenarios and the utilisation of HoPe in other parallel processing and high throughput computing systems are recommended