Adaptive Distributed Computing through Competition

In this paper, a framework for supporting adaptive execution of parallel applications in networks of workstations is presented. The framework is comprised of two levels of competition. At the first level, the tasks of each application are partitioned into grains. The grains race one another until all their tasks are finished. The turn-around time of an application can be shortened by sharing the tasks of the heavily loaded grains with the neighboring grains. At the second level, a prototype system called Comedians has been developed, which enables competition among applications for workstations by mechanisms of auction and bidding. The objectives of the Comedians system are to maximize the speedup of individual parallel applications and, at the same time, to allocate workstations efficiently and fairly to the applications. Unlike all related work, this paper suggests an integrated solution to both the issues of adaptive parallelism and parallel application scheduling in a multi-user en..