Parallel Array Object I/O Support on Distributed Environments

This paper presents a parallel file object environment to support distributed array store on sharednothing distributed computing environments. Our environment enables programmers to extend the concept of array distributions from memory levels to file levels. It allows parallel I/O that facilitates the distribution of objects in an application. When objects are read and/or written by multiple applications using different distributions, we present a novel scheme to help programmers to select the best data distribution pattern according to minimum amount of remote data movements for the store of array objects on distributed file systems. Our selection scheme, to our best knowledge, is the first work to attempt to optimize the distribution patterns in the secondary storage for HPF-like programs with inter-application cases. This is especially important for a class of problems called multiple disciplinary optimization (MDO) problems. Our testbed is built on an 8-node DEC Farm connected with..

Parallel Array Object I/O Support on Distributed Environments

This paper presents a parallel le object environment to support distributed array store on shared-nothing distributed computing environments. Our environment enables programmers to extend the concept of array distributions from memory levels to le levels. It allows parallel I/O that facilitates the distribution of objects in an application. When objects are read and/or written by multiple applications using di erent distributions, we present anovel scheme to help programmers to select the best data distribution pattern according to minimum amount of remote data movements for the store of array objects on distributed le systems. Our selection scheme, to our best knowledge, is the rst work to attempt to optimize the distribution patterns in the secondary storage for HPF-like programs with inter-application cases. This is especially important for a class of problems called multiple disciplinary optimization (MDO) problems. Our testbed is built on an 8-node DEC Farm connected with an ethernet, FDDI, or ATM switch. Our experimental results with scienti c applications show that not only our parallel le system can provide aggregate bandwidths, but also our selection scheme e ectively reduce the communication tra cs for the system.