Automating Parallelization of Regular Computations for Distributed-Memory Multicomputers in the PARADIGM Compiler

Distributed-memory multicomputers such as the Intel iPSC/860, the NCUBE/2, the Intel Paragon and the Connection Machine CM-5 offer significant advantages over shared-memory multiprocessors in terms of cost and scalability. Unfortunately, to extract all the computational power from these machines, users have to parallelize their existing serial programs, which can be an extremely laborious process. One major reason for this difficulty is the absence of a single global shared address space. As a result, the programmer has to distribute code and data on processors and manage communication among tasks explicitly. Clearly there is a need for efficient parallelizing compiler support on these machines. The PARADIGM project at the University of Illinois addresses these problems by developing a fully automated means to translate serial programs for efficient execution on distributed-memory multicomputers. In this paper we discuss parallelization of regular computations using symbolic sets as a ..