32 research outputs found

    Methods to Overlap Communications in Parallel Numerical Algorithms

    No full text

    Towards Mixed Computation/Communication in Parallel Scientific Libraries

    No full text
    This paper presents an overlapping technique of communications by computations based on pipelined communications. This allows to improve the execution time of most parallel numerical algorithms. Some simple examples are developed namely, global combine, matrix-vector product and bi-dimensional Fast Fourier Transform, to illustrate the efficiency of this technique. Moreover, we propose an unified formalism to express easily the pipelined versions of these algorithms. Finally, we report some experiments on various parallel machines. Keywords: parallel numerical algorithms, communications. 1 Introduction The large development of parallel scientific computers leads the common users to adapt their programs, to take into account the potential of parallelism of their applications. Since efficient parallel compilers are not available today, the simplest issue, is to use parallel numerical libraries [1]. Given an initial distribution of the data (vectors, matrices, etc.), the computational ke..
    corecore