Fast Collective Communication Algorithms for Reflective Memory Network Clusters

: In this paper, we present algorithms for efficiently implementing three collective communication operations on reflective memory network clusters: Broadcast, Barrier Synchronization and All-Reduce. These algorithms have been implemented as an extension to the Bill-Board Protocol, a low-latency communication protocol for reflective memory networks that we previously developed [6,7]. Simulated performance results are presented for these algorithms. The performance of the algorithms is evaluated in detail. A comparative study with Myrinet, a popular point-to-point switched interconnect for clusters is also presented. 1. Introduction In recent years, clusters of workstations have become a popular platform for high-performance computing [1,2]. Clusters typically use commodity networks for intra-cluster communication. Performance of applications running on these clusters directly depends upon the performance of the interconnecting network. Point-to-Point networks such as Myrinet [3], swi..