A Caltech Library Service

Efficient Message Passing Interface (MPI) for Parallel Computing on Clusters of Workstations

Bruck, Jehoshua and Dolev, Danny and Ho, Ching-Tien and Roşu, Marcel-Cătălin (1995) Efficient Message Passing Interface (MPI) for Parallel Computing on Clusters of Workstations. In: SPAA '95 Proceedings of the seventh annual ACM symposium on Parallel algorithms and architectures. ACM , New York, NY, pp. 64-73. ISBN 0-89791-717-0.

Full text is not posted in this repository. Consult Related URLs below.

Use this Persistent URL to link to this item:


Parallel computing on clusters of workstations and personal computers has very high potential, since it leverages existing hardware and software. Parallel programming environments offer the user a convenient way to express parallel computation and communication. In fact, recently, a Message Passing Interface (MPI) has been proposed as an industrial standard for writing “portable” message-passing parallel programs. The communication part of MPI consists of the usual point-to-point communication as well as collective communication. However, existing implementations of programming environments for clusters are built on top of a point-to-point communication layer (send and receive) over local area networks (LANs) and, as a result, suffer from poor performance in the collective communication part. In this paper, we present an efficient design and implementation of the collective communication part in MPI that is optimized for clusters of workstations. Our system consists of two main components: the MPI-CCL layer that includes the collective communication functionality of MPI and a User-level Reliable Transport Protocol (URTP) that interfaces with the LAN Data-link layer and leverages the fact that the LAN is a broadcast medium. Our system is integrated with the operating system via an efficient kernel extension mechanism that we developed. The kernel extension significantly improves the performance of our implementation as it can handle part of the communication overhead without involving user space. We have implemented our system on a collection of IBM RS/6000 workstations connected via a lOMbit Ethernet LAN. Our performance measurements are taken from typical scientific programs that run in a parallel mode by means of the MPI. The hypothesis behind our design is that system’s performance will be bounded by interactions between the kernel and user space rather than by the bandwidth delivered by the LAN Data-Link Layer. Our results indicate that the performance of our MPI Broadcast (on top of Ethernet) is about twice as fast as a recently published software implementation of broadcast on top of ATM.

Item Type:Book Section
Related URLs:
URLURL TypeDescription ItemTechnical Report
Bruck, Jehoshua0000-0001-8474-0812
Additional Information:© 1995 ACM. We thank Greg Joyce, Frank Schmuck, Jim Wyllie and Steve Wise for their advice on AIX. We thank Karen Brannon and Yoichi Tsuji for their help with PolyFEM. We thank Alex Ho for his comments on the paper.
Record Number:CaltechAUTHORS:20160811-162638038
Persistent URL:
Usage Policy:No commercial reproduction, distribution, display or performance rights in this work are provided.
ID Code:69576
Deposited On:12 Aug 2016 17:25
Last Modified:11 Nov 2021 04:16

Repository Staff Only: item control page