LogP performance characterization of fast messages atop Myrinet

The Fast Messages (FM) project is a highly optimized, low latency messaging layer providing a virtual interface to the communication hardware. The purpose of the paper is to present a detailed characterization of the FM communication messaging layer using the LogP model. We have used a series of communication microbenchmarks to measure the parameters of the LogP model. These specialized benchmarks are similar to those employed by D.E. Culler et al. (1996) to characterize the network interfaces of different parallel machines. The main focus of our analysis is the interaction between the messaging layer and the underlying communication system. We show that LogP can be a useful architectural analysis tool, providing the designer with some additional insight into the way different parts of the communication subsystem interact and contribute to the total communication overhead.