MultiEdge: An Edge-based Communication Subsystem for Scalable Commodity Servers
Karlsson, S.; Passas, S.; Kotsis, G.; Bilas, A.
Parallel and Distributed Processing Symposium, 2007. IPDPS 2007. IEEE International
Volume , Issue , 26-30 March 2007 Page(s):1 - 10
Digital Object Identifier 10.1109/IPDPS.2007.370218
Summary:At the core of contemporary high performance computer systems is the communication infrastructure. For this reason, there has been a lot of work on providing low-latency, high-bandwidth communication subsystems for clusters. In this paper, we introduce MultiEdge, a connection oriented communication system designed for high-speed commodity hardware. MultiEdge provides support for end-to-end flow -control, ordering, and reliable transmission. It transparently supports multiple physical links within a single connection. We use MultiEdge to examine the behavior of edge-based protocols using both micro-benchmarks and real-life shared memory applications. Our results show that MultiEdge is able to deliver about 88% of the nominal link throughput with a single 10-GBit/s link and more than 95% with multiple 1-GBit/s links. Our application results show that performing all of the communication protocol at the edge does not seem to cause any degradation in performance.
View citation and abstract |