|
1. |
Efficient Data-Movement for Lightweight I/O
Oldfield, R.A.; Widener, P.; Maccabe, A.B.; Ward, L.; Kordenbrock, T.;
Cluster Computing, 2006 IEEE International Conference on
25-28 Sept. 2006
Page(s):1
-
9
Abstract:
Efficient data movement is an important part of any high-performance I/O system, but it is especially critical for the current and next-generation of massively parallel processing (MPP) systems. In this paper, we discuss how the scale, architecture, and organization of current and proposed MPP systems impact the design of the data-movement scheme for the I/O system. We also describe and analyze the approach used by the lightweight file systems (LWFS) project, and we compare that approach to more conventional data-movement protocols used by small and mid-range clusters. Our results indicate that the data-movement strategy used by LWFS clearly outperforms conventional data-movement protocols, particularly as data sizes increase
|
Cart
