By Topic

A New File-Specific Stripe Size Selection Method for Highly Concurrent Data Access

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Bin Dong ; Sch. Of Comput. Sci. & Eng., BeiHang Univ., Beijing, China ; Xiuqiao Li ; Limin Xiao ; Li Ruan

The data-intensive scientific applications running on high-end computing system depend on parallel file systems for high-speed data input/output. In most parallel file systems, a file is partitioned into multiple subfiles with a view to allowing it to be accessed concurrently. An important factor in the file partition is the stripe size. However, while working well for certain applications, most existing schemes for determining the stripe size for a file still lack the ability to handle highly concurrent data accesses, which is typical for most parallel scientific applications. To address this problem, this paper presents an analytic model to assess the performance of highly concurrent data accesses at first, and then it describes how to apply this model to select the stripe size of a file. Experimental results demonstrate that the accuracy of the analytic model is around 87.89% and the stripe size selected with it can improve the aggregated I/O bandwidth of FLASH I/O up to 5.8 times compared with well-known methods. This paper also discusses how to incorporate our method into real-world parallel file systems.

Published in:

Grid Computing (GRID), 2012 ACM/IEEE 13th International Conference on

Date of Conference:

20-23 Sept. 2012