Abstract:
In this paper, we describe the design of a highlyavailable Grid data storage system. Increased availability is ensured by data redundancy and file striping. Redundant dat...Show MoreMetadata
Abstract:
In this paper, we describe the design of a highlyavailable Grid data storage system. Increased availability is ensured by data redundancy and file striping. Redundant data is computed using Reed-Solomon (RS) codes. The level of availability can be chosen for each individual file. Storage overhead is minimal compared to traditional redundancy strategies based on complete replication. Our prototype uses existing Grid data management tools (GridFTP) for communication, and the RS encoding and decoding is embedded in the client software. Performance measurements in wide area network prove the efficiency of our design for high-availability and striped file transfers.
Date of Conference: 19-25 February 2006
Date Added to IEEE Xplore: 03 April 2006
Print ISBN:0-7695-2522-9
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Data Storage ,
- Gridded Data ,
- Erasure Coding ,
- Performance Measures ,
- High Availability ,
- Wide Area ,
- File Transfer ,
- Wide Area Network ,
- Reed-Solomon Codes ,
- Fault-tolerant ,
- Storage Applications ,
- File System ,
- Load Balancing ,
- File Size ,
- Original Files ,
- Packet Size ,
- Level Of Redundancy ,
- Decoding Performance ,
- P2P Network ,
- Low-density Parity-check Codes ,
- Wide Deployment ,
- Low-density Parity-check ,
- Storage Elements ,
- Entire File ,
- Grid Infrastructure ,
- Transfer Operator ,
- Processing Overhead ,
- File Access ,
- Small Files ,
- Network Operators
Keywords assist with retrieval of results and provide a means to discovering other relevant content. Learn more.
- IEEE Keywords
- Index Terms
- Data Storage ,
- Gridded Data ,
- Erasure Coding ,
- Performance Measures ,
- High Availability ,
- Wide Area ,
- File Transfer ,
- Wide Area Network ,
- Reed-Solomon Codes ,
- Fault-tolerant ,
- Storage Applications ,
- File System ,
- Load Balancing ,
- File Size ,
- Original Files ,
- Packet Size ,
- Level Of Redundancy ,
- Decoding Performance ,
- P2P Network ,
- Low-density Parity-check Codes ,
- Wide Deployment ,
- Low-density Parity-check ,
- Storage Elements ,
- Entire File ,
- Grid Infrastructure ,
- Transfer Operator ,
- Processing Overhead ,
- File Access ,
- Small Files ,
- Network Operators