Numerous scientific teams use HDF5 files to store very large datasets, which can be located at remote sites. The HDF5-iRODS module for the iRODS data grid system allows applications to read subsets of datasets without transferring the entire file to a local machine. This capability can result in substantial savings of both time and space.
Published in:
eScience, 2008. eScience '08. IEEE Fourth International Conference on
Date of Conference: 7-12 Dec. 2008