Multi-byte Hash based CSV Load in Bioinformatics

Because using CSV files for data storage and exchange in bioinformatics has some disadvantages, it is usually necessary to load the bioinformatics CSV files into a database. However, the plain text and flexible nature of the CSV format make CSV files with Chinese headers often difficult to parse and correctly load their content. In this paper, we propose a multi-byte hash based bulk load method to load the bioinformatics CSV files with multi-byte headers into a database table. As a result, our proposed method improved data consistency and availability.