Multi-Thread Concurrent Compression Algorithm for Genomic Big Data

At present, there are many excellent genome compression algorithms with high genome compression ratio. However, there is a lack of highly efficient compression algorithms for simultaneous compression of a large number of genomes. This manuscript presents an algorithm, which is called FastLNGC, for simultaneous compression of a large amount of genome data based on multi-thread concurrency. This algorithm is based on the LNGC (Large Number of Genomes Compressor) algorithm, and adopts multi-thread technology to achieve concurrent processing of genome data compression. A large number of experiments show that FastLNGC has better performance on compression of a large number of genes. The source code of FastLNGC is available at https://github.com/APandaThief/FastLNGC.