A Hybrid Technique for Enhancing Data Integrity in Big Data Transmission Environment

Data loss primarily occurs due to huge data size, channel limitations, transmission errors and distinct security attacks. A number of individual or combined efforts have been made to control data size and channel capacity using distinct data compressions, protect numerous security hazards and transportation errors using diverse cryptographies as well as error control techniques. However, the current literature fails to address all these issues mutually with desired time and space efficiencies. Therefore, this research work suggests a hybrid technique which comprises an innovative pattern generation and a new error restraint technique for handling any numbers of isolated or incessant transmission errors. The pattern strings are generated in this mechanism by using a newly designed pattern table. A distinctive lossless compression technique is further incorporated within it to control data size and integrity. Experimented results indicate that the planned hybrid technique is competent to decrease the data loss and errors in compare to other existing technique by offering low Information Loss percentage and high SNR. The obtained results also display its time and space efficiencies by producing higher Compression Percentage and Throughput.