DCC: a High-Performance Distributed Encryption Framework for Large Volumes of Data

Data privacy and security is becoming one of the most important subjects for IT companies, as it has the potential to shift their reputation and therefore influence their value on the market. However, on a large scale, namely in Big Data platforms, securing data may be a major challenge as it can limit the system's performance. Therefore, finding solutions that enable a compromise between security and performance is a must. In this paper, we present a framework called Distributed Cipher Chaining (DCC) which allows the creation of flexible encryption schemes that can offer configurable levels of availability. We also present a local multi-threaded implementation as well as a distributed multi-process implementation and the advantages and applications of each one. We show that our solution is well adapted to large files as it outperforms state-of-the art methods while improving the diffusion rate.