Research on the Application of Transparent Encryption in Distributed File System HDFS

More and more companies are turning to Hadoop to store and deal with their most valuable data, the protection and management of data begin to face increasing security risks. As a data protection technology closely related to big data platform, HDFS transparent encryption technology has certain practical value. In this paper, the HDFS transparent encryption technology is studied, the implementation principle of HDFS transparent encryption technology is introduced, the security and performance of the HDFS transparent encryption technology are analyzed, and the encryption technologies at different levels of the big data platform are compared. Research shows that HDFS transparent encryption technology has the advantages of high performance, transparent application and easy deployment, but there are still potential security problems in the application process.