Hadoop Data Mining Analysis of Network Education Platform based on PDM New Media Data Perspectives

This paper is based on the Hadoop data mining analysis of the networked education platform of PDM data integration. Research and analyze the architecture system of Hadoop, which focuses on analyzing its two core parts: some characteristics and principles of HDFS (distributed file system) and MapReduce (distributed programming model). The parallel multiple linear regression algorithm and the The principle and implementation of the networked education platform, in which the proposed "message passing model" can effectively solve the problem that MapReduce is difficult to deal with the adjacency matrix. The MYSQL system is used in the process of constructing a large data set, and the efficiency of the system is analyzed and tested. . Through practice and testing, it is found that after the algorithm is improved, the data processing time of the system is greatly reduced by 9.7%, so the overall system efficiency has been improved.