Research on the off-line processing data platform of automobile international big data based on Hadoop

This paper aims to build an offline processing data platform for automobile internationalization big data based on 10 databases. Firstly, four important modules of Hadoop such as Hadoop Common, Map Reduce, Yarn and HDFS are studied. Then, the flow chart of the platform's business engine is studied based on business execution and business monitoring. Then, the system adopts the top-down hierarchical thought architecture design, encompassing seven business layers including the application layer, gateway layer, service layer, distributed operation layer, cluster scheduling layer, storage layer, and data layer; Finally, the function test and the performance test of the platform are carried out. The results show that the various business functions and comprehensive performance of the platform can meet the large-scale use of individuals, enterprises, and organizations. This platform can help users deal with international automobile businesses and promote the internationalization of automobile products.