Research on Application of Computer Big Data Technology in Information Database Algorithm Data Processing System

In order to manage large-scale data categorically, this paper proposes a data analysis system for operational records. This system uses a two-stage data preprocessing method. The existing data preprocessing method is optimized to improve the distribution efficiency and accuracy of large amounts of data. Then a real-time monitoring method based on time series data is proposed. Based on the query optimization of distributed databases, the system has been studied and improved. The example analysis shows that the improved half-join query algorithm greatly reduces the transmission cost and improves the query efficiency.