The Application of LDA Model in the Analysis of Job Talent Demand under Big Data Technology

With the arrival of the data era, data analysis job has leaped to become one of the most popular jobs. This paper aims to provide reference for the development direction of job seekers through the study of recruitment information. This paper crawl 1023 data analysis job recruitment information of Guangzhou City from the "future without worry" website. After cleaning the data, firstly, descriptive statistical analysis is made on the basic recruitment information and Chinese word segmentation is processed on the text data, secondly, based on the results of word segmentation, the clustering analysis of vocational skills is carried out, finally, the positions are classified based on the LDA theme model. It is found that the data job requirements for job seekers' technical ability are focused on the mastery of SQL language, python, R software and other programming software, as well as statistical analysis software such as SAS and spss. Requirements for basic quality include the ability to collaborate with other departments, management ability, team cooperation ability and other personal soft strength. Finally, the classification results show that data analysis positions can be roughly divided into three types: partial technology, partial business and commercial data analysis.