Medical Consultation System based on Python Web crawler

With the development of the times and the continuous progress of society, the Internet has become the most representative of today's society. Medical data as an important part of network data, with the rapid development of the network also presents the trend of explosion. It is difficult for users to get useful data resources, which is a serious drawback of the Internet today. Although the traditional search engine can return a great deal of information to the user, the user must spend a great deal of time to obtain the information that is valid to itself. According to the background of big data era and the requirement of practical application, this paper gives some shallow opinions on the Web Crawler, introduces the importance of Web Crawler, and the system crawls medical data through Scrapy frame. The system mainly realizes the crawling and the data storage of the doctor information in the specific area and the designated department.