Prospective Terms Based Architecture for Migrating Crawler

Search engines help users find information on WWW by making web pages related to their query available. Searches are factorized by using either terms or keywords or through short sentences. No matter how user specifies the search query, the results retrieved, organized & presented by search engines are in terms of millions of linked pages of which many of them might not be useful to the user. Due to lack of refinement & any meaningful classification of search result, user seldom find required information on the first page of the result page. Furthermore temporal quality of downloaded documents due to lack of automatic tracking of user trend & topic of current interest is not high. Thus providing accurate precise & high quality result to the end user has become major task for search engine. In this paper Prospective Terms Based Architecture for Migrating Crawler is being proposed that helps to retrieve web pages according to latest trend & updated information among various topics while working in parallel. A prospective table which relate semantically related keyword is being used at crawling, indexing and page ranking level so that search engine adopt a prospective view & user get full information within first few urls & need not go deeper into the results.