Cooperation among Web Crawlers by Using Contract Net Protocol

There are many previous researches on focused crawlers. Most of the crawlers are bionic: they gain energy for having scratched relevant pates to the query and lose energy otherwise; they reproduce when energy is high and they die when energy is out. This causes some crawlers in irrelevant area to die so relevant pages that are far to Seed Url may not be scratched and the crawlers' recall rate may be influenced. In this paper we adopt Contract Net Protocol to solve this problem in a distributed environment.