A Polite Policy for Revisiting Web Pages

We propose and analyze an efficient scheduling policy for revisiting Web pages so as to keep a local repository as up to date as possible. The main contribution of our policy is the fact that it takes into account the politeness constraint in order to compute the revisiting times. Our experiments suggest that the performance of our policy is very close to the optimal one and that it is significantly better than the one obtained using a reasonable variation of the policy proposed in [Wolf et. ah, WWW'2002].