A reinforcement learning algorithm for restless bandits

We propose and analyze a reinforcement learning algorithm for learning Whittle index for a class of indexable restless bandits based on linear function approximation and illustrate its use using as an example a restless bandit problem arising in scheduling of web crawlers for ephemeral content.