Correction to "Hidden Markov model multiarm bandits: a methodology for beam scheduling in multitarget tracking"

We have discovered an error in the return-to-state formulation of the HMM multiarmed bandit problem of Krishnamurthy and Evans (see IEEE Trans. Signal Processing, vol.49, p.2893-2908, Dec. 2001). This note outlines this error and describes a computationally simpler solution.