Linear programming formulation of a discrete time infinite horizon optimal control problem with time discounting criterion

This paper is devoted to a study of a discrete time infinite horizon optimal control problem with time discounting criterion. We introduce an infinite-dimensional linear programming (IDLP) problem closely related to this problem. We derive necessary and sufficient conditions of optimality for the optimal control problem in terms of the solution of the dual to this IDLP problem.