IJA Automaton: Expediency and ε-optimality Properties

In this paper, we present a new fixed structure learning automaton (FSSA), called IJA, and study its steady state behavior in stationary environments. The proposed automaton characterizes by star shaped transition diagram and each branch of the star contains N states associated with a particular action. This new automaton is an improvement of the Krinsky FSSA and not only ε-optimal and expedient, but also converges to the optimal action faster than the old one