An improved method of HRL based on BP neural network

An improved method of hierarchical reinforcement learning which named BMAXQ was presented in order to resolve the shortcomings of MAXQ. It amended the abstract mechanism of MAXQ and utilized the peculiarities of BP neural network. This method can make agent to find the subtasks automatically and realize parallel learning for every layer. It can be adapted to the learning task during the dynamic environment.