By Topic

Recursive Least-squares Reinforcement Learning Controller Based on General Fuzzy CMAC

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Zhipeng Shen ; Coll. of Inf. Sci. & Technol., Dalian Maritime Univ., Dalian ; Ning Zhang ; Chen Guo

Combined CMAC addressing schemes with fuzzy logic idea, a general fuzzy CMAC (GFAC) is proposed, in which the fuzzy membership functions are utilized as the receptive field functions. The mapping of receptive field functions, the selection law of membership function and the learning algorithm are presented. Recursive least-squares temporal difference algorithm (RLS-TD) is deduced, which can use data more efficiently with fast convergence and less computational burden. Using RLS-TD method a reinforcement learning structure based on GFAC is applied to ship steering control, as provides an efficient way for the improvement of ship steering control performance. The parameters of controller are online learned and adjusted. Simulation results show that the ship course can be properly controlled in case of the disturbances of wave and wind. It is demonstrated that the proposed algorithm is a promising alternative to conventional autopilots.

Published in:

Bio-Inspired Computing: Theories and Applications, 2007. BIC-TA 2007. Second International Conference on

Date of Conference:

14-17 Sept. 2007