By Topic

Automata learning and intelligent tertiary searching for stochastic point location

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
B. J. Oommen ; Sch. of Comput. Sci., Carleton Univ., Ottawa, Ont., Canada ; G. Raghunath

Consider the problem of a robot (learning mechanism or algorithm) attempting to locate a point on a line. The mechanism interacts with a random environment which essentially informs it, possibly erroneously, which way it should move. The first reported paper to solve this problem (Oommen 1997) presented a solution which operated in a discretized space. In this paper we present a new scheme by which the point can be learnt using a combination of various learning principles. The heart of the strategy involves performing a controlled random walk on the underlying space and then intelligently pruning the space using an adaptive tertiary search. The overall learning scheme is shown to be ε-optimal. Just as in the case of the results presented in Oommen (1997) the application of the solution in nonlinear optimization has been alluded to. In a typical optimization process the algorithm has to work its way toward the maximum (minimum) using local information. However, the crucial issue in these strategies is that of determining the parameter to be used in the optimization itself. If the parameter is too small the convergence is sluggish. On the other hand, if the parameter is too large, the system could erroneously converge or even oscillate. The strategy presented here can be utilized to determine the best parameter to be used in the optimization

Published in:

IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics)  (Volume:28 ,  Issue: 6 )