By Topic

Determining Optimal Polling Frequency Using a Learning Automata-based Solution to the Fractional Knapsack Problem

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Granmo, O.-C. ; Dept. of ICT, Agder Univ. Coll., Grimstad ; Oommen, B.J. ; Myrer, S.A. ; Olsen, M.G.

Previous approaches to resource allocation in Web monitoring target optimal performance under restricted capacity constraints (Pandey et al., 2003; Wolf et al., 2002). The resource allocation problem is generally modelled as a knapsack problem with known deterministic properties. However, for practical purposes the Web must often be treated as stochastic and unknown. Unfortunately, estimating unknown knapsack properties (e.g., based on an estimation phase (Pandey et al., 2003; Wolf et al., 2002)) delays finding an optimal or near-optimal solution. Dynamic environments aggravate this problem further when the optimal solution changes with time. In this paper, we present a novel solution for the nonlinear fractional knapsack problem with a separable and concave criterion function (Bretthauer and Shetty, 2002). To render the problem realistic, we consider the criterion function to be stochastic with an unknown distribution. At every time instant, our scheme utilizes a series of informed guesses to move, in an online manner, from a "current" solution, towards the optimal solution. At the heart of our scheme, a game of deterministic learning automata performs a controlled random walk on a discretized solution space. Comprehensive experimental results demonstrate that the discretization resolution determines the precision of our scheme. In order to yield a required precision, the current resource allocation solution is consistently improved, until a near-optimal solution is found. Furthermore, our proposed scheme quickly adapts to periodically switching environments. Thus, we believe that our scheme is qualitatively superior to the class of estimation-based schemes

Published in:

Cybernetics and Intelligent Systems, 2006 IEEE Conference on

Date of Conference:

7-9 June 2006