By Topic

Distributed Independent Reinforcement Learning (DIRL) Approach to Resource Management in Wireless Sensor Networks

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Shah, K. ; SensorLogic Inc., Addison ; Kumar, M.

In wireless sensor networks, resource-constrained nodes are expected to operate in unattended highly dynamic environments. Hence, the need for adaptive and autonomous resource/task management in wireless sensor networks is well recognized. We present distributed independent reinforcement learning (DIRL), a Q-learning based framework to enable autonomous self-learning/adaptive applications with inherent support for efficient resource/task management. The proposed scheme based on DIRL, learns the utility of performing various tasks over time using mostly local information at nodes and uses the utility value along with application constraints for task management by optimizing global system-wide parameters like total energy usage, network lifetime etc. We also present an object tracking application design based on DIRL to exemplify our framework. Finally, we present results of simulation studies to demonstrate the feasibility of our approach and compare its performance against other existing approaches. In general for applications requiring autonomous adaptation, we show that DIRL on average is about 90% more efficient than traditional resource management schemes like static scheduling without losing any significant accuracy/performance.

Published in:

Mobile Adhoc and Sensor Systems, 2007. MASS 2007. IEEE Internatonal Conference on

Date of Conference:

8-11 Oct. 2007