By Topic

An energy conservation optimization strategy for wireless sensor network node based on Q-learning

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$33 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Mao Sha ; School of Computer and Information, Hefei University of Technology, Hefei 23009 ; Tang Hao ; Zhou Lei ; Ma Xuesen

Energy conservation for a sensor node is one of the key challenges in wireless sensor networks (WSN). In this paper the optimal energy optimization problem for the sensor node is concerned, and the objective is to obtain the long-term average maximum throughput per energy consumption. First, we analyze the energy conservation optimization problem in the background of cross-layer adaptive transmission over fading channels. For less energy consumption on data sensing, receiving and sending we refer to a mechanism which dynamically turns on or off different components, adjusts transmit power and modulation level of the sensor node while maintaining required performance. Then, the problem is modified by introducing dynamic power management (DPM) technique and modeled as an average reward Markov decision process (AR-MDP). Combined with simulated annealing (SA), Q learning algorithm is proposed to solve the energy conservation optimization problem with average performance criteria. Finally, the simulation results show that the approach in this paper is more efficient than always on policy or random policy. As the approach the energy consumption can be well balanced while the throughput of the sensor node doesn't decrease significantly.

Published in:

Control Conference (ASCC), 2011 8th Asian

Date of Conference:

15-18 May 2011