Scheduled System Maintenance:
Some services will be unavailable Sunday, March 29th through Monday, March 30th. We apologize for the inconvenience.
By Topic

Performance analysis of Reinforcement Learning for achieving context-awareness and intelligence in Cognitive Radio networks

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

The purchase and pricing options are temporarily unavailable. Please try again later.
3 Author(s)
Yau, K.-L.A. ; Sch. of Eng. & Comput. Sci., Victoria Univ. of Wellington, Wellington, New Zealand ; Komisarczuk, P. ; Teal, P.D.

Cognitive radio (CR) is a novel and promising paradigm for next-generation wireless communication. It is able to sense and change its transmission and reception parameters adaptively according to spectrum availability at different channels. The cognition cycle (CC) is a state machine that is embodied in each CR that defines the mechanisms related to achieving context-awareness and intelligence including observation, orientation, learning, planning, decision making, and action selection. The CC is the key element in the design of various schemes in CR networks such as dynamic channel selection (DCS), scheduling and congestion control. Hence, a good implementation of the CC is of paramount importance. In this paper, reinforcement learning (RL) is employed to implement the CC. The main focus is to analyze the performance of RL as an approach to achieving context-awareness and intelligence in regard to DCS. The contributions of this paper are twofold. Firstly, we seek to justify whether RL is an appropriate tool to implement the CC. Secondly, we seek to understand the effects of changes on RL parameters on network performance. In addition, we propose solutions for the problems associated with the application of RL in DCS. The results presented in this paper show that RL is a promising approach.

Published in:

Local Computer Networks, 2009. LCN 2009. IEEE 34th Conference on

Date of Conference:

20-23 Oct. 2009