Scheduled System Maintenance:
Some services will be unavailable Sunday, March 29th through Monday, March 30th. We apologize for the inconvenience.
By Topic

Self-evaluating reinforcement learning based spectrum management for cognitive Ad Hoc networks

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

The purchase and pricing options are temporarily unavailable. Please try again later.
3 Author(s)
Ozekin, E.E. ; Dept. of Comput. Eng., Bogazici Univ., Istanbul, Turkey ; Demirci, F.C. ; Alagoz, F.

Cognitive radio (CR) is an emerging technology which aims to solve the current wireless spectra problems in terms of efficiency and utilization. CRs should respond adequately to environmental changes in order to operate in a highly efficient manner. Reinforcement learning (RL) is an effective method that entails exploration, followed by exploitation and is used to train CRs to function in unknown environments. However, it also suffers from cases that cannot be easily avoided and recovered from, such as: conservative behavior causing converging to a non-ideal state and aggressive exploration that results in disrupting the network. In this paper, we propose a self-evaluating, RL-based spectrum management approach for cognitive ad-hoc networks. We investigate a means to detect environmental changes by having a CR inspect its information consistency and respond accordingly to changes in the environment. We also aim to grant CRs more flexibility in exploration behavior since using this approach will make it easier to remedy any shortcomings caused by aggressive exploration. The benefit of applying our algorithm is demonstrated and comparisons of performances using evaluations of different scopes are also provided to illustrate their impact on the spectrum management. Simulation results show the proposed approach is effective and able to improve the performance by increasing CRs' responsiveness to environmental changes and allowing fast recovery.

Published in:

Information Networking (ICOIN), 2013 International Conference on

Date of Conference:

28-30 Jan. 2013