Q-Learning Energy Management System (Q-EMS) in Wireless Sensor Network

The energy control of a Wireless Sensor Network (WSN) often leads to an unbalanced state between the battery storage system, energy extraction through photovoltaic systems energy, and energy utilization in the WSN. These disparities result in suboptimal wireless sensor network performance. The reliance on batteries is a major factor contributing to this problem. The Q-Learning Energy Management System (Q-EMS) is designed to address these challenges and improve energy management strategies. The Q-EMS algorithm used a learning process resulting in optimal actions for sensor nodes in different situations. The rewards or punishments nodes receive determine their decisions, which are determined by the Q-EMS algorithm. The Q-learning model approach is aimed at reducing energy consumption and supply in WSNs. Energy supply is categorized into battery-based, transfer-based, and harvesting, while energy consumption can be classified into task-cycle, mobility-based, and data-driven. The development of the Q Learning algorithm model has three scenarios: determining energy needs for WSN, effective energy harvesting strategy, and effective energy transfer. As a result, effective energy demand, harvesting and transfer using the Q-learning algorithm are balanced. However, it needs to be studied in more depth using real data in the field. In future research, I will use real data and optimize the use of the Q-Learning algorithm.