Markov Decision Process Based Energy Aware MAC Protocol for IoT WBAN Systems

Internet of Things (IoT) enabled WBAN systems play a crucial role in healthcare monitoring, enhancing patients’ well-being at an affordable cost. However, their primary challenge lies in energy constraints. To optimize the limited energy resources and extend the lifetime of devices within the network, a multi-channel MAC protocol with Markov decision process (MDP-HYMAC) is proposed. This protocol improves energy efficiency, throughput, and network lifetime, and minimizes delays by using separate channels for communication between biomedical devices and access points (APs). In addition, a Markov decision process is employed to stochastically model the systems’ transition states and explore optimal communication strategies between biomedical devices and APs. Furthermore, an adaptive power allocation scheme, a time-slot allocation scheme, and a back-off strategy are designed to minimize time-slot wastage, energy consumption, and delays. The proposed protocol outperforms the baseline methods by achieving significant improvements in energy efficiency from 4% to 22%. The findings of this research strongly indicate that the proposed protocol has the potential to significantly improve the performance of WBAN systems, particularly in the context of sustainable healthcare monitoring.