An Improved Congestion-Controlled Routing Protocol for IoT Applications in Extreme Environments

The Internet of Things (IoT) has shown its presence in applications that require monitoring extreme environments, such as wildfires, military operations, and coastal areas, among others. In these applications, the IoT nodes are deployed in hazardous terrains where humanistic access is hard or not possible. Hence, to ensure reliable data transmission in these applications, novel routing protocols need to be designed due to the multihop nature of communication possessed by the deployed nodes. Currently, most of the routing protocols utilized by IoT nodes follow traditional approaches, which creates congestion and contention in the network. As a result, the network performance is degraded in terms of various communication metrics. To address this problem and improve the communication statistics in extreme environments, we propose a deep-
$Q$
-learning-enable-destination-sequenced distance-vector (DQL-DSDV) framework. DQL-DSDV focuses on selecting the next hop during communication. Initially, the DSDV protocol updates routing information for connected nodes. This information is subsequently utilized by the deep-
$Q$
-learning (DQL) algorithm to compute the next hop count. This computation is based on reward functions, known as
$Q$
-values, which are conceptualized as the distance between connected nodes by taking into account the traffic flow. These distinguishing operational features of DQL and DSDV ensure that DQL-DSDV minimizes the packet lost ratio, congestion, end-to-end delay, and communication cost with improved Quality of Service (QoS). During simulations, we observed significant improvement in these performance metrics, in the presence of the existing schemes. Despite that, we checked the computation complexity of the proposed approach with existing protocols, which demonstrated noteworthy outcomes just like the other metrics.