ALCoD: An Adaptive Load-Aware Approach to Load Balancing for Containers in IoT Edge Computing

Container technologies promise efficient deployment of distributed services, but their potential is hampered by suboptimal resource utilization and network congestion stemming from initial placement decisions made without knowledge of future demands. Existing container cluster management strategies lack robust adaptive capabilities to efficiently balance load as work-loads evolve unpredictably over time. This paper puts forth the Adaptive Load-aware Container Deployment (ALCoD), a novel container cluster management approach integrating worst fit decreasing heuristic placement with deep reinforcement learning-based migration optimization. ALCoD adapts to fluctuating resource availability and service demands by leveraging the complementary strengths of each technique. The worst fit decreasing approach allows rapid initial cluster deployment when resources are abundantly available, while the deep reinforcement learning policy orchestrates intelligent container migrations to optimize load balancing during times of resource scarcity, maintaining service availability throughout. Comprehensive evaluations verified that compared to state-of-the-art strategies, ALCoD reduces system response times by 29.19%, improves load balancing by 51.31%, and decreases bandwidth usage by 27.4% under real-world conditions. Beyond these raw performance improvements, ALCoD demonstrates the potential of hybrid algorithms that blend complementary techniques to match the intrinsic dynamics of container clusters. This pioneering approach establishes a solid foundation for realizing the full promise of containerized services through reliable, responsive delivery even as operating conditions continuously evolve.