Minimizing Service Latency through Image-Based Microservice Caching and Randomized Request Routing in Mobile Edge Computing

In the context of Mobile Edge Computing (MEC), the traditional method of requesting microservices from a central cloud can result in increased delay for users due to the physical distance between the user and the cloud server. To address this issue, MEC advocates for placing servers closer to the users at the edge of the network. However, this approach is constrained by the storage capacity and computing resources of edge servers. Therefore, it is crucial to devise a strategy for processing user requests that minimizes the average request delay. To address this problem, This paper formulates the microservice caching problem as an image-based microservice placement and task request routing problem. We model the problem as an integer linear programming problem with multi-condition constraints. Considering the limited resources of edge servers, we propose a microservice placement algorithm called approximate algorithm based on randomized task request routing. The proposed algorithm is designed to provide near-optimal solutions in polynomial time, leveraging Chernoff’s theorem. Our approach is evaluated through comparisons with two existing algorithms: the image-pull-based microservice cache request algorithm and the greedy-based microservice cache and request routing algorithm. The results demonstrate that our algorithm exhibits superior performance compared to existing methods.