Video Service-Oriented Vehicular Collaboration: A Multi-Agent Proximal Policy Optimization Approach

To guarantee heterogeneous performance requirements of diverse vehicular services, it is necessary to design a full cooperative policy for both vehicle to infrastructure (V2I) links and vehicle to vehicle (V2V) links. This paper investigates how to improve the quality of experience (QoE) of the V2I users for video services while satisfying the delay requirements of both V2I and V2V links. In specific, a QoE maximization problem is formulated with consideration of vehicular collaboration where task offloading decision, channel reuse decision and power allocation of V2V users are all included. A multi-agent reinforcement learning (MARL) framework is then designed, where a new reward function is proposed to evaluate the utility of the considered network. Thereafter, a proximal policy optimization approach is proposed to enable each V2V user to learn policy individually with the shared global network reward. The effectiveness of the proposed approach is finally validated with comparison of other baseline approaches through extensive simulation experiments.