Time or Reward: Digital-twin Enabled Personalized Vehicle Path Planning

Efficient path planning is the key enabling technology for the realization of intelligent transportation systems (ITS). However, due to poor real-time performance and lack of effective incentive methods, it is difficult for traditional path planning schemes to significantly improve the efficiency of traffic management. In addition, existing solutions that use driving distance and driving time as indicators cannot meet the personalized requirements of vehicle users. To this end, by considering the personalized requirements of vehicle users, we propose a digital-twin (DT) enabled path planning scheme to facilitate traffic management. To be specific, based on the collection of traffic data, we first establish a DT architecture for traffic scheduling to reduce the delay of path planning. Then, according to the traffic density of different road sections, we regard road sections as resources and set different rewards for different road sections to encourage vehicles to obey the scheduling instructions. In addition, by jointly considering the driving time and rewards, we further design personalized utility models to map the requirements of different vehicle users. After that, based on the personalized requirement of the vehicle user, we use a
$Q$
-learning algorithm to obtain the optimal path with the target of maximizing the user's utility. The simulation results show that the proposed scheme can bring higher utility to the vehicle users than the conventional schemes.