Reinforcement Learning for Two-Aircraft Conflict Resolution in the Presence of Uncertainty

Recently, the advances in reinforcement learning have enabled an artificial intelligent agent to solve many challenging problems (e.g. AlphaGo) at unprecedented levels. However, the robustness of reinforcement learning in safety critical operation remains unclear. In this work, the applicability of reinforcement learning in Air Traffic Control was explored. We focus on building an algorithm to automate flight conflict resolution which is an ultimate goal of air traffic control. For that purpose, a simulator, that provides learning environment for reinforcement learning, was developed to simulate a variety of air traffic scenarios. We propose a variant of reinforcement learning approach to resolve conflict in an airspace and investigate the performance of the method in achieving that. Reinforcement learning model, specifically deep deterministic policy gradient, was adopted to learn the conflict resolution with continuous action spaces. Experimental results demonstrate that our proposed method is effective in resolving conflict between two aircraft even in the presence of uncertainty. The accuracy of our model is
$\approx 87\%$
at different uncertainty levels. Our findings suggest that reinforcement learning is a promising approach for conflict resolution.