F-Net: Fusion Neural Network for Vehicle Trajectory Prediction in Autonomous Driving

Recent research has been remarkable in recurrent neural networks (RNNs) on sequence-to-sequence problems for image caption, and promising in convolutional neural networks (CNNs) on spatial analysis problems for image detection and sematic segmentation problems. In this paper, based on recurrent neural networks and convolutional neural networks, we propose a fusion neural network architecture named F-Net to deal with vehicle trajectory prediction on highway and urban scenarios in autonomous driving applications. The novelty of the proposed method is the attention mechanism that affects effectively in the progress of both RNN and CNN feature extraction. Besides, our sufficient usage of raw sensor data protects scene texture information of environment and interaction among surrounding vehicles. Experimental results on the nuScene dataset show that our proposed method outperforms the state-of-the-art methods.