Fast Online Multi-Pedestrian Tracking via Integrating Motion Model and Deep Appearance Model

In recent years, multi-object tracking has attracted more and more attention, both in academia and engineering, but most of the recent works do not pay attention to the speed of the algorithm and only pursue the accuracy. In this paper, we propose an online multi-pedestrian tracking algorithm, taking into account both the accuracy and the speed. First, the motion models of the targets are established by the Kalman filter. At the same time, the appearance models of the targets are extracted by the convolutional neural network. Moreover, a data association algorithm is proposed, which integrates the motion information, including scale, intersection-over-union, and distance, and the appearance information, including the current appearance model and the long-term appearance model. With the data association algorithm, the matching between detections and tracklets is realized, and the goal of tracking by detection is achieved. We compare the proposed algorithm with other algorithms on the MOT15 benchmark and the MOT16 benchmark. The experiment results show that the algorithm has high accuracy and good real-time performance.