SiamIRPN: Siamese Visual Tracking with Improved Region Proposal Networks

Though introducing the Region Proposal Network (RPN) from object detection enabled Siamese trackers’ success, RPN-based trackers still struggle in challenging scenarios. We posit that the reason comes from two major limitations of the introduced RPN, where one is that the external structure of the RPN is simple and straight, the other is that the internal components used in RPN cannot cope with complex scenes. In this paper, we propose an Improved RPN (IRPN) suitable for visual tracking. Externally, we place a Convolutional Block Attention Mechanism (CBAM) to the IRPN, and internally, we adopt the advanced component groups for the IPRN. Using multiple IRPN blocks and deep architecture, we propose a Siamese tracker (SiamIRPN) having a layer-wise structure. Comprehensive experiments and ablation studies on five benchmarks (VOT-2019, OTB100, UAV123, GOT-10k, and NFS) show our proposed SiamIRPN achieves competitive performance.