Loading [MathJax]/extensions/MathMenu.js
Dynamic Template Updating Using Spatial-Temporal Information in Siamese Trackers | IEEE Journals & Magazine | IEEE Xplore

Dynamic Template Updating Using Spatial-Temporal Information in Siamese Trackers


Abstract:

Siamese trackers usually use the target in the first frame as a fixed template, but the static template cannot adapt to target changes. The existing updater is challengin...Show More

Abstract:

Siamese trackers usually use the target in the first frame as a fixed template, but the static template cannot adapt to target changes. The existing updater is challenging to deal with target deformation and update noise, and there is an excellent risk of updating with an inaccurate updater. In our research, a dynamic template updating strategy based on spatial-temporal information is proposed to improve the tracking accuracy of the Siamese tracker. Furthermore, Tracking Confidence Network (TCNet) is proposed to judge whether to update, which ensures that high-quality target features are used to update and reduce the noise caused by adding unreliable targets. In experiments, the proposed method is embedded into two baseline trackers: SiamRPN and SiamFC++, and tested on five popular benchmarks. The experimental results show that the proposed method can improve the performance of the Siamese trackers while maintaining real-time speed.
Published in: IEEE Transactions on Multimedia ( Volume: 26)
Page(s): 2006 - 2015
Date of Publication: 30 June 2023

ISSN Information:

Funding Agency:

Author image of Yuanhui Wang
School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China
School of Computer Science, Zhuhai College of Science and Technology, Guangdong, China
Yuanhui Wang received the B.S. degree in intellgence computer science and technology and the M.S. degree in computer software and theory from the Northeast Normal University, Changchun, China, in 2006 and 2009, respectively. She is currently working toward the Ph.D. degree with the School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China. She is also with the School of Computer ...Show More
Yuanhui Wang received the B.S. degree in intellgence computer science and technology and the M.S. degree in computer software and theory from the Northeast Normal University, Changchun, China, in 2006 and 2009, respectively. She is currently working toward the Ph.D. degree with the School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China. She is also with the School of Computer ...View more
Author image of Ben Ye
School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China
Ben Ye received the B.S. degree from Beijing Normal University, Zhuhai, China, in 2013, and the M.S. and Ph.D. degrees from the Macau University of Science and Technology, Macau, China, in 2015 and 2019, respectively. He is currently an Assistant Professor with the School of Computer Science and Engineering, Macau University of Science and Technology. His research interests include salient object feature representation in...Show More
Ben Ye received the B.S. degree from Beijing Normal University, Zhuhai, China, in 2013, and the M.S. and Ph.D. degrees from the Macau University of Science and Technology, Macau, China, in 2015 and 2019, respectively. He is currently an Assistant Professor with the School of Computer Science and Engineering, Macau University of Science and Technology. His research interests include salient object feature representation in...View more
Author image of Zhanchuan Cai
School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China
Zhanchuan Cai (Senior Member, IEEE) received the Ph.D. degree from Sun Yat-sen University, Guangzhou, China, in 2007. He is currently a Professor with the School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China, where he is also with the State Key Laboratory of Lunar and Planetary Sciences, Macau University of Science and Technology. He has authored more than 100 papers in jour...Show More
Zhanchuan Cai (Senior Member, IEEE) received the Ph.D. degree from Sun Yat-sen University, Guangzhou, China, in 2007. He is currently a Professor with the School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China, where he is also with the State Key Laboratory of Lunar and Planetary Sciences, Macau University of Science and Technology. He has authored more than 100 papers in jour...View more

Author image of Yuanhui Wang
School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China
School of Computer Science, Zhuhai College of Science and Technology, Guangdong, China
Yuanhui Wang received the B.S. degree in intellgence computer science and technology and the M.S. degree in computer software and theory from the Northeast Normal University, Changchun, China, in 2006 and 2009, respectively. She is currently working toward the Ph.D. degree with the School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China. She is also with the School of Computer Science, Zhuhai College of Science and Technology, Macau University of Science and Technology. Her research interests include visual object tracking, image processing, and artificial intelligence.
Yuanhui Wang received the B.S. degree in intellgence computer science and technology and the M.S. degree in computer software and theory from the Northeast Normal University, Changchun, China, in 2006 and 2009, respectively. She is currently working toward the Ph.D. degree with the School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China. She is also with the School of Computer Science, Zhuhai College of Science and Technology, Macau University of Science and Technology. Her research interests include visual object tracking, image processing, and artificial intelligence.View more
Author image of Ben Ye
School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China
Ben Ye received the B.S. degree from Beijing Normal University, Zhuhai, China, in 2013, and the M.S. and Ph.D. degrees from the Macau University of Science and Technology, Macau, China, in 2015 and 2019, respectively. He is currently an Assistant Professor with the School of Computer Science and Engineering, Macau University of Science and Technology. His research interests include salient object feature representation in deep learning, remote sensing data processing and analysis, medical data processing, and computer graphics. Dr. Ye was the recipient of the Third Prize of the Macau Science and Technology Award-Technological Invention Award, Macau, in 2018.
Ben Ye received the B.S. degree from Beijing Normal University, Zhuhai, China, in 2013, and the M.S. and Ph.D. degrees from the Macau University of Science and Technology, Macau, China, in 2015 and 2019, respectively. He is currently an Assistant Professor with the School of Computer Science and Engineering, Macau University of Science and Technology. His research interests include salient object feature representation in deep learning, remote sensing data processing and analysis, medical data processing, and computer graphics. Dr. Ye was the recipient of the Third Prize of the Macau Science and Technology Award-Technological Invention Award, Macau, in 2018.View more
Author image of Zhanchuan Cai
School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China
Zhanchuan Cai (Senior Member, IEEE) received the Ph.D. degree from Sun Yat-sen University, Guangzhou, China, in 2007. He is currently a Professor with the School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China, where he is also with the State Key Laboratory of Lunar and Planetary Sciences, Macau University of Science and Technology. He has authored more than 100 papers in journals and refereed conference. His research interests include intelligent information processing, image processing and computer graphics, multimedia information security, and remote sensing data processing and analysis.
Zhanchuan Cai (Senior Member, IEEE) received the Ph.D. degree from Sun Yat-sen University, Guangzhou, China, in 2007. He is currently a Professor with the School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China, where he is also with the State Key Laboratory of Lunar and Planetary Sciences, Macau University of Science and Technology. He has authored more than 100 papers in journals and refereed conference. His research interests include intelligent information processing, image processing and computer graphics, multimedia information security, and remote sensing data processing and analysis.View more

Contact IEEE to Subscribe

References

References is not available for this document.