Abstract:
Robust online object tracking entails integrating short-term memory based trackers and long-term memory based trackers in an elegant framework to handle structural and ap...Show MoreMetadata
Abstract:
Robust online object tracking entails integrating short-term memory based trackers and long-term memory based trackers in an elegant framework to handle structural and appearance variations of unknown objects in an online manner. The integration and synergy between short-term and long-term memory based trackers have yet studied well in the literature, especially in pre-training free settings. To address this issue, this paper presents a bottom-up and top-down integration framework. The bottom-up component realizes a data-driven approach for particle generation. It exploits a short-term memory based tracker to generate bounding box proposals in a new frame. In the top-down component, this paper presents a graph regularized sparse coding scheme as the long-term memory based tracker. The over-complete bases for sparse coding are composed of part-based representations learned from earlier tracking results and new observations to form a space with rich temporal context information. A particle graph is computed whose nodes are the bottom-up discriminative particles and edges are formed on-the-fly in terms of appearance and spatial-temporal similarities between particles. The particle graph induces a regularization term in optimizing the sparse coding coefficients for bottom-up particles. In experiments, the proposed method is tested on the widely used OTB-100 benchmark and the VOT2016 benchmark with better performance obtained than baselines including deep learning based trackers. In addition, the outputs from the top-down sparse coding are potentially useful for downstream tasks such as action recognition, multiple-object tracking, and object re-identification.
Published in: IEEE Transactions on Multimedia ( Volume: 23)
Funding Agency:
NC State University, Raleigh, NC, USA
School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, China
Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu, China
Meihui Li received the bachelor's degree in information display and optoelectronic technology in 2014 from the University of Electronic and Science Technology of China (UESTC), Chengdu, Sichuan, China, where she is currently working toward the Ph.D. degree in signal and information processing. She has been with the Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA, in 201...Show More
Meihui Li received the bachelor's degree in information display and optoelectronic technology in 2014 from the University of Electronic and Science Technology of China (UESTC), Chengdu, Sichuan, China, where she is currently working toward the Ph.D. degree in signal and information processing. She has been with the Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA, in 201...View more
School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, China
Lingbing Peng received the B.Sc. degree in communications engineering from the University of Electronic Science and Technology of China, Chengdu China, in 2012, where she is currently working toward the Ph.D. degree in communications and information systems. Her research interests include signal processing, image processing, and target recognition and tracking.
Lingbing Peng received the B.Sc. degree in communications engineering from the University of Electronic Science and Technology of China, Chengdu China, in 2012, where she is currently working toward the Ph.D. degree in communications and information systems. Her research interests include signal processing, image processing, and target recognition and tracking.View more
Department of Electrical and Computer Engineering and Visual Narrative Initiative, North Caroline State University, Raleigh, NC, USA
Tianfu Wu (Member, IEEE) received the Ph.D. degree in statistics from the University of California, Los Angeles, Los Angeles, CA, USA under the supervision by Prof. Song-Chun Zhu. He is an Assistant Professor with the Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA. His research focuses on computer vision, often motivated by the task of building explainable and improvab...Show More
Tianfu Wu (Member, IEEE) received the Ph.D. degree in statistics from the University of California, Los Angeles, Los Angeles, CA, USA under the supervision by Prof. Song-Chun Zhu. He is an Assistant Professor with the Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA. His research focuses on computer vision, often motivated by the task of building explainable and improvab...View more
School of Information and Communication Engineering, University of Electronic Science and Technology of China, Sichuan, China
Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu, China
Zhenming Peng (Member, IEEE) received the Ph.D. degree in geo-detection and information technology from the Chengdu University of Technology, Chengdu, China, in 2001. From 2001 to 2003, he was a Postdoctoral Researcher with the Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, China. He is currently a Professor with the University of Electronic Science and Technology of China, Chengdu, China. His ...Show More
Zhenming Peng (Member, IEEE) received the Ph.D. degree in geo-detection and information technology from the Chengdu University of Technology, Chengdu, China, in 2001. From 2001 to 2003, he was a Postdoctoral Researcher with the Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, China. He is currently a Professor with the University of Electronic Science and Technology of China, Chengdu, China. His ...View more
Contents NC State University, Raleigh, NC, USA
School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, China
Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu, China
Meihui Li received the bachelor's degree in information display and optoelectronic technology in 2014 from the University of Electronic and Science Technology of China (UESTC), Chengdu, Sichuan, China, where she is currently working toward the Ph.D. degree in signal and information processing. She has been with the Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA, in 2017. Her research interests include computer vision and machine learning.
Meihui Li received the bachelor's degree in information display and optoelectronic technology in 2014 from the University of Electronic and Science Technology of China (UESTC), Chengdu, Sichuan, China, where she is currently working toward the Ph.D. degree in signal and information processing. She has been with the Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA, in 2017. Her research interests include computer vision and machine learning.View more
School of Information and Communication Engineering, University of Electronic Science and Technology of China, Chengdu, China
Lingbing Peng received the B.Sc. degree in communications engineering from the University of Electronic Science and Technology of China, Chengdu China, in 2012, where she is currently working toward the Ph.D. degree in communications and information systems. Her research interests include signal processing, image processing, and target recognition and tracking.
Lingbing Peng received the B.Sc. degree in communications engineering from the University of Electronic Science and Technology of China, Chengdu China, in 2012, where she is currently working toward the Ph.D. degree in communications and information systems. Her research interests include signal processing, image processing, and target recognition and tracking.View more
Department of Electrical and Computer Engineering and Visual Narrative Initiative, North Caroline State University, Raleigh, NC, USA
Tianfu Wu (Member, IEEE) received the Ph.D. degree in statistics from the University of California, Los Angeles, Los Angeles, CA, USA under the supervision by Prof. Song-Chun Zhu. He is an Assistant Professor with the Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA. His research focuses on computer vision, often motivated by the task of building explainable and improvable visual Turing test and robot autonomy through life-long communicative learning. To accomplish his research goals, he is interested in pursuing a unified framework for machines to ALTER (Ask, Learn, Test, Explain and Refine) recursively in a principled way.
Tianfu Wu (Member, IEEE) received the Ph.D. degree in statistics from the University of California, Los Angeles, Los Angeles, CA, USA under the supervision by Prof. Song-Chun Zhu. He is an Assistant Professor with the Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA. His research focuses on computer vision, often motivated by the task of building explainable and improvable visual Turing test and robot autonomy through life-long communicative learning. To accomplish his research goals, he is interested in pursuing a unified framework for machines to ALTER (Ask, Learn, Test, Explain and Refine) recursively in a principled way.View more
School of Information and Communication Engineering, University of Electronic Science and Technology of China, Sichuan, China
Laboratory of Imaging Detection and Intelligent Perception, University of Electronic Science and Technology of China, Chengdu, China
Zhenming Peng (Member, IEEE) received the Ph.D. degree in geo-detection and information technology from the Chengdu University of Technology, Chengdu, China, in 2001. From 2001 to 2003, he was a Postdoctoral Researcher with the Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, China. He is currently a Professor with the University of Electronic Science and Technology of China, Chengdu, China. His research interests include image processing, signal processing, and target recognition and tracking. He is a member of Optical Society of America, China Optical Engineering Society, and Chinese Society of Astronautics.
Zhenming Peng (Member, IEEE) received the Ph.D. degree in geo-detection and information technology from the Chengdu University of Technology, Chengdu, China, in 2001. From 2001 to 2003, he was a Postdoctoral Researcher with the Institute of Optics and Electronics, Chinese Academy of Sciences, Chengdu, China. He is currently a Professor with the University of Electronic Science and Technology of China, Chengdu, China. His research interests include image processing, signal processing, and target recognition and tracking. He is a member of Optical Society of America, China Optical Engineering Society, and Chinese Society of Astronautics.View more
