Abstract:
Supervised manifold learning has been successfully applied to action recognition, in which class label information could improve the recognition performance. However, the...Show MoreMetadata
Abstract:
Supervised manifold learning has been successfully applied to action recognition, in which class label information could improve the recognition performance. However, the learned manifold may not be able to well preserve both the local structure and global constraint of temporal labels in action sequences. To overcome this problem, this paper proposes a new supervised manifold learning algorithm called supervised spatio-temporal neighborhood topology learning (SSTNTL) for action recognition. By analyzing the topological characteristics in the context of action recognition, we propose to construct the neighborhood topology using both supervised spatial and temporal pose correspondence information. Employing the property in locality preserving projection (LPP), SSTNTL solves the generalized eigenvalue problem to obtain the best projections that not only separates data points from different classes, but also preserves local structures and temporal pose correspondence of sequences from the same class. Experimental results demonstrate that SSTNTL outperforms the manifold embedding methods with other topologies or local discriminant information. Moreover, compared with state-of-the-art action recognition algorithms, SSTNTL gives convincing performance for both human and gesture action recognition.
Published in: IEEE Transactions on Circuits and Systems for Video Technology ( Volume: 23, Issue: 8, August 2013)

Department of Computer Science, Hong Kong Baptist University, Hong Kong, China
Andy J. Ma received the B.Sc. degree in mathematics and applied mathematics, and the M.Sc. degree in applied mathematics from Sun Yat-Sen University, Guangzhou, China, in 2007 and 2009, respectively. He is currently pursuing the Ph.D. degree at the Department of Computer Science, Hong Kong Baptist University, Kowloon, Hong Kong.
His current research interests include pattern recognition, computer vision and machine learnin...Show More
Andy J. Ma received the B.Sc. degree in mathematics and applied mathematics, and the M.Sc. degree in applied mathematics from Sun Yat-Sen University, Guangzhou, China, in 2007 and 2009, respectively. He is currently pursuing the Ph.D. degree at the Department of Computer Science, Hong Kong Baptist University, Kowloon, Hong Kong.
His current research interests include pattern recognition, computer vision and machine learnin...View more

Hong Kong Baptist University, Kowloon, HK, HK
Pong C. Yuen (M'93–SM'11) received the B.Sc. degree in electronic engineering (first class honors) from City Polytechnic, Hong Kong, in 1989, and the Ph.D. degree in electrical and electronic engineering from the University of Hong Kong, Hong Kong, in 1993.
He joined the Hong Kong Baptist University, Kowloon, Hong Kong, in 1993, and is currently a Professor and the Head of the Department of Computer Science. He was a recip...Show More
Pong C. Yuen (M'93–SM'11) received the B.Sc. degree in electronic engineering (first class honors) from City Polytechnic, Hong Kong, in 1989, and the Ph.D. degree in electrical and electronic engineering from the University of Hong Kong, Hong Kong, in 1993.
He joined the Hong Kong Baptist University, Kowloon, Hong Kong, in 1993, and is currently a Professor and the Head of the Department of Computer Science. He was a recip...View more

Institute of Computational Theoretical Studies, Hong Kong Baptist University, Hong Kong, China
Wilman W. W. Zou received the B.Sc. degree in mathematics in 2006 and the M.S. degree in applied mathematics in 2008 from Sun Yat-Sen University, Guangzhou, China, and the Ph.D. degree in computer science from Hong Kong Baptist University, Kowloon, Hong Kong, in 2012.
He joined the Institute of Computational Theoretical Studies, Hong Kong Baptist University, as a Research Associate. His current research interests include m...Show More
Wilman W. W. Zou received the B.Sc. degree in mathematics in 2006 and the M.S. degree in applied mathematics in 2008 from Sun Yat-Sen University, Guangzhou, China, and the Ph.D. degree in computer science from Hong Kong Baptist University, Kowloon, Hong Kong, in 2012.
He joined the Institute of Computational Theoretical Studies, Hong Kong Baptist University, as a Research Associate. His current research interests include m...View more

Sun Yat-Sen University, Guangzhou, Guangdong, CN
Jian-Huang Lai (SM'13) received the M.Sc. degree in applied mathematics in 1989 and the Ph.D. degree in mathematics in 1999 from Sun Yat-Sen University, Guangzhou, China.
He joined Sun Yat-Sen University in 1989 as an Assistant Professor. Currently, he is a Professor with the Department of Automation, School of Information Science and Technology, and the Vice Dean of the School of Information Science and Technology. He has...Show More
Jian-Huang Lai (SM'13) received the M.Sc. degree in applied mathematics in 1989 and the Ph.D. degree in mathematics in 1999 from Sun Yat-Sen University, Guangzhou, China.
He joined Sun Yat-Sen University in 1989 as an Assistant Professor. Currently, he is a Professor with the Department of Automation, School of Information Science and Technology, and the Vice Dean of the School of Information Science and Technology. He has...View more

Department of Computer Science, Hong Kong Baptist University, Hong Kong, China
Andy J. Ma received the B.Sc. degree in mathematics and applied mathematics, and the M.Sc. degree in applied mathematics from Sun Yat-Sen University, Guangzhou, China, in 2007 and 2009, respectively. He is currently pursuing the Ph.D. degree at the Department of Computer Science, Hong Kong Baptist University, Kowloon, Hong Kong.
His current research interests include pattern recognition, computer vision and machine learning. Also, he focuses on information fusion, domain adaptation, manifold learning, and action recognition.
Andy J. Ma received the B.Sc. degree in mathematics and applied mathematics, and the M.Sc. degree in applied mathematics from Sun Yat-Sen University, Guangzhou, China, in 2007 and 2009, respectively. He is currently pursuing the Ph.D. degree at the Department of Computer Science, Hong Kong Baptist University, Kowloon, Hong Kong.
His current research interests include pattern recognition, computer vision and machine learning. Also, he focuses on information fusion, domain adaptation, manifold learning, and action recognition.View more

Hong Kong Baptist University, Kowloon, HK, HK
Pong C. Yuen (M'93–SM'11) received the B.Sc. degree in electronic engineering (first class honors) from City Polytechnic, Hong Kong, in 1989, and the Ph.D. degree in electrical and electronic engineering from the University of Hong Kong, Hong Kong, in 1993.
He joined the Hong Kong Baptist University, Kowloon, Hong Kong, in 1993, and is currently a Professor and the Head of the Department of Computer Science. He was a recipient of the University Fellowship to visit the University of Sydney in 1996. He was associated with the Department of Electrical Engineering, Laboratory of Imaging Science and Engineering. In 1998, he spent a six-month sabbatical leave at the Institute for Advanced Computer Studies, University of Maryland, College Park, MD, USA. He was associated with the Computer Vision Laboratory, CFAR. From June 2005 to January 2006, he was a Visiting Professor at GRAVIR (Graphics, Vision and Robotics) laboratory of INRIA Rhone Alpes, France. He was with PRIMA Group. He was the Director of Croucher Advanced Study Institute (ASI) on biometric authentication in 2004 and the Director of Croucher ASI on Biometric Security and Privacy in 2007. His current research interests include human face recognition, biometric security and privacy, and human activity recognition.
Dr. Yuen has been actively involved in many international conferences as an organizing committee and/or technical program committee member. He was the Track Co-Chair of International Conference on Pattern Recognition in 2006 and the Program Co-Chair of the IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems in 2012. Currently, he is an Editorial Board Member of Pattern Recognition and an Associate Editor of the SPIE Journal of Electronic Imaging.
Pong C. Yuen (M'93–SM'11) received the B.Sc. degree in electronic engineering (first class honors) from City Polytechnic, Hong Kong, in 1989, and the Ph.D. degree in electrical and electronic engineering from the University of Hong Kong, Hong Kong, in 1993.
He joined the Hong Kong Baptist University, Kowloon, Hong Kong, in 1993, and is currently a Professor and the Head of the Department of Computer Science. He was a recipient of the University Fellowship to visit the University of Sydney in 1996. He was associated with the Department of Electrical Engineering, Laboratory of Imaging Science and Engineering. In 1998, he spent a six-month sabbatical leave at the Institute for Advanced Computer Studies, University of Maryland, College Park, MD, USA. He was associated with the Computer Vision Laboratory, CFAR. From June 2005 to January 2006, he was a Visiting Professor at GRAVIR (Graphics, Vision and Robotics) laboratory of INRIA Rhone Alpes, France. He was with PRIMA Group. He was the Director of Croucher Advanced Study Institute (ASI) on biometric authentication in 2004 and the Director of Croucher ASI on Biometric Security and Privacy in 2007. His current research interests include human face recognition, biometric security and privacy, and human activity recognition.
Dr. Yuen has been actively involved in many international conferences as an organizing committee and/or technical program committee member. He was the Track Co-Chair of International Conference on Pattern Recognition in 2006 and the Program Co-Chair of the IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems in 2012. Currently, he is an Editorial Board Member of Pattern Recognition and an Associate Editor of the SPIE Journal of Electronic Imaging.View more

Institute of Computational Theoretical Studies, Hong Kong Baptist University, Hong Kong, China
Wilman W. W. Zou received the B.Sc. degree in mathematics in 2006 and the M.S. degree in applied mathematics in 2008 from Sun Yat-Sen University, Guangzhou, China, and the Ph.D. degree in computer science from Hong Kong Baptist University, Kowloon, Hong Kong, in 2012.
He joined the Institute of Computational Theoretical Studies, Hong Kong Baptist University, as a Research Associate. His current research interests include machine learning, computer vision, image processing, data mining, educational data mining, and adaptive learning.
Wilman W. W. Zou received the B.Sc. degree in mathematics in 2006 and the M.S. degree in applied mathematics in 2008 from Sun Yat-Sen University, Guangzhou, China, and the Ph.D. degree in computer science from Hong Kong Baptist University, Kowloon, Hong Kong, in 2012.
He joined the Institute of Computational Theoretical Studies, Hong Kong Baptist University, as a Research Associate. His current research interests include machine learning, computer vision, image processing, data mining, educational data mining, and adaptive learning.View more

Sun Yat-Sen University, Guangzhou, Guangdong, CN
Jian-Huang Lai (SM'13) received the M.Sc. degree in applied mathematics in 1989 and the Ph.D. degree in mathematics in 1999 from Sun Yat-Sen University, Guangzhou, China.
He joined Sun Yat-Sen University in 1989 as an Assistant Professor. Currently, he is a Professor with the Department of Automation, School of Information Science and Technology, and the Vice Dean of the School of Information Science and Technology. He has published over 100 scientific papers in international journals and conferences on image processing and pattern recognition, e.g., IEEE TRANSACTIONS ON NEURAL NETWORKS, IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS (Part B), Pattern Recognition, ICCV, CVPR and ICDM. His current research interests include digital image processing, pattern recognition, multimedia communication, wavelet, and its applications.
Dr. Lai serves as a Standing Member of the Image and Graphics Association of China and also serves as the Standing Director of the Image and Graphics Association of Guangdong.
Jian-Huang Lai (SM'13) received the M.Sc. degree in applied mathematics in 1989 and the Ph.D. degree in mathematics in 1999 from Sun Yat-Sen University, Guangzhou, China.
He joined Sun Yat-Sen University in 1989 as an Assistant Professor. Currently, he is a Professor with the Department of Automation, School of Information Science and Technology, and the Vice Dean of the School of Information Science and Technology. He has published over 100 scientific papers in international journals and conferences on image processing and pattern recognition, e.g., IEEE TRANSACTIONS ON NEURAL NETWORKS, IEEE TRANSACTIONS ON IMAGE PROCESSING, IEEE TRANSACTIONS ON SYSTEMS, MAN, AND CYBERNETICS (Part B), Pattern Recognition, ICCV, CVPR and ICDM. His current research interests include digital image processing, pattern recognition, multimedia communication, wavelet, and its applications.
Dr. Lai serves as a Standing Member of the Image and Graphics Association of China and also serves as the Standing Director of the Image and Graphics Association of Guangdong.View more