By Topic

On-line human action recognition by combining joint tracking and key pose recognition

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
E-Jui Weng ; Dept. of Comput. Sci. & Inf. Eng., Nat. Taiwan Univ., Taipei, Taiwan ; Li-Chen Fu

In this paper, we present a boosting approach by combining the pose estimation and the upper body tracking to on-line recognize human actions. Instead of using a predefined pose to initialize the human skeleton, we construct a key poses database with depth HOG features as searching indexes. When user enters the camera view, we automatically search the database to get the initial skeleton. Then we use the particle filter to track human upper body parts. At the same time, we feed the tracking joints into the hidden Markov models to on-line spot and recognize the performed action. In order to rectify tracking errors, we apply the action recognition results and reuse our key poses database to reinforce the tracking process. Our contributions of the proposed approach are three-fold. First, our method can recognize human poses and actions at the same time. Second, with the key poses database and action recognition results as the feedback, the tracking process becomes more efficient and accurate. Third, we propose a spotting method based on the gradient of HMM probabilities, which thus enables our method to achieve on-line spotting and recognition. Experimental results demonstrate the effectiveness of the proposed approach.

Published in:

Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on

Date of Conference:

7-12 Oct. 2012