By Topic

Functional categorization of objects using real-time markerless motion capture

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

3 Author(s)
Gall, J. ; BIWI, ETH Zurich, Zurich, Swaziland ; Fossati, A. ; Van Gool, L.

Unsupervised categorization of objects is a fundamental problem in computer vision. While appearance-based methods have become popular recently, other important cues like functionality are largely neglected. Motivated by psycho logical studies giving evidence that human demonstration has a facilitative effect on categorization in infancy, we pro pose an approach for object categorization from depth video streams. To this end, we have developed a method for cap turing human motion in real-time. The captured data is then used to temporally segment the depth streams into actions. The set of segmented actions are then categorized in an un supervised manner, through a novel descriptor for motion capture data that is robust to subject variations. Further more, we automatically localize the object that is manipulated within a video segment, and categorize it using the corresponding action. For evaluation, we have recorded a dataset that comprises depth data with registered video sequences for 6 subjects, 13 action classes, and 174 object manipulations.

Published in:

Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on

Date of Conference:

20-25 June 2011