By Topic

Towards recognition of facial expressions in sign language: Tracking facial features under occlusion

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

2 Author(s)
Tan Dat Nguyen ; Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore ; Surendra Ranganath

Deaf people use facial expressions as a non-manual channel for conveying grammatical information in sign language. Tracking facial features using the Kanade-Lucas-Tomasi (KLT) algorithm is a simple and effective method toward recognizing these facial expressions, which are performed simultaneously with head motions and hand signs. To make the tracker robust under these conditions, a Bayesian framework was developed as a feedback mechanism to the KLT tracker. This mechanism relies on a set of face shape sub-spaces learned by probabilistic principal component analysis. An update scheme was utilized to modify these subspaces and adapt to persons with different face shapes. The result shows that the proposed system can track facial features with large head motions, substantial facial deformations, and temporary face occlusions by hand.

Published in:

Image Processing, 2008. ICIP 2008. 15th IEEE International Conference on

Date of Conference:

12-15 Oct. 2008