By Topic

Automatic face modeling from monocular image sequences using modified non parametric regression and an affine camera model

Sign In

Cookies must be enabled to login.After enabling cookies , please use refresh or reload or ctrl+f5 on the browser for the login options.

Formats Non-Member Member
$31 $13
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, eBooks, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

4 Author(s)
Sengupta, K. ; Dept. of Electr. Eng., Nat. Univ. of Singapore, Singapore ; Wang Shiqin ; Ko, C.C. ; Burman, P.

We present the theory of modified nonparametric regression for estimating the 3D face structure of a human from a monocular image sequence. In the preprocessing stage, the face region is segmented from the background using both color and motion information, by using a hierarchical block motion estimation method. By using the affine camera projection geometry, and a given choice of an image frame pair in the sequence, we adopt the KvD model to express the depth at each point on the face region as a function of the unknown out-of-plane rotation, and some measurable quantities computed directly from the optical flow. This is repeated for multiple image pairs (keeping one fixed image frame which we formally call the “base” image, and choosing another frame from the sequence). The true depth map is next estimated from these equations using a modified nonparametric regression technique, and this forms the core contribution of this paper. We conducted experiments on various image sequences to verify the effectiveness of the technique, and propose to extend it for photorealistic modeling of arbitrary (non-face) objects from image sequences

Published in:

Automatic Face and Gesture Recognition, 2000. Proceedings. Fourth IEEE International Conference on

Date of Conference:

2000