Building virtual human body from video

We present a mode-based analysis and synthesis of human body images. First, we estimate the current 3D pose of a human figure by using the spatio-temporal analysis with kinematic constraints. Then, we store the intensity images of the human body as textures of the 3D body model. Such a human model can be used to generate multiple-views, merge virtual objects, and change motion characteristics of human figures in video.