Vision-based real-time motion capture system using multiple cameras

In this paper, we discuss a vision-based real-time motion capture system, which is constructed on a PC-cluster. Vision-based motion capture does not impose physical restrictions on humans, which provides a natural way of measuring human motion. However, there are several issues to be solved, which are robust estimation of human motion from a limited number of visual cues and computation cost of the estimation algorithm. To deal with these issues, we have developed multi-view-based algorithms using multiple cameras and have implemented the algorithms on a PC-cluster to solve the computation problem. In this paper, we present our experimental study on vision-based real-time motion capture with emphasis on 3D human posture estimation.