A systemic framework of camera motion analysis for home video

A key factor that results in low quality home video is abnormal camera motion, such as camera shaking and irregular camera motion. Those unwanted camera movements make video content analysis more difficult than that in high quality video, because these abnormal motions usually cannot be well handled by traditional camera motion characterization approaches. In this paper, a systemic framework is proposed for camera motion analysis, which is robust to low quality home videos. The main characters of this framework are: (1) it is a qualitative analysis framework for camera motion, which is based on a novel motion representation instead of traditional motion estimation methods; (2) a robust camera shaking detection module is integrated, which effectively improves the accuracy of camera motion characterization and shot boundary detection; (3) all camera motion related issues, including shot boundary detection, in home videos are considered as a whole; (4) due to adopting qualitative motion representation, the processing speed is much faster than real time. Experiment results have shown the efficiency and robustness of the proposed framework.