Flexible video coding scheme for content-based video storage and retrieval

In this paper, we proposed a flexible video coding scheme for content-based video storage and retrieval. The proposed flexible video coding scheme applies shot clustering on the uncompressed video in the first pass and encodes the video in multi-clusters based on different video contents in the second pass. The compressed video can be flexibly decoding to meet the different requirements such as video indexing, video summary and structure extraction without fully decoding and re-analyzing. Also the flexible encoder can achieve global coding optimization by encoding similarity video shots continuously. It is very important to reduce the process complexity at the decoder and provide the flexible video content access on the compressed videos in many off-line video storage and retrieval applications. The experiments on sport and film videos illustrate the coding performance increase and the effect of the proposed coding scheme for content-based video storage.