Video bookmark based on soundtrack identification and two-stage search for interactive-television

This paper presents a video retrieval system (VRS) for Interactive-Television as like internet protocol television (IPTV). A video bookmark initiated by users is performed based on snippets of the background soundtrack corresponding to the ongoing program. Our VRS has two special aspects compared with previous bookmark systems. First, we adopt the robust audio fingerprint feature of long-term logarithmic modified DCT modulation coefficients (LMDCT-MC) for audio indexing and retrieval. Second, we propose and apply a two-stage search (TSS) algorithm for fast searching. In the first stage of TSS, candidate video segments are roughly determined with audio index bit vectors (IBV) and then the optimal video clip is obtained by fingerprint bit vectors (FBV). We evaluate the proposed system with a database of 100 TV programs including news, panel discussions, music shows, advertisements, and dramas. The experimental results show that our VRS achieve fast search, robustness to noise and high precision of retrieval. A search accuracy of 99.67% was accomplished.