F-divergences driven video key frame extraction

This paper proposes a shot-based key frame selection technique, aiming at generating a condensed set of frames representing the essential content of a video sequence. Inspired by the successful utilization of Jensen-Shannon Divergence (JSD) and Jensen-Rényi Divergence (JRD) for key frame selection [1] [2], we investigate several popularly accepted f-divergences for calculating the frame-by-frame distance to segment the video clip and then to obtain the key frames. Based on simulation and real test videos, the performances of the key frame selection method by using different versions of f-divergences are systematically analyzed. Extensive experimentation shows that, compared with the methods using JSD and JRD, the new technique is slightly better and computationally faster.