Video abstraction via learning the progress of story

In this paper, we incorporate script into movie content analysis and present a novel movie abstraction approach via the progress of storyline, which is validated by film production theory that film actually catches audiences' attention is the storyline. We first segment scenes by analysis and alignment of script and movie. Then we conduct storyline analysis based on the content attention analysis and audio-visual features. Given obtained transition intensity values, we calculate storyline progress score and adopt this as criterion to generate movie abstraction. The promising experimental results demonstrate that storyline analysis is effective for movie abstraction and movie content understanding.