Video Browser Showdown 2012-2019: A Review

The Video Browser Showdown (VBS) is a challenging video retrieval competition annually performed at the International Conference on MultiMedia Modeling (MMM). This paper presents a review of all eight years of the VBS performed so far – as a summary of the keynote presented at CBMI 2019. It discusses the different types of tasks and sessions, provides an overview of the datasets and participating teams, and it gives some insights on the setup and evaluation procedure. It also evaluates the progress made over the last few years in terms of average task solve time and task solve ratio.