CLICK-IT: interactive television highlighter for sports action replay

CLICK-IT (CSIRO Laboratory for Imaging by Content and Knowledge-Interactive Television) is a PC-based system which provides the user with an intelligent highlighter pen for sports action replay. It is intended as a truly interactive improvement on the drawing pad technology currently used for video annotation in sports broadcasting. The system uses computer vision techniques to focus attention and track particular objects, e.g. player(s) or ball, and semiautomatically annotate the dynamic scene. This paper describes the system including the user interface, the tracking technology based on colour and motion information, and system performance evaluation in applications to running rugby league football, basketball and soccer.