Automatic indexing of broadcast content using its live chat on the Web

A method of automatically indexing broadcast content using live chat on the Web is proposed. The live chat is a Web bulletin board where the viewers post messages in sync with a TV program. Statistical analysis and pattern recognition of these messages can effectively extract metadata related to viewer's viewpoints such as important scenes in the program or responses by a particular viewer. Preliminary experiments indicate that the proposed method can efficiently extract metadata such as the intensity of viewers' responses and degree of emotional delight or depression. They also indicate that a prototype TV viewing system using the extracted metadata enables a new way of viewing TV content from different perspectives reflecting viewers' viewpoints.