A WWW-based intelligent multimedia information query and retrieve system

In this paper, we propose and implement a World Wide Web based video query system: the Intelligent Multimedia Information Processing System (IMIPS). The IMIPS first collects videos available over the WWW, analyzes these videos to extract key frames, and indexes these key frames at a local database. By using the proposed multiple-instance learning algorithm, a user can select a few key frames to train a desired image query model. When a query model is selected, the proposed IMIPS will retrieve matched images from the local database and display them as a small icon at the user interface. A user can then click on the icon to retrieve and play the video from the original Web site. According to the implemented prototype system, a user can find the desired videos on the WWW with only a few (2-3) retraining episodes to achieve a 70% hit rate on 50 retrieved videos among 5 different query models.