Research on multimedia ontology bridging “semantic gap” between perceivable world and conceptual world

The producers and customers have difficulties in organizing, finding, retrieving and accessing ‘right’ media info, reasons for this problem stem from a lack of interoperability and semantic metadata share between several applications for multimedia processing and understanding. Thus, it is necessary to design a set of media info understanding-oriented MultiMedia Ontology (MMO). In order to effectively solve the problem of “semantic gap” between perceivable media world and high-level conceptual world, a novel method of semantic-layering and semantic-abstracting step by step is adopted, viz. the abstract from primary perceptive level to high-level perceptive level by various perceptual components and the abstract from high-level perceptive level to high-level conceptual level by mathematical model such as Hierarchical Hidden Markov Model (HHMM). MMO is designed by re-engineering MPEG-7 with OWL DL rules, which includes core ontology, media ontology and domain ontology, the reason for such design is to be convenient to adopt existing ontology(such as MPEG-7 and DOLCE) and easy to be extended and reused. A use case of semantic-abstracting and semantic-annotating is showed to testify the effect of MMO.