A MULTI-CHANNEL RETRIEVAL SYSTEM FOR MULTIMEDIA DOCUMENTS

Wang Yanyun,Liu Xiang,Wu Fei
DOI: https://doi.org/10.3969/j.issn.1000-386X.2009.07.004
2009-01-01
Abstract:A multi-channel,corresponding to multiple modals,e.g.text,image,video,etc.,retrieval system for multimedia documents is proposed and implemented.A novel framework model is defined in system to describe the contents of multimedia documents.In the framework,content-based bottom features in each channel extracted from multimedia documents and the links between multimedia objects of multimedia documents are both recorded.Moreover,a graph model-based cross-reference knowledge base is proposed to store the semantic relation between multimedia objects mined from link relations.A valid algorithm for semantic context analysis is proposed to calculate the semantic similarity between each object and query when retrieving.The algorithm not only endues content-based multimedia information retrieval method with semantic information of multimedia objects,but also provides a flexible query model,which enables a user to interact with the system through channel exchange and relevance feedback.It is demonstrated in the experiments that the retrieval performance(e.g.the content coverage rate) for multimedia objects in the proposed multi-channel retrieval system is much better than that of a system with conventional content-based retrieval methods.
What problem does this paper attempt to address?