Multimedia information retrieval using content-based image retrieval and context link for Chinese cultural artifacts

Chung-Ming Lo
DOI: https://doi.org/10.1108/lht-10-2022-0500
2024-01-25
Library Hi Tech
Abstract:Purpose An increasing number of images are generated daily, and images are gradually becoming a search target. Content-based image retrieval (CBIR) is helpful for users to express their requirements using an image query. Nevertheless, determining whether the retrieval system can provide convenient operation and relevant retrieval results is challenging. A CBIR system based on deep learning features was proposed in this study to effectively search and navigate images in digital articles. Design/methodology/approach Convolutional neural networks (CNNs) were used as the feature extractors in the author's experiments. Using pretrained parameters, the training time and retrieval time were reduced. Different CNN features were extracted from the constructed image databases consisting of images taken from the National Palace Museum Journals Archive and were compared in the CBIR system. Findings DenseNet201 achieved the best performance, with a top-10 mAP of 89% and a query time of 0.14 s. Practical implications The CBIR homepage displayed image categories showing the content of the database and provided the default query images. After retrieval, the result showed the metadata of the retrieved images and links back to the original pages. Originality/value With the interface and retrieval demonstration, a novel image-based reading mode can be established via the CBIR and links to the original images and contextual descriptions.
information science & library science
What problem does this paper attempt to address?