Abstract:Semantic identifier (ID) is an important concept in information retrieval that aims to preserve the semantics of objects such as documents and items inside their IDs. Previous studies typically adopt a two-stage pipeline to learn semantic IDs by first procuring embeddings using off-the-shelf text encoders and then deriving IDs based on the embeddings. However, each step introduces potential information loss, and there is usually an inherent mismatch between the distribution of embeddings within the latent space produced by text encoders and the anticipated distribution required for semantic indexing. It is non-trivial to design a method that can learn the document's semantic representations and its hierarchical structure simultaneously, given that semantic IDs are discrete and sequentially structured, and the semantic supervision is deficient. In this paper, we introduce LMIndexer, a self-supervised framework to learn semantic IDs with a generative language model. We tackle the challenge of sequential discrete ID by introducing a semantic indexer capable of generating neural sequential discrete representations with progressive training and contrastive learning. In response to the semantic supervision deficiency, we propose to train the model with a self-supervised document reconstruction objective. We show the high quality of the learned IDs and demonstrate their effectiveness on three tasks including recommendation, product search, and document retrieval on five datasets from various domains. Code is available at <a class="link-external link-https" href="https://github.com/PeterGriffinJin/LMIndexer" rel="external noopener nofollow">this https URL</a>.

Semantic Indexing with Deep Learning: a Case Study

Semantic Image Retrieval Based on Multiple-Instance Learning

Biomedical Literature Classification With A Cnns-Based Hybrid Learning Network

Deep Learning for Content-Based Image Retrieval: A Comprehensive Study

A novel serial deep multi-task learning model for large scale biomedical semantic indexing

Developing a More Accurate Biomedical Literature Retrieval Method using Deep Learning and Citations in PubMed Central Full-text Articles

A Brief Survey on Semantic Segmentation with Deep Learning

Medical Image Semantic Segmentation Based on Deep Learning

Leveraging Semantic and Lexical Matching to Improve the Recall of Document Retrieval Systems: A Hybrid Approach

Modeling Image Data for Effective Indexing and Retrieval in Large General Image Databases.

Research on Cross-media Semantic Retrieval Methods of Information Resources Based on Deep Learning.

Using Deep Learning for Content-Based Medical Image Retrieval

Recent advances and clinical applications of deep learning in medical image analysis

A Survey of Image Semantic Segmentation Algorithm Based on Deep Learning

Semantic Retrieval Based on Shallow Semantic Analysis Technology

DeepMeSH: Deep Semantic Representation for Improving Large-Scale MeSH Indexing.

Deepindex For Accurate And Efficient Image Retrieval

Deep Learning Based Semantic Video Indexing and Retrieval

Deep Image Retrieval: A Survey

Deep Semantic Indexing Using Convolutional Localization Network with Region-Based Visual Attention for Image Database.

Language Models As Semantic Indexers