Abstract:Leveraging generative retrieval (GR) techniques to enhance search systems is an emerging methodology that has shown promising results in recent years. In GR, a text-to-text model maps string queries directly to relevant document identifiers (docIDs), dramatically simplifying the retrieval process. However, when applying most GR models in large-scale E-commerce for personalized item search, we must face two key problems in encoding and decoding. (1) Existing docID generation methods ignore the encoding of efficiency information, which is critical in E-commerce. (2) The positional information is important in decoding docIDs, while prior studies have not adequately discriminated the significance of positional information or well exploited the inherent interrelation among these positions. To overcome these problems, we introduce an efficient Hierarchical encoding-decoding Generative retrieval method (Hi-Gen) for large-scale personalized E-commerce search systems. Specifically, we first design a representation learning model using metric learning to learn discriminative feature representations of items to capture semantic relevance and efficiency information. Then, we propose a category-guided hierarchical clustering scheme that makes full use of the semantic and efficiency information of items to facilitate docID generation. Finally, we design a position-aware loss to discriminate the importance of positions and mine the inherent interrelation between different tokens at the same position. This loss boosts the performance of the language model used in the decoding stage. Besides, we propose two variants of Hi-Gen (Hi-Gen-I2I and Hi-Gen-Cluster) to support online real-time large-scale recall in the online serving process. Hi-Gen gets 3.30% and 4.62% improvements over SOTA for Recall@1 on the public and industry datasets, respectively.

LLMGR: Large Language Model-based Generative Retrieval in Alipay Search

Know where to go: Make LLM a relevant, responsible, and trustworthy searchers

Know Where to Go: Make LLM a Relevant, Responsible, and Trustworthy Searcher

Generative Retrieval with Preference Optimization for E-commerce Search

Hi-Gen: Generative Retrieval For Large-Scale Personalized E-commerce Search

Leveraging Large Language Models to Enhance Personalized Recommendations in E-commerce

Large Language Models are Built-in Autoregressive Search Engines

Zero-Indexing Internet Search Augmented Generation for Large Language Models

Learning to Rank in Generative Retrieval

Differentiable Retrieval Augmentation via Generative Language Modeling for E-commerce Query Intent Classification

LEAD-ID: Language-Enhanced Denoising and Intent Distinguishing Graph Neural Network for Sponsored Search Broad Retrievals

ProphetNet-Ads: A Looking Ahead Strategy for Generative Retrieval Models in Sponsored Search Engine

WeKnow-RAG: An Adaptive Approach for Retrieval-Augmented Generation Integrating Web Search and Knowledge Graphs

ScalingNote: Scaling up Retrievers with Large Language Models for Real-World Dense Retrieval

GenRec: Large Language Model for Generative Recommendation

Large Language Model based Long-tail Query Rewriting in Taobao Search

Embedding-based Product Retrieval in Taobao Search

Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents

List-aware Reranking-Truncation Joint Model for Search and Retrieval-augmented Generation

Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy