Abstract:Effective query-item relevance modeling is pivotal for enhancing user experience and safeguarding user satisfaction in e-commerce search systems. Recently, benefiting from the vast inherent knowledge, Large Language Model (LLM) approach demonstrates strong performance and long-tail generalization ability compared with previous neural-based specialized relevance learning methods. Though promising, current LLM-based methods encounter the following inadequacies in practice: First, the massive parameters and computational demands make it difficult to be deployed online. Second, distilling LLM models to online models is a feasible direction, but the LLM relevance modeling is a black box, and its rich intrinsic knowledge is difficult to extract and apply online. To improve the interpretability of LLM and boost the performance of online relevance models via LLM, we propose an Explainable LLM-driven Multi-dimensional Distillation framework for e-commerce relevance learning, which comprises two core components: (1) An Explainable LLM for relevance modeling (ELLM-rele), which decomposes the relevance learning into intermediate steps and models relevance learning as a Chain-of-Thought (CoT) reasoning, thereby enhancing both interpretability and performance of LLM. (2) A Multi-dimensional Knowledge Distillation (MKD) architecture that transfers the knowledge of ELLM-rele to current deployable interaction-based and representation-based student models from both the relevance score distribution and CoT reasoning aspects. Through distilling the probabilistic and CoT reasoning knowledge, MKD improves both the semantic interaction and long-tail generalization abilities of student models. Extensive offline evaluations and online experiments on Taobao search ad scene demonstrate that our proposed framework significantly enhances e-commerce relevance learning performance and user experience.

Towards Better Seach Query Classification with Distribution-Diverse Multi-Expert Knowledge Distillation in JD Ads Search

Towards Better Query Classification with Multi-Expert Knowledge Condensation in JD Ads Search

Improving short text classification using public search engines

BERT2DNN: BERT Distillation with Massive Unlabeled Data for Online E-Commerce Search

Processing Long Queries Against Short Text

Query-Variant Advertisement Text Generation with Association Knowledge

Personalized Attraction Enhanced Sponsored Search with Multi-task Learning

SMAD: <i>S</i>calable <i>Multi</i>-view <i>Ad</i> Retrieval System for E-Commerce Sponsored Search

A Semi-supervised Multi-channel Graph Convolutional Network for Query Classification in E-commerce

Explainable LLM-driven Multi-dimensional Distillation for E-Commerce Relevance Learning

AutoADR: Automatic Model Design for Ad Relevance

DeText: A Deep Text Ranking Framework with BERT

Distilling Knowledge from BERT into Simple Fully Connected Neural Networks for Efficient Vertical Retrieval.

A Multi-Granularity Matching Attention Network for Query Intent Classification in E-commerce Retrieval

Cross-domain knowledge distillation for text classification

LEADRE: Multi-Faceted Knowledge Enhanced LLM Empowered Display Advertisement Recommender System

A Novel Approach to Keyword Extraction for Contextual Advertising

A Dynamic Product-aware Learning Model for E-commerce Query Intent Understanding

Adversarial Self-Supervised Data-Free Distillation for Text Classification

LEAD-ID: Language-Enhanced Denoising and Intent Distinguishing Graph Neural Network for Sponsored Search Broad Retrievals

Adam: Dense Retrieval Distillation with Adaptive Dark Examples