Abstract:Benefiting from the strong reasoning capabilities, Large language models (LLMs) have demonstrated remarkable performance in recommender systems. Various efforts have been made to distill knowledge from LLMs to enhance collaborative models, employing techniques like contrastive learning for representation alignment. In this work, we prove that directly aligning the representations of LLMs and collaborative models is sub-optimal for enhancing downstream recommendation tasks performance, based on the information theorem. Consequently, the challenge of effectively aligning semantic representations between collaborative models and LLMs remains unresolved. Inspired by this viewpoint, we propose a novel plug-and-play alignment framework for LLMs and collaborative models. Specifically, we first disentangle the latent representations of both LLMs and collaborative models into specific and shared components via projection layers and representation regularization. Subsequently, we perform both global and local structure alignment on the shared representations to facilitate knowledge transfer. Additionally, we theoretically prove that the specific and shared representations contain more pertinent and less irrelevant information, which can enhance the effectiveness of downstream recommendation tasks. Extensive experimental results on benchmark datasets demonstrate that our method is superior to existing state-of-the-art algorithms.

Search for Discriminative Word Alignment via Dual Decomposition

Search for Discriminative Word Alignment via Dual Decomposition

Discriminative Word Alignment by Linear Modeling

Discriminative Word Alignment over Multiple Word Segmentations

Consistency-Aware Search for Word Alignment.

Alignment-Aware Word Distance.

Word Alignment by Fine-tuning Embeddings on Parallel Corpora

Combining Multiple Alignments to Improve Machine Translation.

Research of English-Chinese Alignment at Word Granularity on Parallel Corpora

BinaryAlign: Word Alignment as Binary Sequence Labeling

Word Alignment Combination over Multiple Word Segmentation

Diversify and Combine: Improving Word Alignment for Machine Translation on Low-Resource Languages.

Improving Word Alignment by Semi-Supervised Ensemble.

A Beam Search Algorithm for ITG Word Alignment.

Word Alignment in the Era of Deep Learning: A Tutorial

Improving Statistical Word Alignment with Various Clues.

Optimizing Word Alignment Combination for Phrase Table Training

TsinghuaAligner: A Statistical Bilingual Word Alignment System

: Improving Domain-Specific Word Alignment with a General Bilingual Corpus

DaRec: A Disentangled Alignment Framework for Large Language Model and Recommender System

Improving domain-specific word alignment for computer assisted translation