Abstract:Generative recommendation systems, driven by large language models (LLMs), present an innovative approach to predicting user preferences by modeling items as token sequences and generating recommendations in a generative manner. A critical challenge in this approach is the effective tokenization of items, ensuring that they are represented in a form compatible with LLMs. Current item tokenization methods include using text descriptions, numerical strings, or sequences of discrete tokens. While text-based representations integrate seamlessly with LLM tokenization, they are often too lengthy, leading to inefficiencies and complicating accurate generation. Numerical strings, while concise, lack semantic depth and fail to capture meaningful item relationships. Tokenizing items as sequences of newly defined tokens has gained traction, but it often requires external models or algorithms for token assignment. These external processes may not align with the LLM's internal pretrained tokenization schema, leading to inconsistencies and reduced model performance. To address these limitations, we propose a self-improving item tokenization method that allows the LLM to refine its own item tokenizations during training process. Our approach starts with item tokenizations generated by any external model and periodically adjusts these tokenizations based on the LLM's learned patterns. Such alignment process ensures consistency between the tokenization and the LLM's internal understanding of the items, leading to more accurate recommendations. Furthermore, our method is simple to implement and can be integrated as a plug-and-play enhancement into existing generative recommendation systems. Experimental results on multiple datasets and using various initial tokenization strategies demonstrate the effectiveness of our method, with an average improvement of 8\% in recommendation performance.

Token-Level Self-Evolution Training for Sequence-to-Sequence Learning

Self-Evolution Learning for Discriminative Language Model Pretraining.

Self-Evolution Fine-Tuning for Policy Optimization

Better Simultaneous Translation with Monotonic Knowledge Distillation.

Self-Evolution Learning for Mixup: Enhance Data Augmentation on Few-Shot Text Classification Tasks

E2S2: Encoding-Enhanced Sequence-to-Sequence Pretraining for Language Understanding and Generation

Self-Evolution Knowledge Distillation for LLM-based Machine Translation

Less is More: Pre-training a Strong Siamese Encoder Using a Weak Decoder

Training With Additional Semantic Constraints For Enhancing Neural Machine Translation

SemiEvol: Semi-supervised Fine-tuning for LLM Adaptation

Token-Level Fitting Issues of Seq2seq Models

Enhancing Item Tokenization for Generative Recommendation through Self-Improvement

Leveraging Relaxed Equilibrium by Lazy Transition for Sequence Modeling

SELF: Self-Evolution with Language Feedback

Evolving Subnetwork Training for Large Language Models

Sustainable Self-evolution Adversarial Training

MetaRL-SE: a few-shot speech enhancement method based on meta-reinforcement learning

Bridging the Training-Inference Gap in LLMs by Leveraging Self-Generated Tokens

Interactive Evolution: A Neural-Symbolic Self-Training Framework For Large Language Models

STRA: A Simple Token Replacement Strategy Alleviating Exposure Bias in Text Generation

Self-attention Mechanism at the Token Level: Gradient Analysis and Algorithm Optimization.