Abstract:The emergence of Large Language Models (LLMs) has achieved tremendous success in the field of Natural Language Processing owing to diverse training paradigms that empower LLMs to effectively capture intricate linguistic patterns and semantic representations. In particular, the recent "pre-train, prompt and predict" training paradigm has attracted significant attention as an approach for learning generalizable models with limited labeled data. In line with this advancement, these training paradigms have recently been adapted to the recommendation domain and are seen as a promising direction in both academia and industry. This half-day tutorial aims to provide a thorough understanding of extracting and transferring knowledge from pre-trained models learned through different training paradigms to improve recommender systems from various perspectives, such as generality, sparsity, effectiveness and trustworthiness. In this tutorial, we first introduce the basic concepts and a generic architecture of the language modeling paradigm for recommendation purposes. Then, we focus on recent advancements in adapting LLM-related training strategies and optimization objectives for different recommendation tasks. After that, we will systematically introduce ethical issues in LLM-based recommender systems and discuss possible approaches to assessing and mitigating them. We will also summarize the relevant datasets, evaluation metrics, and an empirical study on the recommendation performance of training paradigms. Finally, we will conclude the tutorial with a discussion of open challenges and future directions.

The Interplay between Lexical Resources and Natural Language Processing

Connecting Ideas in 'Lower-Resource' Scenarios: NLP for National Varieties, Creoles and Other Low-resource Scenarios

Some Ideas on Natural Language Processing

The Best of Both Worlds: Lexical Resources To Improve Low-Resource Part-of-Speech Tagging

Exploring the Landscape of Natural Language Processing Research

Challenges and Strategies in Cross-Cultural NLP

TutorialBank: A Manually-Collected Corpus for Prerequisite Chains, Survey Extraction and Resource Recommendation

Unnatural Language Processing: Bridging the Gap Between Synthetic and Natural Language Data

Progress in the Application of Natural Language Processing to Information Retrieval Tasks

Natural Language Processing RELIES on Linguistics

Exploring Interdisciplinary Team Collaboration in Clinical NLP Projects Through the Lens of Activity Theory

Putting Natural in Natural Language Processing

Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction

Application of Natural Language Processing Technology in Educational Resources Retrieval

Natural Language Processing: A Historical Review

The Coonstruction and Utilization of A Comprehensive Language Knowledge-base

Understanding Language Modeling Paradigm Adaptations in Recommender Systems: Lessons Learned and Open Challenges

Deep Learning and Machine Learning -- Natural Language Processing: From Theory to Application

Language Resources in Spanish for Automatic Text Simplification across Domains

NLPIR: A theoretical framework for applying natural language processing to information retrieval

Memory-Based Lexical Acquisition and Processing