Abstract:Large language models (LLMs) have achieved impressive success in text-formatted learning problems, and most popular LLMs have been deployed in a black-box fashion. Meanwhile, fine-tuning is usually necessary for a specific downstream task to obtain better performance, and this functionality is provided by the owners of the black-box LLMs. To fine-tune a black-box LLM, labeled data are always required to adjust the model parameters. However, in many real-world applications, LLMs can label textual datasets with even better quality than skilled human annotators, motivating us to explore the possibility of fine-tuning black-box LLMs with unlabeled data. In this paper, we propose unsupervised prompt learning for classification with black-box LLMs, where the learning parameters are the prompt itself and the pseudo labels of unlabeled data. Specifically, the prompt is modeled as a sequence of discrete tokens, and every token has its own to-be-learned categorical distribution. On the other hand, for learning the pseudo labels, we are the first to consider the in-context learning (ICL) capabilities of LLMs: we first identify reliable pseudo-labeled data using the LLM, and then assign pseudo labels to other unlabeled data based on the prompt, allowing the pseudo-labeled data to serve as in-context demonstrations alongside the prompt. Those in-context demonstrations matter: previously, they are involved when the prompt is used for prediction while they are not involved when the prompt is trained; thus, taking them into account during training makes the prompt-learning and prompt-using stages more consistent. Experiments on benchmark datasets show the effectiveness of our proposed algorithm. After unsupervised prompt learning, we can use the pseudo-labeled dataset for further fine-tuning by the owners of the black-box LLMs.

Automatic Multi-Label Prompting: Simple and Interpretable Few-Shot Classification

Prompt-Based Label-Aware Framework for Few-Shot Multi-Label Text Classification

STPrompt: Semantic-guided and Task-driven prompts for Effective Few-shot Classification

Prompt-Based Meta-Learning for Few-shot Text Classification.

Multi-Mask Label Mapping for Prompt-Based Learning.

Knowledge-Guided Prompt Learning for Few-Shot Text Classification

PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners

Prompt Expending for Single Positive Multi-Label Learning with Global Unannotated Categories

Dynamic Prompt Adjustment for Multi-Label Class-Incremental Learning

Label-Guided Prompt for Multi-label Few-shot Aspect Category Detection

Label prompt for multi-label text classification

On Unsupervised Prompt Learning for Classification with Black-box Language Models

Retrieval-Enhanced Visual Prompt Learning for Few-shot Classification

LAMM: Label Alignment for Multi-Modal Prompt Learning

Towards Unified Prompt Tuning for Few-shot Text Classification

Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models.

Helping Language Models Learn More: Multi-dimensional Task Prompt for Few-shot Tuning

Hierarchical Prompt Learning Using CLIP for Multi-label Classification with Single Positive Labels

StablePT: Towards Stable Prompting for Few-shot Learning via Input Separation

TransPrompt - Towards an Automatic Transferable Prompting Framework for Few-shot Text Classification.

Unified Prompt Learning Makes Pre-Trained Language Models Better Few-Shot Learners