Abstract:The cultivation of expertise for large language models (LLMs) to solve tasks of specific areas often requires special-purpose tuning with calibrated behaviors on the expected stable outputs. To avoid huge cost brought by manual preparation of instruction datasets and training resources up to hundreds of hours, the exploitation of open knowledge including a wealth of low rank adaptation (LoRA) models and instruction datasets serves as a good starting point. However, existing methods on model and data selection focus on the performance of general-purpose capabilities while neglecting the knowledge gap exposed in domain-specific deployment. In the present study, we propose to bridge such gap by introducing few human-annotated samples (i.e., K-shot) for advancing task expertise of LLMs with open knowledge. Specifically, we develop an efficient and scalable pipeline to cost-efficiently produce task experts where K-shot data intervene in selecting the most promising expert candidates and the task-relevant instructions. A mixture-of-expert (MoE) system is built to make the best use of individual-yet-complementary knowledge between multiple experts. We unveil the two keys to the success of a MoE system, 1) the abidance by K-shot, and 2) the insistence on diversity. For the former, we ensure that models that truly possess problem-solving abilities on K-shot are selected rather than those blind guessers. Besides, during data selection, instructions that share task-relevant contexts with K-shot are prioritized. For the latter, we highlight the diversity of constituting experts and that of the fine-tuning instructions throughout the model and data selection process. Extensive experimental results confirm the superiority of our approach over existing methods on utilization of open knowledge across various tasks. Codes and models will be released later.

ProfLLM: A Framework for Adapting Offline Large Language Models to Few-Shot Expert Knowledge

Supervised Knowledge Makes Large Language Models Better In-context Learners

Leveraging Open Knowledge for Advancing Task Expertise in Large Language Models

Large Language Models with Controllable Working Memory

Lifelong Language Pretraining with Distribution-Specialized Experts

Augmented Large Language Models with Parametric Knowledge Guiding

FedMKT: Federated Mutual Knowledge Transfer for Large and Small Language Models

General LLMs as Instructors for Domain-Specific LLMs: A Sequential Fusion Method to Integrate Extraction and Editing

Small LLMs Are Weak Tool Learners: A Multi-LLM Agent

Time-LLM: Time Series Forecasting by Reprogramming Large Language Models

Online Continual Knowledge Learning for Language Models

BLADE: Enhancing Black-box Large Language Models with Small Domain-Specific Models

TL-Training: A Task-Feature-Based Framework for Training Large Language Models in Tool Use

Online Training of Large Language Models: Learn while chatting

LLM-Neo: Parameter Efficient Knowledge Distillation for Large Language Models

Efficient Few-Shot Clinical Task Adaptation with Large Language Models

FedCoLLM: A Parameter-Efficient Federated Co-tuning Framework for Large and Small Language Models

Mutual Enhancement of Large and Small Language Models with Cross-Silo Knowledge Transfer

Getting More from Less: Large Language Models are Good Spontaneous Multilingual Learners

Lens: Rethinking Multilingual Enhancement for Large Language Models