Abstract:Large language models (LLMs) have demonstrated remarkable capabilities in various tasks. However, their suitability for domain-specific tasks, is limited due to their immense scale at deployment, susceptibility to misinformation, and more importantly, high data annotation costs. We propose a novel Interactive Multi-Fidelity Learning (IMFL) framework for the cost-effective development of small domain-specific LMs under limited annotation budgets. Our approach formulates the domain-specific fine-tuning process as a multi-fidelity learning problem, focusing on identifying the optimal acquisition strategy that balances between low-fidelity automatic LLM annotations and high-fidelity human annotations to maximize model performance. We further propose an exploration-exploitation query strategy that enhances annotation diversity and informativeness, incorporating two innovative designs: 1) prompt retrieval that selects in-context examples from human-annotated samples to improve LLM annotation, and 2) variable batch size that controls the order for choosing each fidelity to facilitate knowledge distillation, ultimately enhancing annotation quality. Extensive experiments on financial and medical tasks demonstrate that IMFL achieves superior performance compared with single fidelity annotations. Given a limited budget of human annotation, IMFL significantly outperforms the human annotation baselines in all four tasks and achieves very close performance as human annotations on two of the tasks. These promising results suggest that the high human annotation costs in domain-specific tasks can be significantly reduced by employing IMFL, which utilizes fewer human annotations, supplemented with cheaper and faster LLM (e.g., GPT-3.5) annotations to achieve comparable performance.

SLIM: Spuriousness Mitigation with Minimal Human Annotations

Less Learn Shortcut: Analyzing and Mitigating Learning of Spurious Feature-Label Correlation

Discover and Cure: Concept-aware Mitigation of Spurious Correlation

Learning Robust Classifiers with Self-Guided Spurious Correlation Mitigation

Spuriousness-Aware Meta-Learning for Learning Robust Classifiers

No More Distractions: an Adaptive Up-Sampling Algorithm to Reduce Data Artifacts

Robustness to Spurious Correlations via Human Annotations

Mitigating Spurious Correlations in Multi-modal Models during Fine-tuning

Exploring LLMs as a Source of Targeted Synthetic Textual Data to Minimize High Confidence Misclassifications

MM-SpuBench: Towards Better Understanding of Spurious Biases in Multimodal LLMs

SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detection

Spurious Feature Eraser: Stabilizing Test-Time Adaptation for Vision-Language Foundation Model

Mitigating Shortcuts in Language Models with Soft Label Encoding

Avoiding spurious correlations via logit correction

Label-aware Debiased Causal Reasoning for Natural Language Inference

Out of spuriousity: Improving robustness to spurious correlations without group annotations

SparseDet: Improving Sparsely Annotated Object Detection with Pseudo-positive Mining

Interactive Multi-fidelity Learning for Cost-effective Adaptation of Language Model with Sparse Human Supervision

Leveraging saliency priors and explanations for enhanced consistent interpretability

Towards Mitigating more Challenging Spurious Correlations: A Benchmark & New Datasets