Abstract:Most large language models (LLMs), especially chat models, do not undergo updates post-deployment, which results in a lack of awareness of constantly changing new real-time information. External knowledge retrieval methods exist to enhance these models, but for high-traffic chat models, the extensive use of search engine API resources can be costly. In our work, we study the performance of LLMs in answering tasks involving real-time factual knowledge. Due to the lack of datasets for Q&A involving the latest real-time information, we first carefully constructed NewlyQA, a new dynamic QA benchmark including questions about world knowledge whose answers evolve over time. Inspired by human learning methods, we propose FastLearn, a simple rapid learning method that enhances model responses by merging relevant, up-to-date information retrieved from search engine APIs (filtered through our Time-Prompt mechanism) into prompts, followed by Lora fine-tuning to “inject” new knowledge into LLMs via external parameters, significantly improving performance on FreshQA, NewlyQA and OpenDataEval. Our experiments show that FastLearn outperforms most other search engine augmented prompt methods, like FreshPrompt, Self-Ask, and the commercial PERPLEXITY.AI. Additionally, we further analyze the two main mechanisms of FastLearn, Time-Prompt and Self-Correction, finding that both play key roles in enhancing model answer performance. To facilitate future research, we will open-source NewlyQA and commit to regularly updating its answers.

Prompt Learning for Few-Shot Question Answering Via Self-Context Data Augmentation

MinPrompt: Graph-based Minimal Prompt Data Augmentation for Few-shot Question Answering

Prompting-based Synthetic Data Generation for Few-Shot Question Answering

Gotta: Generative Few-shot Question Answering by Prompt-based Cloze Data Augmentation

Adversarial Knowledge Stimulated Contrastive Prompting for Few-shot Language Learners

KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering

PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners

QaNER: Prompting Question Answering Models for Few-shot Named Entity Recognition

Improving Low-resource Question Answering by Augmenting Question Information

Unified Prompt Learning Makes Pre-Trained Language Models Better Few-Shot Learners

Few-shot Unified Question Answering: Tuning Models or Prompts?

Adaptive Prompt Learning-Based Few-Shot Sentiment Analysis

FastLearn: A Rapid Learning Agent for Chat Models to Acquire Latest Knowledge

Ontology-enhanced Prompt-tuning for Few-shot Learning

LM-CPPF: Paraphrasing-Guided Data Augmentation for Contrastive Prompt-Based Few-Shot Fine-Tuning

Few-Shot Data Synthesis for Open Domain Multi-Hop Question Answering

Prompt Based CVAE Data Augmentation for Few-Shot Intention Detection

Revisiting Self-Training for Few-Shot Learning of Language Model

Response Generation with Context-Aware Prompt Learning

Towards Unified Prompt Tuning for Few-shot Text Classification

Self-Prompting Large Language Models for Zero-Shot Open-Domain QA