Abstract:A reverse dictionary (RD) is a tool designed to find the appropriate word based on a given definition. While large language models (LLMs) have demonstrated exceptional natural language generation capabilities, offering a promising solution for this task, existing LLMs, particularly those with smaller parameter sizes, still require performance enhancements on RD. Fine-tuning LLMs is a direct method of improvement, but it comes with high computational costs and the potential sacrifice of the LLMs' ability to solve other problems. In contrast, employing prompt engineering to construct high-quality prompts that evoke the latent potential of LLMs on RD is a more ideal approach. To this end, we propose a method of automatically constructing prompts based on a small-scale language model. Our method analyzes definitions across multiple semantic dimensions and introduces negative samples to enhance the model's universality and adaptability. Consequently, our small model can generate a candidate set containing the target word with an accuracy rate of 93.1% . We then use these candidates to form effective prompts for LLMs, significantly improving the performance of larger models. Evaluations on a new dataset from the Oxford dictionary show that our LLMs can directly select the target word with an accuracy of 57.5% , which increases to 73.8% when given five candidate words. Our research not only enhances the performance of LLMs on RD but also provides a new perspective on how small models can augment large models, which is particularly important when computational resources are limited.

Towards Non-Ambiguous Reverse Dictionary

Multi-channel Reverse Dictionary Model.

A Unified Model for Reverse Dictionary and Definition Modelling

RDMTL: Reverse dictionary model based on multitask learning

GEAR: A Simple GENERATE, EMBED, AVERAGE AND RANK Approach for Unsupervised Reverse Dictionary

BERT for Monolingual and Cross-Lingual Reverse Dictionary.

Using Multi-Sense Vector Embeddings for Reverse Dictionaries

Sõnajaht: Definition Embeddings and Semantic Search for Reverse Dictionary Creation

A prompt construction method for the reverse dictionary task of large-scale language models

Creating Reverse Bilingual Dictionaries

WordAlchemy: A transformer-based Reverse Dictionary

Spatial Constrained Hyperspectral Reconstruction From Rgb Inputs Using Dictionary Representation

Reverse Training to Nurse the Reversal Curse

WantWords: an Open-source Online Reverse Dictionary System

On the Tip of the Tongue: Analyzing Conceptual Representation in Large Language Models with Reverse-Dictionary Probe

Reverse Modeling in Large Language Models

LingJing at SemEval-2022 Task 1: Multi-task Self-supervised Pre-training for Multilingual Reverse Dictionary.

Adaptive Dictionary Construction for Hyperspectral Anomaly Detection Based on Collaborative Representation.

Non-negative representation based discriminative dictionary learning for face recognition

DICTDIS: Dictionary Constrained Disambiguation for Improved NMT