Abstract:With the rapid spread of information, abbreviations are used more and more common because they are convenient. However, the duplication of abbreviations can lead to confusion in many cases, such as information management and information retrieval. The resultant confusion annoys users. Thus, inferring a full name from an abbreviation has practical and significant advantages. The bulk of studies in the literature mainly inferred full names based on rule-based methods, statistical models, the similarity of representation, etc. However, these methods are unable to use various grained contexts properly. In this paper, we propose a flexible framework of Multi-attention mask Abbreviation Context and Full name language model, named MACF to address the problem. With the abbreviation and contexts as the inputs, the MACF can automatically predict a full name by generation, where the contexts can be variously grained. That is, different grained contexts ranging from coarse to fine can be selected to perform such complicated tasks in which contexts include paragraphs, several sentences, or even just a few keywords. A novel multi-attention mask mechanism is also proposed, which allows the model to learn the relationships among abbreviations, contexts, and full names, a process that makes the most of various grained contexts. The three corpora of different languages and fields were analyzed and measured with seven metrics in various aspects to evaluate the proposed framework. According to the experimental results, the MACF yielded more significant and consistent outputs than other baseline methods. Moreover, we discuss the significance and findings, and give the case studies to show the performance in real applications.

Abbreviation Prediction Using Conditional Random Field and Web Data

Generalized Abbreviation Prediction with Negative Full Forms and Its Application on Improving Chinese Web Search

Coarse-grained Candidate Generation and Fine-grained Re-ranking for Chinese Abbreviation Prediction.

Enhancing Chinese abbreviation prediction with LLM generation and contrastive evaluation

Predicting Chinese Abbreviations from Definitions: an Empirical Learning Approach Using Support Vector Regression.

A Sequence-to-Sequence Model for Large-scale Chinese Abbreviation Database Construction.

Predicting Chinese Abbreviations with Minimum Semantic Unit and Global Constraints.

A Context-Enhanced Generate-then-Evaluate Framework for Chinese Abbreviation Prediction

Generating Abbreviations for Chinese Named Entities Using Recurrent Neural Network with Dynamic Dictionary

A transformer-based neural network framework for full names prediction with abbreviations and contexts

A Context-Enhanced Transformer with Abbr-Recover Policy for Chinese Abbreviation Prediction

Constructing Chinese Abbreviation Dictionary: A Stacked Approach.

A Chinese Dataset with Negative Full Forms for General Abbreviation Prediction

A CRF-based Method for Automatic Construction of Chinese Symptom Lexicon

Extracting Chinese abbreviation-definition pairs from anchor texts.

The Automatic Extraction of Temporal Relation from Chinese Narrative Medical Records Using Conditional Random Fields

Chinese Abbreviation Identification Using Abbreviation-Template Features *

A Bilingual Corpus Based Approach to Chinese Abbreviation Extraction

Chinese Abbreviation-Definition Identification: A SVM Approach Using Context Information

Chinese Abbreviation Identification Using Abbreviation-Template Features and Context Information

A Chinese Toponym Recognition Method Based on Conditional Random Field