Abstract:With the rapid spread of information, abbreviations are used more and more common because they are convenient. However, the duplication of abbreviations can lead to confusion in many cases, such as information management and information retrieval. The resultant confusion annoys users. Thus, inferring a full name from an abbreviation has practical and significant advantages. The bulk of studies in the literature mainly inferred full names based on rule-based methods, statistical models, the similarity of representation, etc. However, these methods are unable to use various grained contexts properly. In this paper, we propose a flexible framework of Multi-attention mask Abbreviation Context and Full name language model, named MACF to address the problem. With the abbreviation and contexts as the inputs, the MACF can automatically predict a full name by generation, where the contexts can be variously grained. That is, different grained contexts ranging from coarse to fine can be selected to perform such complicated tasks in which contexts include paragraphs, several sentences, or even just a few keywords. A novel multi-attention mask mechanism is also proposed, which allows the model to learn the relationships among abbreviations, contexts, and full names, a process that makes the most of various grained contexts. The three corpora of different languages and fields were analyzed and measured with seven metrics in various aspects to evaluate the proposed framework. According to the experimental results, the MACF yielded more significant and consistent outputs than other baseline methods. Moreover, we discuss the significance and findings, and give the case studies to show the performance in real applications.

Coarse-grained Candidate Generation and Fine-grained Re-ranking for Chinese Abbreviation Prediction.

Enhancing Chinese abbreviation prediction with LLM generation and contrastive evaluation

Abbreviation Prediction Using Conditional Random Field and Web Data

A Context-Enhanced Generate-then-Evaluate Framework for Chinese Abbreviation Prediction

Generalized Abbreviation Prediction with Negative Full Forms and Its Application on Improving Chinese Web Search

A Sequence-to-Sequence Model for Large-scale Chinese Abbreviation Database Construction.

Constructing Chinese Abbreviation Dictionary: A Stacked Approach.

Predicting Chinese Abbreviations with Minimum Semantic Unit and Global Constraints.

Predicting Chinese Abbreviations from Definitions: an Empirical Learning Approach Using Support Vector Regression.

Generating Abbreviations for Chinese Named Entities Using Recurrent Neural Network with Dynamic Dictionary

AGRA: an Analysis-Generation-Ranking Framework for Automatic Abbreviation from Paper Titles.

Chinese Abbreviation Identification Using Abbreviation-Template Features *

A hybrid approach to chinese abbreviation expansion

Learning Abbreviations from Chinese and English Terms by Modeling Non-Local Information

Automatic Expansion of Chinese Abbreviations by Web Mining

A Context-Enhanced Transformer with Abbr-Recover Policy for Chinese Abbreviation Prediction

A transformer-based neural network framework for full names prediction with abbreviations and contexts

Chinese Named Entity Abbreviation Generation Using First-Order Logic.

Chinese Abbreviation Identification Using Abbreviation-Template Features and Context Information

A Bilingual Corpus Based Approach to Chinese Abbreviation Extraction

Automatic expansion of abbreviations in Chinese news text