Abstract:Abbreviations often used in our daily communication play an important role in natural language processing. Most of the existing studies regard the Chinese abbreviation prediction as a sequence labeling problem. However, sequence labeling models usually ignore label dependencies in the process of abbreviation prediction, and the label prediction of each character should be conditioned on its previous labels. In this paper, we propose to formalize the Chinese abbreviation prediction task as a sequence generation problem, and a novel sequence-to-sequence model is designed. To boost the performance of our deep model, we further propose a multi-level pre-trained model that incorporates character, word, and concept-level embeddings. To evaluate our methods, a new dataset for Chinese abbreviation prediction is automatically built, which contains 81,351 pairs of full forms and abbreviations. Finally, we conduct extensive experiments on a public dataset and the built dataset, and the experimental results on both datasets show that our model outperforms the state-of-the-art methods. More importantly, we build a large-scale database for a specific domain, i.e., life services in Meituan Inc., with high accuracy of about 82.7%, which contains 4,134,142 pairs of full forms and abbreviations. The online A/B testing on Meituan APP and Dianping APP suggests that Click-Through Rate increases by 0.59% and 0.86% respectively when the built database is used in the searching system. We have released our API on http://kw.fudan.edu.cn/ddemos/abbr/ with over 87k API calls in 9 months.

Constructing Chinese Abbreviation Dictionary: A Stacked Approach.

A Sequence-to-Sequence Model for Large-scale Chinese Abbreviation Database Construction.

Automatic Expansion of Chinese Abbreviations by Web Mining

Coarse-grained Candidate Generation and Fine-grained Re-ranking for Chinese Abbreviation Prediction.

A hybrid approach to chinese abbreviation expansion

Automatic Construction of Biomedical Abbreviations Dictionary from Text

A Bilingual Corpus Based Approach to Chinese Abbreviation Extraction

Automatic expansion of abbreviations in Chinese news text

Enhancing Chinese abbreviation prediction with LLM generation and contrastive evaluation

A CRF-based Method for Automatic Construction of Chinese Symptom Lexicon

AGRA: an Analysis-Generation-Ranking Framework for Automatic Abbreviation from Paper Titles.

Learning Abbreviations from Chinese and English Terms by Modeling Non-Local Information

Chinese Abbreviation Identification Using Abbreviation-Template Features *

Generalized Abbreviation Prediction with Negative Full Forms and Its Application on Improving Chinese Web Search

Chinese Named Entity Abbreviation Generation Using First-Order Logic.

Generating Abbreviations for Chinese Named Entities Using Recurrent Neural Network with Dynamic Dictionary

Robust Approach to Abbreviating Terms

Predicting Chinese Abbreviations with Minimum Semantic Unit and Global Constraints.

A Context-Enhanced Generate-then-Evaluate Framework for Chinese Abbreviation Prediction

Abbreviation Prediction Using Conditional Random Field and Web Data

Effective Chinese Organization Name Linking to a List-Like Knowledge Base.