Abstract:Chinese spelling correction (CSC) constitutes a pivotal and enduring goal in natural language processing, serving as a foundational element for various language-related tasks by detecting and rectifying spelling errors in textual content. Numerous methods for Chinese spelling correction leverage multimodal information, including character, character sound, and character shape, to establish connections between incorrect and correct characters. Research indicates that a majority of spelling errors stem from pinyin similarity, with character similarity accounting for half of the errors. Consequently, effectively modeling character pinyin and character relationships emerges as a key challenge in the CSC task. In this study, we propose enhancing the CSC task by introducing the pinyin character prediction task. We employ an adaptive weighting method in the pinyin character prediction task to address predictions in a more granular manner, achieving a balance between the two prediction tasks. The proposed model, SPMSpell, utilizes ChineseBERT as an encoder to capture multimodal feature information simultaneously. It incorporates three parallel decoders for character prediction, pinyin prediction, and self-distillation modules. To mitigate potential overfitting concerning pinyin, a self-distillation method is introduced to prioritize character information in predictions. Extensive experiments conducted on three SIGHAN benchmark tests showcase that the model introduced in this paper attains a superior level of performance. This substantiates the correctness and superiority of the adaptive weighted pinyin character prediction task and underscores the effectiveness of the self-distillation module.

Integrating Pinyin to Improve Spelling Errors Detection for Chinese Language

Self-Distillation and Pinyin Character Prediction for Chinese Spelling Correction Based on Multimodality

Chinese Spelling Error Detection Using a Fusion Lattice LSTM

A Hybrid Model for Chinese Spelling Check

A data quality improvement method based on non-word errors correction

Exploring the Usage of Chinese Pinyin in Pretraining

MISpeller: Multimodal Information Enhancement for Chinese Spelling Correction

Chinese pinyin-to-text translation technique with error correction used for continuous speech recognition

A Chinese OCR Spelling Check Approach Based on Statistical Language Models.

MLSL-Spell: Chinese Spelling Check Based on Multi-Label Annotation

Winnow-based approach in automatic error detection and correction of Chinese text

An Error-Guided Correction Model for Chinese Spelling Error Correction

Large Language Model Should Understand Pinyin for Chinese ASR Error Correction

Improving Chinese Spelling Check by Character Pronunciation Prediction: The Effects of Adaptivity and Granularity

Improving Chinese Spelling Correction by Ranking.

CHIME: an efficient error-tolerant Cinese pinyin input method

Improve Chinese Spelling Check by Reevaluation

Multi-Task Fine-Tuning on BERT Using Spelling Errors Correction for Chinese Text Classification Robustness

CRASpell: A Contextual Typo Robust Approach to Improve Chinese Spelling Correction

Correcting Chinese Spelling Errors with Phonetic Pre-training

IMPROVED STRATEGIES FOR INTELLIGENT SENTENCE INPUT METHOD ENGINE SYSTEM