Abstract:Abstract Punctuation marks play a vital role in text representation and interpretation, and are useful in enhancing the performance of modern Natural Language Processing (NLP) systems such as voice input typing aids, machine translation, and speech synthesis systems. Punctuation marks, except period, are inherently not available in Indian languages such as Tamil and Hindi. However, some modern forms of writing such as news articles, blogs, stories, and so forth, incorporate user‐defined punctuation marks in these languages. The current work proposes an automatic punctuation prediction system for texts in Tamil and Hindi using classification approach, where punctuation prediction is considered as a multi‐class classification problem. Word‐level text features are chosen and are analysed to validate their language‐dependency and significance towards punctuation prediction. A Feature‐weighted AdaBoost (FAda) classifier is proposed that defines a novel boosting factor to adjust the hypothesis weight of the weak classifiers, hence reducing the number of false classifications. It is observed that the proposed classifier outperforms the other classification techniques such as, AdaBoost, SVM, CART, CRF, and Bi‐LSTM by a maximum difference of 50% and 16% in the macro F1‐scores for Tamil and Hindi texts, respectively. The proposed classifier performs on par with the attention‐based classifier for both Tamil and Hindi texts. Further, as a proof of concept, the proposed punctuation prediction system is applied to voice keyboard, machine translation, and speech synthesis systems, to validate the effect of the punctuation marks on the performance of these Natural Language Processing (NLP) systems.

Transfer knowledge for punctuation prediction via adversarial training

Adversarial Transfer Learning for Punctuation Restoration

Incorporating External POS Tagger for Punctuation Restoration

Focal Loss for Punctuation Prediction.

Multimodal Punctuation Prediction with Contextual Dropout

Distilling Knowledge from an Ensemble of Models for Punctuation Prediction.

Self-Attention Based Model For Punctuation Prediction Using Word And Speech Embeddings

Improved Training for End-to-End Streaming Automatic Speech Recognition Model with Punctuation

Punctuation Restoration Improves Structure Understanding without Supervision

Adversarial Multi-Task Learning for Mandarin Prosodic Boundary Prediction with Multi-Modal Embeddings

Joint Chinese Word Segmentation and POS Tagging on Heterogeneous Annotated Corpora with Multiple Task Learning.

Unified Multimodal Punctuation Restoration Framework for Mixed-Modality Corpus

Multimodal Semi-supervised Learning Framework for Punctuation Prediction in Conversational Speech

LLaMA based Punctuation Restoration With Forward Pass Only Decoding

Efficient Ensemble for Multimodal Punctuation Restoration using Time-Delay Neural Network

Predicting Punctuation in Ancient Chinese Texts: A Multi-Layered LSTM and Attention-Based Approach

Cross-Register Projection for Headline Part of Speech Tagging

Neural Multi-Task Learning for Stance Prediction

Reliable Part-of-Speech Tagging of Historical Corpora through Set-Valued Prediction

Feature‐weighted AdaBoost classifier for punctuation prediction in Tamil and Hindi NLP systems

Question Mark Prediction by Bert