Abstract:Automatic text summarization (ATS) provides a summary of distinct categories of information using natural language processing (NLP). Low-resource languages like Hindi have restricted applications of these techniques. This study proposes a method for automatically generating summaries of Hindi documents using extractive technique. The approach retrieves pertinent sentences from the source documents by employing multiple linguistic features and machine learning (ML) using maximum likelihood estimation (MLE) and maximum entropy (ME). We conducted pre-processing on the input documents, such as eliminating Hindi stop words and stemming. We have obtained 15 linguistic feature scores from each document to identify the phrases with high scores for summary generation. We have performed experiments over BBC News articles, CNN News, DUC 2004, Hindi Text Short Summarization Corpus, Indian Language News Text Summarization Corpus, and Wikipedia Articles for the proposed text summarizer. The Hindi Text Short Summarization Corpus and Indian Language News Text Summarization Corpus datasets are in Hindi, whereas BBC News articles, CNN News, and the DUC 2004 datasets have been translated into Hindi using Google, Microsoft Bing, and Systran translators for experiments. The summarization results have been calculated and shown for Hindi as well as for English to compare the performance of a low and rich-resource language. Multiple ROUGE metrics, along with precision, recall, and F-measure, have been used for the evaluation, which shows the better performance of the proposed method with multiple ROUGE scores. We compare the proposed method with the supervised and unsupervised machine learning methodologies, including support vector machine (SVM), Naive Bayes (NB), decision tree (DT), latent semantic analysis (LSA), latent Dirichlet allocation (LDA), and K-means clustering, and it was found that the proposed method outperforms these methods.

Automatic Text Summarizing Based on Sentence Extraction: A Statistical Approach

Automatic Document Summarization Via Deep Neural Networks

Automatic text summarization based on sentences clustering and extraction

Research on Sentence Extraction in Text Summarization

A Domain-Based Automatic Text Summarization System

Automatic Text Summarization Using Support Vector Machine

Analysis of Sentence Scoring Methods for Extractive Automatic Text Summarization

Hybrid Approach for Single Text Document Summarization using Statistical and Sentiment Features

Automatic Text Summarization Method Based on Improved TextRank Algorithm and K-Means Clustering

Automatic Extractive Text Summarization using Multiple Linguistic Features

Automatic Summarization Method Based on Thematic Term Set

Automatic Text Summarization Methods: A Comprehensive Review

English automatic text summarization

Automatic summarization oriented Chinese word extraction and statistics system

Automatic Summarization Based on Statistic Semantic and Structural Features

GA, MR, FFNN, PNN and GMM Based Models for Automatic Text Summarization

Integrating Extractive and Abstractive Models for Long Text Summarization

Automatic Summarization for Chinese Text Based on Combined Words Recognition and Paragraph Clustering

A Novel Approach to Text Summarization Using Machine Learning

Automatic Text Summarization Using Fuzzy Inference.

A Review of Text Summarization Techniques Using NLP