Abstract:Keyword extraction is the foundation for solving various text mining tasks. However, the literature heavily relies on statistical, linguistic feature-based, or graph-based metrics to gauge corpus-representative keywords, the process of which is sensitive to preprocessing and stopword selection. In this paper, we propose a general-use keyword extraction model designed to work with document groups of various sizes, domains, and readability, as well as the existence of keyword labels. To extract a better selection of keywords, we employ a simple logistic regression model with the least absolute shrinkage and selection operator regularization (Tibshirani, 1996). The classification-based structure of our approach ensures learning words that distinctively characterize the given document group against the comparison groups, enhancing the representativeness of the extracted keywords. Furthermore, our model repeatedly modifies coefficients as it learns the document label classifiers, rather than relying directly on the term frequencies, reducing the model’s sensitivity to words of very high and very low frequencies. We test our model’s performance against numerous classic keyword extraction frameworks as baseline models using online customer reviews, news articles, and patent documentation. The results indicate that our proposed method has robust performance in terms of representability and distinctiveness across document groups with varying sizes, number of class labels, levels of readability, and domain. Additionally, we show that our model beats baseline models even when applied to documents without class labels compared with the baseline models. Given its generalizability and simplicity, we believe that our proposed model may serve as an easy-to-use, yet a powerful, general-use tool for keyword extraction, especially when working with various groups of documents from different domains.

Unsupervised two-stage keyword extraction from spoken documents by topic coherence and support vector machine

Exploring Simultaneous Keyword and Key Sentence Extraction

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Keyword extraction using support vector machine

A comprehensive unsupervised feature selection method of two-stage strategy

Automatic Keywords Extraction Based on Co-Occurrence and Semantic Relationships Between Words

General-use unsupervised keyword extraction model for keyword analysis

Unsupervised Spoken Term Discovery on Untranscribed Speech

Keyword-specific normalization based keyword spotting for spontaneous speech

Topic Modeling in Semantic Space with Keywords.

A New Keyword Spotting Approach for Spontaneous Mandarin Speech

Unsupervised Pattern Discovery from Thematic Speech Archives Based on Multilingual Bottleneck Features

U2-KWS: Unified Two-pass Open-vocabulary Keyword Spotting with Keyword Bias

Audio-visual Keyword Spotting for Mandarin Based on Discriminative Local Spatial-Temporal Descriptors.

Complex Network based Supervised Keyword Extractor

AdaptiveUKE: Towards adaptive unsupervised keyphrase extraction with gated topic modeling

Improved spoken term detection using support vector machines with acoustic and context features from pseudo-relevance feedback

Supervised Spoken Document Summarization Based On Structured Support Vector Machine With Utterance Clusters As Hidden Variables

Supervised Spoken Document Summarization Jointly Considering Utterance Importance and Redundancy by Structured Support Vector Machine.

Unsupervised Discovery of Structured Acoustic Tokens with Applications to Spoken Term Detection

Understanding temporally weakly supervised training: A case study for keyword spotting