Abstract:Keyword extraction is the foundation for solving various text mining tasks. However, the literature heavily relies on statistical, linguistic feature-based, or graph-based metrics to gauge corpus-representative keywords, the process of which is sensitive to preprocessing and stopword selection. In this paper, we propose a general-use keyword extraction model designed to work with document groups of various sizes, domains, and readability, as well as the existence of keyword labels. To extract a better selection of keywords, we employ a simple logistic regression model with the least absolute shrinkage and selection operator regularization (Tibshirani, 1996). The classification-based structure of our approach ensures learning words that distinctively characterize the given document group against the comparison groups, enhancing the representativeness of the extracted keywords. Furthermore, our model repeatedly modifies coefficients as it learns the document label classifiers, rather than relying directly on the term frequencies, reducing the model’s sensitivity to words of very high and very low frequencies. We test our model’s performance against numerous classic keyword extraction frameworks as baseline models using online customer reviews, news articles, and patent documentation. The results indicate that our proposed method has robust performance in terms of representability and distinctiveness across document groups with varying sizes, number of class labels, levels of readability, and domain. Additionally, we show that our model beats baseline models even when applied to documents without class labels compared with the baseline models. Given its generalizability and simplicity, we believe that our proposed model may serve as an easy-to-use, yet a powerful, general-use tool for keyword extraction, especially when working with various groups of documents from different domains.

Keyword spotting based on mixed grammar model

A Keyword Spotting Method

A New Keyword Spotting Approach for Spontaneous Mandarin Speech

Keyword-specific normalization based keyword spotting for spontaneous speech

Keyword Spotting Based on Hypothesis Boundary Realignment and State-Level Confidence Weighting

Spot keywords from very noisy and mixed speech

An Approach of Keyword Spotting Based on HMM

Few-Shot Keyword Spotting from Mixed Speech

Web-based keyword adapted Language Modeling for Keyword Spotting

Keyword Spotting Based on Phoneme Confusion Matrix

Keywords and Instances: A Hierarchical Contrastive Learning Framework Unifying Hybrid Granularities for Text Generation

A New Framework for Large Vocabulary Keyword Spotting Using Two-Pass Confidence Measure

MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting

LEXICAL ACCESS-BASED CONFIDENCE MEASURE FOR A SPANISH KEYWORD SPOTTING SYSTEM

Keyword-Guided Neural Conversational Model

A Hybrid Language Model Based on Statistics and Linguistic Rules

Automatic Keyphrase Extraction by Bridging Vocabulary Gap.

General-use unsupervised keyword extraction model for keyword analysis

SIFRANK Algorithm for Chinese Text Keyword Extraction Based on Dependent Semantic Feature Constraints

Model acquisition method, keyword generation method and device, medium and computing equipment

Controlled Evaluation of Grammatical Knowledge in Mandarin Chinese Language Models