Abstract:Netizens all over the world can search malicious websites by malicious long-tail keywords on search engines, but malicious websites are strictly prohibited by law in most countries, so the construction of short text classification models for detecting malicious long-tail keywords has become a key research topic of Natural Language Processing (NLP). Most of the short text classification models are for English, with the widespread use of Chinese, there is an urgent need to develop Chinese short text classification models to help Chinese search engines detect malicious long-tail keywords. Considering that malicious long-tail keywords often evade detection by using homophones that have the same pinyin, pinyin is added to solve the homophonic typos problem of Chinese short text. Considering the data sparsity problem of malicious long-tail keywords, pinyin and radicals are added to obtain more abundant features. Since there is no publicly available pre-trained pinyin and radical embedding models, the embedding vectors of Chinese words, radical and pinyin are trained through Word2Vec, and 492,345 individual word embedding vectors, 207,995 individual radical embedding vectors and 402,071 individual pinyin embedding vectors are obtained. In addition, the positional encoding and part-of-speech coefficient are added to them, and the TF-IDF and MI values are added to reflect the word frequency weight and the different importance of the same word in different documents. Then, two parallel co-attention networks are used to fuse features of words, pinyin, and radicals, BIGRU is used to extract temporal features, and CNN is used to extract local features. Multi-group comparative experiment results on two short text benchmark datasets and pornographic and gambling long-tail keywords show that the proposed model outperforms the state-of-the-art text classification model.

Radical features for Chinese text classification.

A Radical-Aware Attention-Based Model for Chinese Text Classification

A Chinese text classification model based on radicals and character distinctions

Self-information of radicals: A new clue for zero-shot Chinese character recognition

Radical-Enhanced Chinese Character Embedding

The Impact of Visual Information in Chinese Characters: Evaluating Large Models' Ability to Recognize and Utilize Radicals

Reading Chinese in Natural Scenes with a Bag-of-Radicals Prior

Ideography Leads Us to the Field of Cognition: A Radical-Guided Associative Model for Chinese Text Classification

Chinese character recognition with radical-structured stroke trees

Radical Analysis Network for Zero-Shot Learning in Printed Chinese Character Recognition

Trajectory-based Radical Analysis Network for Online Handwritten Chinese Character Recognition

Radical-attended and Pinyin-attended malicious long-tail keywords detection

Radical Composition Network for Chinese Character Generation

Incorporating Chinese Radicals Into Neural Machine Translation: Deeper Than Character Level

Distributional Similarity for Chinese: Exploiting Characters and Radicals

Radical-level Ideograph Encoder for RNN-based Sentiment Analysis of Chinese and Japanese

A Transformer-based Radical Analysis Network for Chinese Character Recognition

Rare Chinese Character Recognition by Radical Extraction Network

Radical Counter Network for Robust Chinese Character Recognition

Radical aggregation network for few-shot offline handwritten Chinese character recognition