Abstract:Netizens all over the world can search malicious websites by malicious long-tail keywords on search engines, but malicious websites are strictly prohibited by law in most countries, so the construction of short text classification models for detecting malicious long-tail keywords has become a key research topic of Natural Language Processing (NLP). Most of the short text classification models are for English, with the widespread use of Chinese, there is an urgent need to develop Chinese short text classification models to help Chinese search engines detect malicious long-tail keywords. Considering that malicious long-tail keywords often evade detection by using homophones that have the same pinyin, pinyin is added to solve the homophonic typos problem of Chinese short text. Considering the data sparsity problem of malicious long-tail keywords, pinyin and radicals are added to obtain more abundant features. Since there is no publicly available pre-trained pinyin and radical embedding models, the embedding vectors of Chinese words, radical and pinyin are trained through Word2Vec, and 492,345 individual word embedding vectors, 207,995 individual radical embedding vectors and 402,071 individual pinyin embedding vectors are obtained. In addition, the positional encoding and part-of-speech coefficient are added to them, and the TF-IDF and MI values are added to reflect the word frequency weight and the different importance of the same word in different documents. Then, two parallel co-attention networks are used to fuse features of words, pinyin, and radicals, BIGRU is used to extract temporal features, and CNN is used to extract local features. Multi-group comparative experiment results on two short text benchmark datasets and pornographic and gambling long-tail keywords show that the proposed model outperforms the state-of-the-art text classification model.

Adaptive Topic Modeling for Detection Objectionable Text

Web Objectionable Text Content Detection Using Topic Modeling Technique.

Hierarchical Semantic Model for Objectionable Web Text Content Detection

A Knowledge-Based Semisupervised Hierarchical Online Topic Detection Framework.

A Text Semantics-Based Detection Method for Internet Sensitive Topics

Detecting Malicious Websites in Depth through Analyzing Topics and Web-pages

Adaptive Topic Modeling With Probabilistic Pseudo Feedback In Online Topic Detection

Perplexed by Quality: A Perplexity-based Method for Adult and Harmful Content Detection in Multilingual Heterogeneous Web Data

Detect All Abuse! Toward Universal Abusive Language Detection Models

Using Topic Modeling Methods for Short-Text Data: A Comparative Analysis

TextDefense: Adversarial Text Detection based on Word Importance Entropy

A Self-adaptive Sliding Window Based Topic Model for Non-uniform Texts

TEXTSHIELD: Robust Text Classification Based on Multimodal Embedding and Neural Machine Translation

The performance of multiple language models in identifying offensive language on social media

A Joint Model Of Extended Lda And Ibtm Over Streaming Chinese Short Texts

Unhealthy Webpage Detection Based on Topic-focused Web Crawler

Radical-attended and Pinyin-attended malicious long-tail keywords detection

A topic detection method based on KM-LSH Fusion algorithm and improved BTM model

Cease with Bass: A Framework for Real-Time Topic Detection and Popularity Prediction Based on Long-Text Contents.

Detecting AI Flaws: Target-Driven Attacks on Internal Faults in Language Models

DATM: A Novel Data Agnostic Topic Modeling Technique With Improved Effectiveness for Both Short and Long Text