Abstract:With the development of online transactions, the Chinese cyber black market is proliferating and facilitates many cybercrimes. It is difficult to understand the cyber black market due to the confusing jargon (called black keywords in this paper) used by criminals to conceal underground transactions. To discover black keywords automatically, some natural language processing based methods have been proposed by comparing the similarity of word vectors generated by word embedding models. Therefore, the quality of word vectors generated has a significant impact on black keyword discovery and it is necessary to evaluate different word embedding models in discovering black keywords. To this end, we design a Chinese black keyword discovery framework and conduct a systematic empirical study on six existing word embedding models including both static and dynamic types in discovering Chinese black keywords. In specific, we classify Chinese black keywords in four types: domain specific words (DSWs), new meaning words (NMWs), similar pronunciation words (SPWs), and similar glyph words (SGWs). We experimentally find that different word embedding models vary greatly in performance when discovering black keywords, e.g., dynamic models perform well in discovering DSWs and NMWs, static ones perform poorly in discovering NMWs. We improve the static word embedding model based NMW discovery algorithm by additionally comparing the differences in cross-corpus word nearest -neighbors before and after domain incremental training. For effectively discovering variant words like SPWs and SGWs, we additionally introduce Chinese pronunciation and glyph features. The experimental results demonstrate the effectiveness of the proposed Chinese black keyword discovery framework, with detection accuracies of over 90% for DSWs, 80% for NWMs, 90% for SPWs, and 61% for SGWs.

Detecting new Chinese words from massive domain texts with word embedding

New Word Identification in Social Network Text Based on Time Series Information

Mining Coherent Topics in Documents Using Word Embeddings and Large-Scale Text Data

Knowledge-based Document Embedding for Cross-Domain Text Classification

Domain-Specific New Words Detection in Chinese.

A systematic empirical study on word embedding based methods in discovering Chinese black keywords

Improving Cross-Domain Chinese Word Segmentation with Word Embeddings

An Exploration Of Semantic Relations In Neural Word Embeddings Using Extrinsic Knowledge

Fast Extraction of Word Embedding from Q-contexts

Continuous Word Embeddings For Detecting Local Text Reuses At The Semantic Level

Chinese New Word Detection from Query Logs.

Chinese LIWC Lexicon Expansion Via Hierarchical Classification of Word Embeddings with Sememe Attention

Visual Exploration and Comparison of Word Embeddings.

Extract Chinese Unknown Words from a Large-scale Corpus Using Morphological and Distributional Evidences.

New Word Detection Using BiLSTM+CRF Model with Features

Word Embedding Based Chinese News Event Detection and Representation

Topic Modeling over Short Texts by Incorporating Word Embeddings

Internet-oriented Chinese New Words Detection

Multiple Character Embeddings for Chinese Word Segmentation

Using Big Data From The Web To Train Chinese Traffic Word Representation Model In Vector Space

New Word Extraction from Chinese Financial Documents.