Abstract:Chinese developers often cannot effectively search questions in English, because they may have difficulties in translating technical words from Chinese to English and formulating proper English queries. For the purpose of helping Chinese developers take advantage of the rich knowledge base of Stack Overflow and simplify the question retrieval process, we propose an automated cross-language relevant question retrieval (CLRQR) system to retrieve relevant English questions for a given Chinese question. CLRQR first extracts essential information (both Chinese and English) from the title and description of the input Chinese question, then performs domain-specific translation of the essential Chinese information into English, and finally formulates an English query for retrieving relevant questions in a repository of English questions from Stack Overflow. We propose three different retrieval algorithms (word-embedding, word-matching, and vector-space-model based methods) that exploit different document representations and similarity metrics for question retrieval. To evaluate the performance of our approach and investigate the effectiveness of different retrieval algorithms, we propose four baseline approaches based on the combination of different sources of query words, query formulation mechanisms and search engines. We randomly select 80 Java, 20 Python and 20 .NET questions in SegmentFault and V2EX (two Chinese Q&A websites for computer programming) as the query Chinese questions. We conduct a user study to evaluate the relevance of the retrieved English questions using CLRQR with different retrieval algorithms and the four baseline approaches. The experiment results show that CLRQR with word-embedding based retrieval achieves the best performance.

Chinese Information Retrieval: Using Characters Or Words?

Chinese word segmentation and its effect on information retrieval

Domain-specific Cross-Language Relevant Question Retrieval.

A Survey of Chinese Word Segmentation and the Application in Information Retrieval

A Local Information Perception Enhancement–Based Method for Chinese NER

Chinese Word Segmentation with Character Abstraction.

Towards Unified Chinese Segmentation Algorithm

Forgetting Word Segmentation in Chinese Text Classification with L1-Regularized Logistic Regression.

Word, Subword or Character? An Empirical Study of Granularity in Chinese-English NMT

Combining multiple sources for short query translation in Chinese-English cross-language information retrieval

Chinese Named Entity Recognition and Word Segmentation Based on Character.

A Discriminative Latent Variable Chinese Segmenter with Hybrid Word/Character Information.

Research On English-Chinese Bi-Directional Cross-Language Information Retrieval

Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models

Research on Lucene-based English-Chinese Cross-Language Information Retrieval

Context driven chinese string segmentation and recognition

Research on Chinese-English Cross-Language Information Retrieval

A Compression-based Algorithm for Chinese Word Segmentation

English-Chinese Cross-language Information Retrieval Using Lucene System

Chinese Keyword Extraction Based on N-Gram and Word Co-occurrence

Survey on Chinese Word Segmentation