Abstract:Chinese developers often cannot effectively search questions in English, because they may have difficulties in translating technical words from Chinese to English and formulating proper English queries. For the purpose of helping Chinese developers take advantage of the rich knowledge base of Stack Overflow and simplify the question retrieval process, we propose an automated cross-language relevant question retrieval (CLRQR) system to retrieve relevant English questions for a given Chinese question. CLRQR first extracts essential information (both Chinese and English) from the title and description of the input Chinese question, then performs domain-specific translation of the essential Chinese information into English, and finally formulates an English query for retrieving relevant questions in a repository of English questions from Stack Overflow. We propose three different retrieval algorithms (word-embedding, word-matching, and vector-space-model based methods) that exploit different document representations and similarity metrics for question retrieval. To evaluate the performance of our approach and investigate the effectiveness of different retrieval algorithms, we propose four baseline approaches based on the combination of different sources of query words, query formulation mechanisms and search engines. We randomly select 80 Java, 20 Python and 20 .NET questions in SegmentFault and V2EX (two Chinese Q&A websites for computer programming) as the query Chinese questions. We conduct a user study to evaluate the relevance of the retrieved English questions using CLRQR with different retrieval algorithms and the four baseline approaches. The experiment results show that CLRQR with word-embedding based retrieval achieves the best performance.

Narrowing the language gap: domain adaptation guided cross-lingual passage re-ranking

Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains.

Domain-specific Cross-Language Relevant Question Retrieval.

Parameter-Efficient Neural Reranking for Cross-Lingual and Multilingual Retrieval

Cross-lingual Information Retrieval with BERT

Bridging the Domain Gap: Improve Informal Language Translation Via Counterfactual Domain Adaptation

Transfer Learning Approaches for Building Cross-Language Dense Retrieval Models

Cross-Lingual Training with Dense Retrieval for Document Retrieval

Expand, Rerank, and Retrieve: Query Reranking for Open-Domain Question Answering.

Dealing with Typos for BERT-based Passage Retrieval and Ranking

Cross-Lingual Relevance Transfer for Document Retrieval

Innovative Bert-based Reranking Language Models for Speech Recognition

BERT for Monolingual and Cross-Lingual Reverse Dictionary.

SS-BERT: A Semantic Information Selecting Approach for Open-Domain Question Answering

An in-depth analysis of passage-level label transfer for contextual document ranking

Searching for Optimal Subword Tokenization in Cross-domain NER

Utilizing passage‐level relevance and kernel pooling for enhancing BERT‐based document reranking

Understanding the Behaviors of BERT in Ranking

ERNIE-Search: Bridging Cross-Encoder with Dual-Encoder Via Self On-the-fly Distillation for Dense Passage Retrieval

Improving Bilingual Lexicon Induction with Cross-Encoder Reranking

Incorporating Explicit Knowledge in Pre-trained Language Models for Passage Re-ranking