Abstract:Code search aims to find code snippets from large-scale code repositories based on the developer's query intent. A significant challenge for code search is the semantic gap between programming language and natural language. Recent works have indicated that deep learning (DL) techniques can perform well by automatically learning the relationships between query and code. Among these DL-based approaches, the state-of-the-art model is TabCS, a two-stage attention-based model for code search. However, TabCS still has two limitations: semantic loss and semantic confusion. TabCS breaks the structural information of code into token-level words of abstract syntax tree (AST), which loses the sequential semantics between words in programming statements, and it uses a co-attention mechanism to build the semantic correlation of code-query after fusing all features, which may confuse the correlations between individual code features and query. In this paper, we propose a code search model named FcarCS (Fine-grained Co-Attentive Representation Learning Model for Semantic Code Search). FcarCS extracts code textual features (i.e., method name, API sequence, and tokens) and structural features that introduce a statement-level code structure. Unlike TabCS, FcarCS splits AST into a series of subtrees corresponding to code statements and treats each subtree as a whole to preserve sequential semantics between words in code statements. FcarCS constructs a new fine-grained co-attention mechanism to learn interdependent representations for each code feature and query, respectively, instead of performing one co-attention process for the fused code features like TabCS. Generally, this mechanism leverages row/column-wise CNN to enable our model to focus on the strongly correlated local information between code feature and Query. We train and evaluate FcarCS on an open Java dataset with 475k and 10k code/query pairs, respectively. Experimental results show that FcarCS achieves an MRR of 0.613, outperforming three state-of-the-art models DeepCS, UNIF, and TabCS, by 117.38%, 16.76%, and 12.68%, respectively. We also performed a user study for each model with 50 real-world queries, and the results show that FcarCS returned code snippets that are more relevant than the baseline models.

Fine-Tuning Pre-Trained CodeBERT for Code Search in Smart Contract

Automating User Notice Generation for Smart Contract Functions

Semantic Code Search for Smart Contracts

Improving smart contract search by semantic and structural clustering for source codes

An Empirical Study of Parameter-Efficient Fine-Tuning Methods for Pre-Trained Code Models.

Tackling Long Code Search with Splitting, Encoding, and Aggregating

Code semantic enrichment for deep code search

Deep Semantics-Enhanced Neural Code Search

Refining Joint Text and Source Code Embeddings for Retrieval Task with Parameter-Efficient Fine-Tuning

Fine-grained Co-Attentive Representation Learning for Semantic Code Search

CodeRetriever: A Large Scale Contrastive Pre-Training Method for Code Search

BERTer: The Efficient One

BinEnhance: An Enhancement Framework Based on External Environment Semantics for Binary Code Search

Cross-Modal Contrastive Learning for Code Search

PatentBERT: Patent Classification with Fine-Tuning a pre-trained BERT Model

Enhancing smart contract security: Leveraging pre‐trained language models for advanced vulnerability detection

Revisiting Code Search in a Two-Stage Paradigm

Pre-training Tasks for User Intent Detection and Embedding Retrieval in E-commerce Search

CoCoSoDa: Effective Contrastive Learning for Code Search

Combining Fine-Tuning and LLM-based Agents for Intuitive Smart Contract Auditing with Justifications

Codehow: Effective Code Search Based On Api Understanding And Extended Boolean Model