Abstract:Hidden code clones negatively impact software maintenance, but manually detecting them in large codebases is impractical. Additionally, automated approaches find detection of syntactically‐divergent clones very challenging. While recent deep neural networks (for example BERT‐based artificial neural networks) seem more effective in detecting such clones, their pairwise comparison of every code pair in the target system(s) is inefficient and scales poorly on large codebases. We present SSCD, a BERT‐based clone detection approach that targets high recall of Type 3 and Type 4 clones at a very large scale (in line with our industrial partner's requirements). It computes a representative embedding for each code fragment and finds similar fragments using a nearest neighbor search. Thus, SSCD avoids the pairwise‐comparison bottleneck of other neural network approaches, while also using a parallel, GPU‐accelerated search to tackle scalability. This article describes the approach, proposing and evaluating several refinements to improve Type 3/4 clone detection at scale. It provides a substantial empirical evaluation of the technique, including a speed/efficacy comparison of the approach against SourcererCC and Oreo, the only other neural‐network approach currently capable of scaling to hundreds of millions of LOC. It also includes a large in‐situ evaluation on our industrial collaborator's code base that assesses the original technique, the impact of the proposed refinements and illustrates the impact of incremental, active learning on its efficacy. We find that SSCD is significantly faster and more accurate than SourcererCC and Oreo. SAGA, a GPU‐accelerated traditional clone detection approach, is a little better than SSCD for T1/T2 clones, but substantially worse for T3/T4 clones. Thus, SSCD is both scalable to industrial code sizes, and comparatively more accurate than existing approaches for difficult T3/T4 clone searching. In‐situ evaluation on company datasets shows that SSCD outperforms the baseline approach (CCFinderX) for T3/T4 clones. Whitespace removal and active learning further improve SSCD effectiveness.

From Local to Global Semantic Clone Detection

Code Clone Detection: A Literature Review

FSD-CLCD: Functional Semantic Distillation Graph Learning for Cross-Language Code Clone Detection

Neural Detection of Semantic Code Clones Via Tree-Based Convolution

An ensemble learning approach for software semantic clone detection

Detecting Code Clones with Graph Neural Networkand Flow-Augmented Abstract Syntax Tree

Goner: Building Tree-Based N-Gram-Like Model for Semantic Code Clone Detection

SCDetector

Detecting Semantic Code Clones by Building AST-based Markov Chains Model.

SCCD-GAN: An Enhanced Semantic Code Clone Detection Model Using GAN

Java Code Clone Detection by Exploiting Semantic and Syntax Information from Intermediate Code-Based Graph

Functional Code Clone Detection with Syntax and Semantics Fusion Learning

Challenging Machine Learning-based Clone Detectors via Semantic-preserving Code Transformations

Tritor: Detecting Semantic Code Clones by Building Social Network-Based Triads Model

GRRLN: Gated Recurrent Residual Learning Networks for code clone detection

Nearest‐neighbor, BERT‐based, scalable clone detection: A practical approach for large‐scale industrial code bases

Go-clone: Graph-Embedding Based Clone Detector for Golang

Using a Nearest-Neighbour, BERT-Based Approach for Scalable Clone Detection

A Generative AI-Driven Method-Level Semantic Clone Detection Based on the Structural and Semantical Comparison of Methods

TreeCen: Building Tree Graph for Scalable Semantic Code Clone Detection

Fine-Grained Code Clone Detection with Block-Based Splitting of Abstract Syntax Tree.