Abstract:Code idioms are commonly used patterns, techniques, or practices that aid in solving particular problems or specific tasks across multiple software projects. They can improve code quality, performance, and maintainability, and also promote program standardization and reuse across projects. However, identifying code idioms is significantly challenging, as existing studies have still suffered from three main limitations. First, it is difficult to recognize idioms that span non-contiguous code lines. Second, identifying idioms with intricate data flow and code structures can be challenging. More-over, they only extract dataset-specific idioms, so common idioms or well-established code/design patterns that are rarely found in datasets cannot be identified. To overcome these limitations, we propose a novel approach, named Idiomine, to automatically extract generic and specific idioms from both Java projects and libraries. We perform program analysis on Java functions to transform them into concise PDGs, for integrating the data flow and control flow of code fragments. We then develop a novel chain structure, Data-driven Control Chain (DCC), to extract sub-idioms that possess contiguous semantic meanings from PDGs. After that, we utilize GraphCodeBERT to generate code embeddings of these sub-idioms and perform density-based clustering to obtain frequent sub-idioms. We use heuristic rules to identify interrelated sub-idioms among the frequent ones. Finally, we employ ChatGPT to synthesize interrelated sub-idioms into potential code idioms and infer real idioms from them. We conduct well-designed experiments and a user study to evaluate Idiomine's correctness and the practical value of the extracted idioms. Our experimental results show that Idiomine effectively extracts more idioms with better performance in most metrics. We compare our approach with Haggis and ChatGPT, Idiomine outperforms them by 22.8% and 35.5% in Idiom Set Precision (ISP) and by 9.7% and 22.9% in Idiom Coverage (IC) when extracting idioms from libraries. Idiomine also extracts almost twice the size of idioms than the baselines, exhibiting its ability to identify complete idioms. Our user study indicates that idioms extracted by Idiomine are well-formed and semantically clear. Moreover, we conduct a qualitative and quantitative analysis to investigate the primary functionalities of Idiomine's extracted idioms from various projects and libraries.

Spotting working code examples

Solving the Search for Source Code

What Do Developers Search for on the Web?

I Know What You Are Searching for: Code Snippet Recommendation from Stack Overflow Posts

Semantics Based Code Search Using Input/Output Examples

SpotWeb: Detecting Framework Hotspots and Coldspots via Mining Open Source Code on the Web

Streamlining Java Programming: Uncovering Well-Formed Idioms with IdioMine

Source Forager: A Search Engine for Similar Source Code

[Research Paper] Semantics-Based Code Search Using Input/Output Examples

From Query to Usable Code: An Analysis of Stack Overflow Code Snippets

APIExample: An effective web search based usage example recommendation system for java APIs.

Recommending Typical Usage Examples for Component Retrieval in Reuse Repositories.

Big Code Search: a Bibliography

Aroma: code recommendation via structural code search

Codehow: Effective Code Search Based On Api Understanding And Extended Boolean Model

Refine Software Q&A Document Search Results Based on Code Pattern

CodeScholar: Growing Idiomatic Code Examples

Mining API Usage Examples from Test Code

Optimising the fit of stack overflow code snippets into existing code

Graph Embedding Based Code Search in Software Project

Generating API-usage Example for Project Developers