Abstract:Code idioms are commonly used patterns, techniques, or practices that aid in solving particular problems or specific tasks across multiple software projects. They can improve code quality, performance, and maintainability, and also promote program standardization and reuse across projects. However, identifying code idioms is significantly challenging, as existing studies have still suffered from three main limitations. First, it is difficult to recognize idioms that span non-contiguous code lines. Second, identifying idioms with intricate data flow and code structures can be challenging. More-over, they only extract dataset-specific idioms, so common idioms or well-established code/design patterns that are rarely found in datasets cannot be identified. To overcome these limitations, we propose a novel approach, named Idiomine, to automatically extract generic and specific idioms from both Java projects and libraries. We perform program analysis on Java functions to transform them into concise PDGs, for integrating the data flow and control flow of code fragments. We then develop a novel chain structure, Data-driven Control Chain (DCC), to extract sub-idioms that possess contiguous semantic meanings from PDGs. After that, we utilize GraphCodeBERT to generate code embeddings of these sub-idioms and perform density-based clustering to obtain frequent sub-idioms. We use heuristic rules to identify interrelated sub-idioms among the frequent ones. Finally, we employ ChatGPT to synthesize interrelated sub-idioms into potential code idioms and infer real idioms from them. We conduct well-designed experiments and a user study to evaluate Idiomine's correctness and the practical value of the extracted idioms. Our experimental results show that Idiomine effectively extracts more idioms with better performance in most metrics. We compare our approach with Haggis and ChatGPT, Idiomine outperforms them by 22.8% and 35.5% in Idiom Set Precision (ISP) and by 9.7% and 22.9% in Idiom Coverage (IC) when extracting idioms from libraries. Idiomine also extracts almost twice the size of idioms than the baselines, exhibiting its ability to identify complete idioms. Our user study indicates that idioms extracted by Idiomine are well-formed and semantically clear. Moreover, we conduct a qualitative and quantitative analysis to investigate the primary functionalities of Idiomine's extracted idioms from various projects and libraries.

Nli2code: Reusing Libraries With Natural Language Interface

From API to NLI: A New Interface for Library Reuse

Streamlining Java Programming: Uncovering Well-Formed Idioms with IdioMine

Accurate Library Recommendation Using Combining Collaborative Filtering and Topic Model for Mobile Development.

Natural Language-Guided Programming

LILO: Learning Interpretable Libraries by Compressing and Documenting Code

LibN3L: A Lightweight Package for Neural NLP.

Natural Language Generation and Understanding of Big Code for AI-Assisted Programming: A Review

Natural Language-Oriented Programming (NLOP): Towards Democratizing Software Creation

Improving Natural Language Capability of Code Large Language Model

Leroy: Library Learning for Imperative Programming Languages

AIOS Compiler: LLM as Interpreter for Natural Language Programming and Flow Programming of AI Agents

NoviCode: Generating Programs from Natural Language Utterances by Novices

No Man is an Island: Towards Fully Automatic Programming by Code Search, Code Generation and Program Repair

DiffCoder: Enhancing Large Language Model on API Invocation via Analogical Code Exercises

CodeGen4Libs: A Two-Stage Approach for Library-Oriented Code Generation.

A natural language interface to a graph-based bibliographic information retrieval system

CodeS: Natural Language to Code Repository via Multi-Layer Sketch

Program Synthesis using Natural Language

Integrating NLP Using Linked Data