Abstract:Code idioms are commonly used patterns, techniques, or practices that aid in solving particular problems or specific tasks across multiple software projects. They can improve code quality, performance, and maintainability, and also promote program standardization and reuse across projects. However, identifying code idioms is significantly challenging, as existing studies have still suffered from three main limitations. First, it is difficult to recognize idioms that span non-contiguous code lines. Second, identifying idioms with intricate data flow and code structures can be challenging. More-over, they only extract dataset-specific idioms, so common idioms or well-established code/design patterns that are rarely found in datasets cannot be identified. To overcome these limitations, we propose a novel approach, named Idiomine, to automatically extract generic and specific idioms from both Java projects and libraries. We perform program analysis on Java functions to transform them into concise PDGs, for integrating the data flow and control flow of code fragments. We then develop a novel chain structure, Data-driven Control Chain (DCC), to extract sub-idioms that possess contiguous semantic meanings from PDGs. After that, we utilize GraphCodeBERT to generate code embeddings of these sub-idioms and perform density-based clustering to obtain frequent sub-idioms. We use heuristic rules to identify interrelated sub-idioms among the frequent ones. Finally, we employ ChatGPT to synthesize interrelated sub-idioms into potential code idioms and infer real idioms from them. We conduct well-designed experiments and a user study to evaluate Idiomine's correctness and the practical value of the extracted idioms. Our experimental results show that Idiomine effectively extracts more idioms with better performance in most metrics. We compare our approach with Haggis and ChatGPT, Idiomine outperforms them by 22.8% and 35.5% in Idiom Set Precision (ISP) and by 9.7% and 22.9% in Idiom Coverage (IC) when extracting idioms from libraries. Idiomine also extracts almost twice the size of idioms than the baselines, exhibiting its ability to identify complete idioms. Our user study indicates that idioms extracted by Idiomine are well-formed and semantically clear. Moreover, we conduct a qualitative and quantitative analysis to investigate the primary functionalities of Idiomine's extracted idioms from various projects and libraries.

Method Chaining Redux: An Empirical Study of Method Chaining in Java, Kotlin, and Python

An Empirical Study of Long Method and God Method in Industrial Projects.

Streamlining Java Programming: Uncovering Well-Formed Idioms with IdioMine

CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules

Whole-body Systems Biology for Understanding Human Organismal Complexity

An empirical study of code reuse between GitHub and stack overflow during software development

Bi-Chainer: Automated Large Language Models Reasoning with Bidirectional Chaining

Chain of Code: Reasoning with a Language Model-Augmented Code Emulator

Designing LLM Chains by Adapting Techniques from Crowdsourcing Workflows

Cross-Language Dependencies: An Empirical Study of Kotlin-Java

How Do I Refactor This? An Empirical Study on Refactoring Trends and Topics in Stack Overflow

ChainBuddy: An AI Agent System for Generating LLM Pipelines

In-IDE Code Generation from Natural Language: Promise and Challenges

A Comparative Study of Programming Languages in Rosetta Code

Replication Can Improve Prior Results: A GitHub Study of Pull Request Acceptance

Impact of methodological choices on the analysis of code metrics and maintenance

Tables of Nuclear Cross Sections and Reaction Rates: an Addendum to the Paper "Astrophysical Reaction Rates from Statistical Model Calculations"

Investigating Student Reasoning in Method-Level Code Refactoring: A Think-Aloud Study

Reverse Chain: A Generic-Rule for LLMs to Master Multi-API Planning

Data-Driven Program Completion

Characterizing Information Shared by Participants to Coding Challenges: The Case of Advent of Code