Abstract:To effectively guide the exploration of the code transform space for automated code evolution techniques, we present in this paper the first approach for structurally predicting code transforms at the level of AST nodes using conditional random fields (CRFs). Our approach first learns offline a probabilistic model that captures how certain code transforms are applied to certain AST nodes, and then uses the learned model to predict transforms for arbitrary new, unseen code snippets. {Our approach involves a novel representation of both programs and code transforms. Specifically, we introduce the formal framework for defining the so-called AST-level code transforms and we demonstrate how the CRF model can be accordingly designed, learned, and used for prediction}. We instantiate our approach in the context of repair transform prediction for Java programs. Our instantiation contains a set of carefully designed code features, deals with the training data imbalance issue, and comprises transform constraints that are specific to code. We conduct a large-scale experimental evaluation based on a dataset of bug fixing commits from real-world Java projects. The results show that when the popular evaluation metric \emph{top-3} is used, our approach predicts the code transforms with an accuracy varying from 41\% to 53\% depending on the transforms. Our model outperforms two baselines based on history probability and neural machine translation (NMT), suggesting the importance of considering code structure in achieving good prediction accuracy. In addition, a proof-of-concept synthesizer is implemented to concretize some repair transforms to get the final patches. The evaluation of the synthesizer on the Defects4j benchmark confirms the usefulness of the predicted AST-level repair transforms in producing high-quality patches.

Structurally-Enhanced Approach for Automatic Code Transformation

Dynamically Relative Position Encoding-Based Transformer for Automatic Code Edit

StructCoder: Structure-Aware Transformer for Code Generation

Code Structure–Guided Transformer for Source Code Summarization

CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing

A Closer Look into Transformer-Based Code Intelligence Through Code Transformation: Challenges and Opportunities

Learning the Relation between Code Features and Code Transforms with Structured Prediction

TransformCode: A Contrastive Learning Framework for Code Embedding Via Subtree Transformation

AST-trans

kTrans: Knowledge-Aware Transformer for Binary Code Embedding

Code2Text: Dual Attention Syntax Annotation Networks for Structure-Aware Code Translation

TRANSAGENT: An LLM-Based Multi-Agent System for Code Translation

InterTrans: Leveraging Transitive Intermediate Translations to Enhance LLM-based Code Translation

An Extensive Study of the Structure Features in Transformer-based Code Semantic Summarization.

Automatic Code Annotation Generation Based on Multi-dimensional Heterogeneous Graph Structure

Inferring Program Transformations from Singular Examples Via Big Code

Code comment generation based on graph neural network enhanced transformer model for code understanding in open-source software ecosystems

Unleashing the Power of Transformer for Graphs

hmCodeTrans: Human-Machine Interactive Code Translation

Similarity-Based Source Code Vulnerability Detection Leveraging Transformer Architecture: Harnessing Cross- Attention for Hierarchical Analysis

AST-Trans: Code Summarization with Efficient Tree-Structured Attention