Abstract:Context: Neural code generation aims to automatically generate code snippets guided by Natural Language Descriptions (NLDs). In recent years, various neural code generation models for mainstream Programming Languages (PLs), such as Java and Python, have been proposed and demonostrated significant success in prior studies. Nonetheless, due to the scarcity of available training examples for some domain-specific PLs, such as Solidity, Bash, and Clojure, simply adopting previous neural models may lead to overfitting and inadequate learning. Objective: To overcome this challenge, we propose MetaCoder, a novel meta-learning code generation approach that efficiently extracts general-purpose knowledge from a large-scale source language and rapidly adapts to domain-specific scenarios, even with relatively few samples. Method: MetaCoder employs MAML, a powerful few-shot meta-learning method, to construct a transfer learning framework. This framework learns general-purpose knowledge from large-scale source languages and applies it in domain-specific target languages. To acquire more general-purpose knowledge, heterogeneous sub-tasks are constructed from the source language during the pre-training phase of MAML. As such, combining with CodeBERT and K-means, we design an unsupervised category assignment method for code generation samples, thereby exploiting the n -way k -shot rule to construct the heterogeneous sub-tasks. Consequently, MetaCoder can be applied to the code generation field. Results: We evaluate MetaCoder with both tree-based (e.g., TreeGen) and sequence-based (e.g., CodeGPT) backbones on two domain-specific PLs, including Solidity and Bash. Extensive experiments demonstrate the superior performance of our approach compared to baselines and verified its capability of code generation visually in practice. Conclusion: MetaCoder effectively extracts general-purpose knowledge from large-scale source languages, thereby enhancing model performance. Therefore, we highly recommend MetaCoder as a code generation approach for domain-specific PLs.

Adaptive Code Completion with Meta-learning.

A Self-Attentional Neural Architecture for Code Completion with Multi-Task Learning.

MetaComp: Learning to Adapt for Online Depth Completion

Multi-task learning based pre-trained language model for code completion

A unified multi-task learning model for AST-level and token-level code completion

Deep Learning Based Code Completion Models for Programming Codes.

AdaComplete: improve DL-based code completion method’s domain adaptability

Sequence Model Design for Code Completion in the Modern IDE

Domain Adaptive Code Completion via Language Models and Decoupled Domain Databases

Improving domain-specific neural code generation with few-shot meta-learning

Towards Full-line Code Completion with Neural Language Models

ReACC: A Retrieval-Augmented Code Completion Framework

Precise Learning of Source Code Contextual Semantics via Hierarchical Dependence Structure and Graph Attention Networks

A Neural Network Based Intelligent Support Model for Program Code Completion

Enriching Source Code with Contextual Data for Code Completion Models: An Empirical Study

Non-Autoregressive Line-Level Code Completion

Teaching Code LLMs to Use Autocompletion Tools in Repository-Level Code Generation

ESALE: Enhancing Code-Summary Alignment Learning for Source Code Summarization

Does Your Neural Code Completion Model Use My Code? A Membership Inference Approach

On-the-Fly Adapting Code Summarization on Trainable Cost-Effective Language Models.