Abstract:Commit Classification(CC) is an important task in software maintenance since it helps software developers classify code changes into different types according to their nature and purpose. This allows them to better understand how their development efforts are progressing, identify areas where they need improvement. However, existing methods are all discriminative models, usually with complex architectures that require additional output layers to produce class label probabilities. Moreover, they require a large amount of labeled data for fine-tuning, and it is difficult to learn effective classification boundaries in the case of limited labeled data. To solve above problems, we propose a generative framework that Incorporating prompt-tuning for commit classification with prior knowledge (IPCK) <a class="link-external link-https" href="https://github.com/AppleMax1992/IPCK" rel="external noopener nofollow">this https URL</a>, which simplifies the model structure and learns features across different tasks. It can still reach the SOTA performance with only limited samples. Firstly, we proposed a generative framework based on T5. This encoder-decoder construction method unifies different CC task into a text2text problem, which simplifies the structure of the model by not requiring an extra output layer. Second, instead of fine-tuning, we design an prompt-tuning solution which can be adopted in few-shot scenarios with only limit samples. Furthermore, we incorporate prior knowledge via an external knowledge graph to map the probabilities of words into the final labels in the speech machine step to improve performance in few-shot scenarios. Extensive experiments on two open available datasets show that our framework can solve the CC problem simply but effectively in few-shot and zeroshot scenarios, while improving the adaptability of the model without requiring a large amount of training samples for fine-tuning.

CCPrefix: Counterfactual Contrastive Prefix-Tuning for Many-Class Classification

User-Aware Prefix-Tuning is a Good Learner for Personalized Image Captioning

On Robust Prefix-Tuning for Text Classification

Controllable Natural Language Generation with Contrastive Prefixes

Control Prefixes for Parameter-Efficient Text Generation

Focused Prefix Tuning for Controllable Text Generation

Towards Infinite-Long Prefix in Transformer

When Do Prompting and Prefix-Tuning Work? A Theory of Capabilities and Limitations

Prefix tuning for automated audio captioning

KnowPrefix-Tuning: A Two-Stage Prefix-Tuning Framework for Knowledge-Grounded Dialogue Generation

Inducer-tuning: Connecting Prefix-tuning and Adapter-tuning

Learning Easily Updated General Purpose Text Representations with Adaptable Task-Specific Prefixes

Preserving Pre-trained Representation Space: On Effectiveness of Prefix-tuning for Large Multi-modal Models

An Enhanced Few-Shot Text Classification Approach by Integrating Topic Modeling and Prompt-tuning

Incorprating Prompt tuning for Commit classification with prior Knowledge

Revisiting Prefix-tuning: Statistical Benefits of Reparameterization among Prompts

On Prefix-tuning for Lightweight Out-of-distribution Detection.

Exploring Soft Prompt Initialization Strategy for Few-Shot Continual Text Classification

CrossTune: Black-Box Few-Shot Classification with Label Enhancement

L-TUNING: Synchronized Label Tuning for Prompt and Prefix in LLMs

P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks