Abstract:Learning distributed representations of source code has been a challenging task for machine learning models. Earlier works treated programs as text so that natural language methods can be readily applied. Unfortunately, such approaches do not capitalize on the rich structural information possessed by source code. Of late, Graph Neural Network (GNN) was proposed to learn embeddings of programs from their graph representations. Due to the homogeneous (i.e. do not take advantage of the program-specific graph characteristics) and expensive (i.e. require heavy information exchange among nodes in the graph) message-passing procedure, GNN can suffer from precision issues, especially when dealing with programs rendered into large graphs. In this paper, we present a new graph neural architecture, called Graph Interval Neural Network (GINN), to tackle the weaknesses of the existing GNN. Unlike the standard GNN, GINN generalizes from a curated graph representation obtained through an abstraction method designed to aid models to learn. In particular, GINN focuses exclusively on intervals (generally manifested in looping construct) for mining the feature representation of a program, furthermore, GINN operates on a hierarchy of intervals for scaling the learning to large graphs. We evaluate GINN for two popular downstream applications: variable misuse prediction and method name prediction. Results show in both cases GINN outperforms the state-of-the-art models by a comfortable margin. We have also created a neural bug detector based on GINN to catch null pointer deference bugs in Java code. While learning from the same 9,000 methods extracted from 64 projects, GINN-based bug detector significantly outperforms GNN-based bug detector on 13 unseen test projects. Next, we deploy our trained GINN-based bug detector and Facebook Infer, arguably the state-of-the-art static analysis tool, to scan the codebase of 20 highly starred projects on GitHub. Through our manual inspection, we confirm 38 bugs out of 102 warnings raised by GINN-based bug detector compared to 34 bugs out of 129 warnings for Facebook Infer. We have reported 38 bugs GINN caught to developers, among which 11 have been fixed and 12 have been confirmed (fix pending). GINN has shown to be a general, powerful deep neural network for learning precise, semantic program embeddings.

JITGNN: A deep graph neural network framework for Just-In-Time bug prediction

Ignnvd: A Novel Software Vulnerability Detection Model Based on Integrated Graph Neural Networks

Graph-Based Machine Learning Improves Just-in-Time Defect Prediction

JITLine: A Simpler, Better, Faster, Finer-grained Just-In-Time Defect Prediction

Just-In-Time Defect Identification and Localization: A Two-Phase Framework.

Effort-aware and just-in-time defect prediction with neural network

Just-in-time Defect Prediction for Software Hunks

Code-centric learning-based just-in-time vulnerability detection

Parameter-efficient fine-tuning of pre-trained code models for just-in-time defect prediction

TEP-GNN: Accurate Execution Time Prediction of Functional Tests using Graph Neural Networks

An exploratory study on just-in-time multi-programming-language bug prediction

Just-In-Time Software Defect Prediction via Bi-modal Change Representation Learning

A code change‐oriented approach to just‐in‐time defect prediction with multiple input semantic fusion

Deep Learning for Just-In-Time Defect Prediction

Learning semantic program embeddings with graph interval neural network

Lane-Level Traffic Flow Prediction with Heterogeneous Data and Dynamic Graphs

ApacheJIT: A Large Dataset for Just-In-Time Defect Prediction

Leveraging structural properties of source code graphs for just-in-time bug prediction

IRJIT: A Simple, Online, Information Retrieval Approach for Just-In-Time Software Defect Prediction

The Need for a Fine-grained approach in Just-in-Time Defect Prediction