Abstract:Semantic understanding of programs is a fundamental problem for programming language processing (PLP). Recent works that learn representations of code based on pre-training techniques in NLP have pushed the frontiers in this direction. However, the semantics of PL and NL have essential differences. These being ignored, we believe it is difficult to build a model to better understand programs, by either directly applying off-the-shelf NLP pre-training techniques to the source code, or adding features to the model by the heuristic. In fact, the semantics of a program can be rigorously defined by formal semantics in PL theory. For example, the operational semantics, describes the meaning of a valid program as updating the environment (i.e., the memory address-value function) through fundamental operations, such as memory I/O and conditional branching. Inspired by this, we propose a novel program semantics learning paradigm, that the model should learn from information composed of (1) the representations which align well with the fundamental operations in operational semantics, and (2) the information of environment transition, which is indispensable for program understanding. To validate our proposal, we present a hierarchical Transformer-based pre-training model called OSCAR to better facilitate the understanding of programs. OSCAR learns from intermediate representation (IR) and an encoded representation derived from static analysis, which are used for representing the fundamental operations and approximating the environment transitions respectively. OSCAR empirically shows the outstanding capability of program semantics understanding on many practical software engineering tasks. Code and models are released at: https://github com/pdlan/OSCAR.

Software Planned Learning and Recognition Based on the Sequence Learning and Narx Memory Model of Neural Network

A Spiking Neural Network System for Robust Sequence Recognition

How could Neural Networks understand Programs?

Vision-Action Semantic Associative Learning Based on Spiking Neural Networks for Cognitive Robot.

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Learning Sequence Representations by Non-local Recurrent Neural Memory

A hippocampus CA3 spiking neural network model for storage and retrieval of sequential memory

Non-local Recurrent Neural Memory for Supervised Sequence Modeling

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding.

Robust Neuro-Symbolic Goal and Plan Recognition

A Spike-Timing Based Integrated Model for Pattern Recognition

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

Learning Solving Procedure for Artificial Neural Network

Regression Planning Networks

Incorporating structural plasticity into self-organization recurrent networks for sequence learning

Learning whom to trust in navigation: dynamically switching between classical and neural planning

NSP: A Neuro-Symbolic Natural Language Navigational Planner

SynapNet: A Complementary Learning System Inspired Algorithm With Real-Time Application in Multimodal Perception

Learning Neuro-Symbolic Relational Transition Models for Bilevel Planning

Learning to Recover from Plan Execution Errors during Robot Manipulation: A Neuro-symbolic Approach

Concept learning through deep reinforcement learning with memory-augmented neural networks