Abstract:Code summarization aims to generate brief natural language descriptions for source codes. The state-of-the-art approaches follow a transformer-based encoder-decoder architecture. As the source code is highly structured and follows strict grammars, its Abstract Syntax Tree (AST) is widely used for encoding structural information. However, ASTs are much longer than the corresponding source code. Existing approaches ignore the size constraint and simply feed the whole linearized AST into the encoders. We argue that such a simple process makes it difficult to extract the truly useful dependency relations from the overlong input sequence. It also incurs significant computational overhead since each node needs to apply self-attention to all other nodes in the AST. To encode the AST more effectively and efficiently, we propose AST-Trans in this paper which exploits two types of node relationships in the AST: ancestor-descendant and sibling relationships. It applies the tree-structured attention to dynamically allocate weights for relevant nodes and exclude irrelevant nodes based on these two relationships. We further propose an efficient implementation to support fast parallel computation for tree-structure attention. On the two code summarization datasets, experimental results show that AST-Trans significantly outperforms the state-of-the-arts while being times more efficient than standard transformers (1).

Asts: A String-Wise Address Space Transformation Algorithm For Real-Time Collaborative Editing

Making Itinerary Planning Collaborative: an AST-based Approach

Character-based consistency maintenance in Web-based real-time cooperative edit system

A Differential Testing Approach for Evaluating Abstract Syntax Tree Mapping Algorithms

An Optimized String Transformation Algorithm for Real-Time Group Editors

A Data Filtering Approach Based on Updateable Queue & Interactive Stream

ABTS: A transformation-based consistency control algorithm for wide-area collaborative applications

Locking Intention Preservation Based On Address Space Transformation Technique

Constructing Format-Preserving Printing from Syntax-Directed Definitions.

AST-trans

Maintaining Time and Space Consistencies in Hybrid CAD Environments: Framework and Algorithms

An Algebraic Approach to Bi-directional Updating

Towards Efficient Control Flow Handling in Spatial Architecture via Architecting the Control Flow Plane

Key Techniques of Consistency Maintenance in Real-time Collaboration

A Fast Operational Transformation Algorithm for Mobile and Asynchronous Collaboration

ASTormer: An AST Structure-aware Transformer Decoder for Text-to-SQL

An Operational Transformation Based Synchronization Protocol for Web 2.0 Applications.

A Heterogeneous Graph to Abstract Syntax Tree Framework for Text-to-SQL

Rethinking Control Flow in Spatial Architectures: Insights into Control Flow Plane Design

AST-Trans: Code Summarization with Efficient Tree-Structured Attention