Abstract:Large language models~(LLMs) demonstrate significant potential to revolutionize software engineering (SE) by exhibiting outstanding performance in SE tasks such as code and document generation. However, the high reliability and risk control requirements in software engineering raise concerns about the lack of interpretability of LLMs. To address this concern, we conducted a study to evaluate the capabilities of LLMs and their limitations for code analysis in SE. We break down the abilities needed for artificial intelligence~(AI) models to address SE tasks related to code analysis into three categories: 1) syntax understanding, 2) static behavior understanding, and 3) dynamic behavior understanding. Our investigation focused on the ability of LLMs to comprehend code syntax and semantic structures, which include abstract syntax trees (AST), control flow graphs (CFG), and call graphs (CG). We employed four state-of-the-art foundational models, GPT4, GPT3.5, StarCoder and CodeLlama-13b-instruct. We assessed the performance of LLMs on cross-language tasks involving C, Java, Python, and Solidity. Our findings revealed that while LLMs have a talent for understanding code syntax, they struggle with comprehending code semantics, particularly dynamic semantics. We conclude that LLMs possess capabilities similar to an Abstract Syntax Tree (AST) parser, demonstrating initial competencies in static code analysis. Furthermore, our study highlights that LLMs are susceptible to hallucinations when interpreting code semantic structures and fabricating nonexistent facts. These results indicate the need to explore methods to verify the correctness of LLM output to ensure its dependability in SE. More importantly, our study provides an initial answer to why the codes generated by LLM are usually syntax-correct but vulnerable.

Implementing of Gaussian Syntax-analyzer using ANTLR

A Differential Testing Approach for Evaluating Abstract Syntax Tree Mapping Algorithms

A Method for Parsing GCC abstract Syntax Tree

Generalized LR syntactic analysis algorithm based on neural network

Design and Implementation of the Visual Basic Language Analyzer Based on Test Semantics

Syntactic Representation Transformation in Operator Design Method Based on ANTLR Tool

THE ALGORITHM FOR ATTRIBUTED GRAMMAR EVALUATOR BASED ON LR ANALYSIS AND BACKFILLING TECHNIQUE

Static Code Analyzer Using Micro-Grammar

Parsing and abstract syntax tree generation in the GIPSY system

Generating an ATL Model Checker using an Attribute Grammar

Research on a G Code Translator of Virtual NC Machining System

A Method for Parsing Functional Language in Digital System Design

Computer-Aided Grammar Acquisition in the Chinese Understanding System CUSAGA.

Experiences in Building C++ Front End.

Patterns for Name Analysis and Type Analysis with JastAdd

LMs: Understanding Code Syntax and Semantics for Code Analysis

Application of Grammatical Parsing Technique in Chinese Input

On Classification of the extremal contraction from a smooth fourfold

Saggitarius: A DSL for Specifying Grammatical Domains

GGF: A Graph-based Method for Programming Language Syntax Error Correction

Integrating NLP and context-free grammar for complex rule interpretation towards automated compliance checking