Abstract:The theory of strings with concatenation has been widely argued as the basis of constraint solving for verifying string-manipulating programs. However, this theory is far from adequate for expressing many string constraints that are also needed in practice; for example, the use of regular constraints (pattern matching against a regular expression), and the string-replace function (replacing either the first occurrence or all occurrences of a ``pattern'' string constant/variable/regular expression by a ``replacement'' string constant/variable), among many others. Both regular constraints and the string-replace function are crucial for such applications as analysis of JavaScript (or more generally HTML5 applications) against cross-site scripting (XSS) vulnerabilities, which motivates us to consider a richer class of string constraints. The importance of the string-replace function (especially the replace-all facility) is increasingly recognised, which can be witnessed by the incorporation of the function in the input languages of several string constraint solvers. Recently, it was shown that any theory of strings containing the string-replace function (even the most restricted version where pattern/replacement strings are both constant strings) becomes undecidable if we do not impose some kind of straight-line (aka acyclicity) restriction on the formulas. Despite this, the straight-line restriction is still practically sensible since this condition is typically met by string constraints that are generated by symbolic execution. In this paper, we provide the first systematic study of straight-line string constraints with the string-replace function and the regular constraints as the basic operations. We show that a large class of such constraints (i.e. when only a constant string or a regular expression is permitted in the pattern) is decidable. We note that the string-replace function, even under this restriction, is sufficiently powerful for expressing the concatenation operator and much more (e.g. extensions of regular expressions with string variables). This gives us the most expressive decidable logic containing concatenation, replace, and regular constraints under the same umbrella. Our decision procedure for the straight-line fragment follows an automata-theoretic approach, and is modular in the sense that the string-replace terms are removed one by one to generate more and more regular constraints, which can then be discharged by the state-of-the-art string constraint solvers. We also show that this fragment is, in a way, a maximal decidable subclass of the straight-line fragment with string-replace and regular constraints. To this end, we show undecidability results for the following two extensions: (1) variables are permitted in the pattern parameter of the replace function, (2) length constraints are permitted.

Symbolic Solving of Extended Regular Expression Inequalities

Derivative Based Extended Regular Expression Matching Supporting Intersection, Complement and Lookarounds

Derivatives for Enhanced Regular Expressions

Expressiveness modulo Bisimilarity of Regular Expressions with Parallel Composition (Extended Abstract)

Constrained Expressions and their Derivatives

A Symbolic Algorithm for the Case-Split Rule in Solving Word Constraints with Extensions (Technical Report)

Symbolic Automata: $ω$-Regularity Modulo Theories

Solving String Constraints with Regex-dependent Functions Through Transducers with Priorities and Variables

Specialized Mathematical Solving by a Step-By-Step Expression Chain Generation

String Constraints with Concatenation and Transducers Solved Efficiently (Technical Report)

The Image of the Process Interpretation of Regular Expressions is Not Closed under Bisimulation Collapse

Hybrid Regular Expressions

Decision Procedures for Sequence Theories (Technical Report)

Regular Substitution Sets: A Means of Controlling E-Unification

Extending Regular Expressions with Duration Constraints for Modelling and Verifying Hybrid Systems

Parikh's Theorem Made Symbolic

What is Decidable about String Constraints with the ReplaceAll Function

Sound Regular Expression Semantics for Dynamic Symbolic Execution of JavaScript

Two-Sided Derivatives for Regular Expressions and for Hairpin Expressions

Optimizing Regular Expressions via Rewrite-Guided Synthesis

Deterministic Regular Expressions With Back-References