Abstract:The orbits of the orthogonal and symplectic groups on the flag variety are in bijection, respectively, with the involutions and fixed-point-free involutions in the symmetric group $S_n$. Wyser and Yong have described polynomial representatives for the cohomology classes of the closures of these orbits, which we denote as $\hat{\mathfrak{S}}_y$ (to be called involution Schubert polynomials) and $\hat{\mathfrak{S}}^{\tt FPF}_y$ (to be called fixed-point-free involution Schubert polynomials). Our main results are explicit formulas decomposing the product of $\hat{\mathfrak{S}}_y$ (respectively, $\hat{\mathfrak{S}}^{\tt FPF}_y$) with any $y$-invariant linear polynomial as a linear combination of other involution Schubert polynomials. These identities serve as analogues of Lascoux and Schützenberger's transition formula for Schubert polynomials, and lead to a self-contained algebraic proof of the nontrivial equivalence of several definitions of $\hat{\mathfrak{S}}_y$ and $\hat{\mathfrak{S}}^{\tt FPF}_y$ appearing in the literature. Our formulas also imply combinatorial identities about involution words, certain variations of reduced words for involutions in $S_n$. We construct operators on involution words based on the Little map to prove these identities bijectively. The proofs of our main theorems depend on some new technical results, extending work of Incitti, about covering relations in the Bruhat order of $S_n$ restricted to involutions.

Hertzsprung patterns on involutions

Wilf classification of bi-vincular permutation patterns

Patterns in Multi-dimensional Permutations

Thresholds for patterns in random permutations with a given number of inversions

An equidistribution involving invisible inversions

From geometry to generating functions: rectangulations and permutations

Involution matrix loci and orbit harmonics

How to write a permutation as a product of involutions (and why you might care)

Counting occurrences of patterns in permutations

Pattern containment in random permutations

Counting Involutions on Multicomplex Numbers

Involutes of null Cartan curves and their representations in Minkowski 3-space

Congruences Involving Permutation

Pattern Avoiding Permutations Enumerated by Inversions

Self-similar surfaces: involutions and perfection

Pattern-avoiding Cayley permutations via combinatorial species

Enumerating Permutations Avoiding Split Patterns 3|12 and 23|1

Moments of permutation statistics and central limit theorems

Involution words: counting problems and connections to Schubert calculus for symmetric orbit closures

Toroidal Hitomezashi Patterns

Transition formulas for involution Schubert polynomials