Abstract:The orbits of the orthogonal and symplectic groups on the flag variety are in bijection, respectively, with the involutions and fixed-point-free involutions in the symmetric group $S_n$. Wyser and Yong have described polynomial representatives for the cohomology classes of the closures of these orbits, which we denote as $\hat{\mathfrak{S}}_y$ (to be called involution Schubert polynomials) and $\hat{\mathfrak{S}}^{\tt FPF}_y$ (to be called fixed-point-free involution Schubert polynomials). Our main results are explicit formulas decomposing the product of $\hat{\mathfrak{S}}_y$ (respectively, $\hat{\mathfrak{S}}^{\tt FPF}_y$) with any $y$-invariant linear polynomial as a linear combination of other involution Schubert polynomials. These identities serve as analogues of Lascoux and Schützenberger's transition formula for Schubert polynomials, and lead to a self-contained algebraic proof of the nontrivial equivalence of several definitions of $\hat{\mathfrak{S}}_y$ and $\hat{\mathfrak{S}}^{\tt FPF}_y$ appearing in the literature. Our formulas also imply combinatorial identities about involution words, certain variations of reduced words for involutions in $S_n$. We construct operators on involution words based on the Little map to prove these identities bijectively. The proofs of our main theorems depend on some new technical results, extending work of Incitti, about covering relations in the Bruhat order of $S_n$ restricted to involutions.

Replacing Pfaffians and applications

$p$-adic analogues of two ${}_4F_3$ hypergeometric identities and their applications

Pfaff's Method Revisited

Quadratic Residues and Related Permutations and Identities

Upper Bounds for Perfect Matchings in Pfaffian and Planar Graphs

Fay Identities of Pfaffian Type for Hyperelliptic Curves

Polynomial identities and Fermat quotients

Further results on enumeration of perfect matchings of Cartesian product graphs

Dynamical quantum determinants and Pfaffians

On refined enumerations of totally symmetric self-complementary plane partitions I

Polynomial Quotient Rings and Kronecker Substitution for Deriving Combinatorial Identities

On Generalized Pfaffians

Incidences with Pfaffian Curves and Functions

Transition formulas for involution Schubert polynomials

On determinants involving $(\frac{j+k}p)\pm(\frac{j-k}p)$

Quadratic transformations of Macdonald and Koornwinder polynomials

Reformulations and Generalizations of Hoffman's and Genčev's Combinatorial Identities

Pfaffian Formulation of Schur's $Q$-functions

Perfect matchings and spanning trees: squarishness, bijections and independence

Solution of some tiling open problems of Propp, Lai, and some related results

Dimer face polynomials in knot theory and cluster algebras