Abstract:We prove that the set of closed orbits in a real reductive representation contains a subset which is open with respect to the real Zariski topology if it has non-empty interior. In particular the set of closed orbits is dense.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is about the properties of closed orbits in real reductive representations. Specifically, the author studied the representation of a real Lie group \(G\) on a real vector space \(V\), and explored the topological properties of the set of closed orbits. The main problem is to prove that under certain conditions, the set of closed orbits contains a subset that is open with respect to the real Zariski topology, and this set is dense.
### Specific description of the problem
Consider an action \(G\times V\rightarrow V\) of a real Lie group \(G\) on a finite - dimensional real vector space \(V\). If there exists a complex reductive Lie group \(U_{C}\) and a Cartan involution \(\theta\) such that \(G\) is a \(\theta\)-stable subgroup of \(U_{C}\), and the representation of \(G\) can be extended to a holomorphic representation of \(U_{C}\) on a complex vector space containing \(V\), then this representation is called a real reductive representation.
Let \(V_{c}\) denote the set of closed \(G\)-orbits in \(V\). The main results of the author are as follows:
**Theorem 1**: Let \(G\times V\rightarrow V\) be a real reductive representation, and \(W\) be a subspace of \(V\) such that \(V_{c}\cap W\) has a non - empty interior in \(W\). Then \(V_{c}\cap W\) contains a subset \(U\) that is open in \(W\) with respect to the real Zariski topology. In particular, \(V_{c}\cap W\) is dense in \(W\). If \(W\) is \(G\)-invariant, then \(U\) can be chosen to be \(G\)-invariant.
### Methods for solving the problem
To prove the above theorem, the author used several methods and techniques:
1. **Complexified representation**: Complexify the \(G\)-representation \(V\) into a \(U_{C}\)-representation \(V_{C}\), and use tools in complex geometry (such as moment maps) to study the properties of closed orbits.
2. **Stratified structure**: Simplify the problem through the stratified structure of closed orbit types, especially when \(G\) is semisimple or commutative.
3. **Mixed case**: For the case where \(G\) is the product of its center and a semisimple subgroup, construct a new group \(H\) such that \(H\) is a real form of some complex reductive group, and the \(H\)-representation can be extended to a \(U_{C}\)-representation.
4. **Application of moment maps**: Use moment maps to connect closed orbits with the orbits of maximal compact subgroups, thereby proving the density of closed orbits.
### Conclusion
This paper successfully proved the density and openness of the set of closed orbits in real reductive representations by introducing new techniques and tools, which provides an important theoretical basis for subsequent research.