Extreme eigenvalues of principal minors of random matrix with moment conditions

Jianwei Hu,Seydou Keita,Kang Fu
2023-06-14
Abstract:Let $\bm{x}_1,\cdots,\bm{x}_n$ be a random sample of size $n$ from a $p$-dimensional population distribution, where $p=p(n)\rightarrow\infty$. Consider a symmetric matrix $W=X^\top X$ with parameters $n$ and $p$, where $X=(\bm{x}_1,\cdots,\bm{x}_n)^\top$. In this paper, motivated by model selection theory in high-dimensional statistics, we mainly investigate the asymptotic behavior of the eigenvalues of the principal minors of the random matrix $W$. For the Gaussian case, under a simple condition that $m=o(n/\log p)$, we obtain the asymptotic results on maxima and minima of the eigenvalues of all $m\times m$ principal minors of $W$. We also extend our results to general distributions with some moment conditions. Moreover, we gain the asymptotic results of the extreme eigenvalues of the principal minors in the case of the real Wigner matrix. Finally, similar results for the maxima and minima of the eigenvalues of all the principal minors with a size smaller than or equal to $m$ are also given.
Probability
What problem does this paper attempt to address?
### Problems Addressed by the Paper This paper primarily explores the asymptotic behavior of the extreme eigenvalues of principal submatrices of random matrices in the context of model selection theory in high-dimensional statistics. Specifically, the authors investigate the asymptotic properties of the extreme eigenvalues (maximum and minimum) of all \( m \times m \) principal submatrices of a random matrix \( W = X^\top X \) under certain moment conditions. #### Main Research Content: 1. **Results in the Gaussian Case**: For Gaussian distributions, when \( m = o(n / \log p) \), the authors obtained asymptotic results for the maximum and minimum eigenvalues of all \( m \times m \) principal submatrices. 2. **General Distribution Case**: The authors extended the results to general distributions with certain moment conditions, further exploring the asymptotic properties of the extreme eigenvalues under these distributions. 3. **Real Wigner Matrix Case**: Additionally, the authors studied the asymptotic results of the extreme eigenvalues of real Wigner matrices. #### Research Motivation: - **Variable Selection in High-Dimensional Statistics**: In high-dimensional statistics, variable selection is an important problem. The sparse Riesz condition (SRC) is one of the key assumptions for variable selection methods (such as the MC+ method), and SRC is closely related to the extreme eigenvalues of principal submatrices of random matrices. - **Consistency of Model Selection**: By studying the asymptotic behavior of extreme eigenvalues, the consistency and unbiasedness of model selection methods can be verified. #### Research Significance: - **Theoretical Contribution**: This paper relaxes some conditions in the existing literature, such as \( m = o(\min\{(\log p)^{1/3} / \log \log p, n^{1/4} / (\log n)^{3/2} (\log p)^{1/2}\}) \), and obtains asymptotic results under broader distribution conditions. - **Application Prospects**: These results have important implications for model selection, principal component analysis, factor analysis, and other fields in high-dimensional data. In summary, this paper provides new theoretical foundations and methods for model selection theory in high-dimensional statistics by deeply studying the asymptotic behavior of the extreme eigenvalues of principal submatrices of random matrices.