Abstract:In this paper, we work on a general multivariate regression model under the regime that both p, the number of covariates, and n, the number of observations, are large with p∕n→κ(0<κ<∞). Unlike previous works that focus on a sparse regression vector β, we consider a more interesting situation in which β is composed of two groups: components in group I are large while components in group II are small but possibly not zeros. This study aims to explore the asymptotic behavior of the ridge-regularized high-dimensional multivariate M-estimator of β in group II. By applying the double leave-one-out method, we successfully derive a nonlinear system comprised of two deterministic equations, which characterizes the risk behavior of the M-estimator. The system solution also enables us to yield asymptotic normality for each component of the M-estimator. Moreover, we present rigorous proofs to these approximations that play a critical role in deriving the system. Finally, we perform experimental validations to demonstrate the performance of the proposed system.

Developments on MTP2 Properties of Absolute Value Multinormal Variables with Nonzero Means

Asymptotics for Self-Normalized Random Products of Sums of I.i.d. Random Variables

A Probability Inequality for Convolutions of MTP2-Distribution Functions

Asymptotic Approximation of Inverse Moments of Nonnegative Random Variables

M-Tensors and Some Applications.

SELF-NORMALIZED CENTRAL LIMIT THEOREM AND ESTIMATION OF VARIANCE OF PARTIAL SUMS FOR NEGATIVE DEPENDENT RANDOM VARIABLES

Asymptotic Theory of Least Distances Estimate in Multivariate Linear Models

Multilinear Systems with <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" altimg="si424.gif" overflow="scroll"><mml:mi mathvariant="bold-script">ℳ</mml:mi></mml:math>-Tensors

Dependence Structure of a Class of Symmetric Distributions

Univariate Normal Model

T product Tensors Part II: Tail Bounds for Sums of Random T product Tensors

Some Properties of Λ Ω P ( X, Μ )

Multivariate transforms of total positivity

Partial Generalized Four Moment Theorem Revisited

M-tensors and Nonsingularm-Tensors

TP2 DEPENDENCE OF SAMPLE SPACINGS WITH APPLICATIONS

Fast Projected Newton-like Method for Precision Matrix Estimation under Total Positivity

M-tensors and the Positive Definiteness of a Multivariate Form

Existence and uniqueness of positive solution for multilinear systems with generalized strong M-tensor

Asymptotic properties on high-dimensional multivariate regression M-estimation

Condition Numbers of the Multidimensional Total Least Squares Problems Having More Than One Solution