Multivariate Order Statistics: The Intermediate Case

Michael Falk,Florian Wisheckel

DOI: https://doi.org/10.48550/arXiv.1607.05896

2016-07-20

Abstract:Asymptotic normality of intermediate order statistics taken from univariate iid random variables is well-known. We generalize this result to random vectors in arbitrary dimension, where the order statistics are taken componentwise.

Statistics Theory

What problem does this paper attempt to address?

Asymptotic independence of bivariate order statistics

Michael Falk,Florian Wisheckel

DOI: https://doi.org/10.1016/j.spl.2017.01.020

2017-06-01

Abstract:It is well known that an extreme order statistic and a central order statistic (os) as well as an intermediate os and a central os from a sample of iid univariate random variables get asymptotically independent as the sample size increases. We extend this result to bivariate random variables, where the os are taken componentwise. An explicit representation of the conditional distribution of bivariate os turns out to be a powerful tool.

statistics & probability
Hessian and increasing-Hessian orderings of scale-shape mixtures of multivariate skew-normal distributions and applications

Mehdi Amiri,Narayanaswamy Balakrishnan

DOI: https://doi.org/10.1016/j.cam.2021.113801

IF: 2.872

2022-03-01

Journal of Computational and Applied Mathematics

Abstract:In this work, we establish some stochastic comparison results for the class of scale-shape mixtures of multivariate skew-normal (SSSN) distributions. These multivariate stochastic comparisons involve Hessian and increasing-Hessian orderings as well as many of their special cases. We show that the supermodular and increasing-supermodular orderings are equivalent to the concordance and upper orthant orderings, respectively, as well as the ordering of correlations within the underlying vectors of variables. The supermodular and increasing-supermodular orderings of log-SSSN family are also shown to be equivalent to the convex ordering and increasing-convex orderings of their geometric and harmonic averages. These results are then used to order the stability of average of relatives and aggregate value of portfolios through the order of their correlations. The aggregate claims of insurance portfolios is ordered, in the sense of stop-loss ordering, through the order of their average correlations. A multivariate stop-loss order is proposed to order the multivariate aggregate claims in SSSN family and is then shown to be equivalent to the concordance and upper orthant orderings in the sense of supermodular and increasing-supermodular orderings, respectively, based on the ordering of inter dependence of claims in the portfolios. In addition, the Gini index of SSSN risks is ordered, in the sense of increasing-convex order, with respect to the strength of correlations. Finally, the results are used in analyzing some real data sets to provide illustrations for the established results and practical interpretations.

mathematics, applied
A hypothesis test for independence of sets of variates in high dimensions

Zhengyan Lin,Yanbiao Xiang

DOI: https://doi.org/10.1016/j.spl.2008.05.003

IF: 0.718

2008-01-01

Statistics & Probability Letters

Abstract:Srivastava [Srivastava, M.S., 2005. Some tests concerning the covariance matrix in high dimensional data. J. Japan Statist. Soc. 35, 251–272] has proposed a test statistic for testing the hypothesis that the covariance matrix of the normal population is a diagonal matrix when the sample size is smaller than the dimensionality of the data. We extend his results to the hypothesis testing problem for independence of sets of variates in high dimensions. A test statistic is proposed and its asymptotic null distribution is also given, as both the sample size and the number of variables go to infinity. Consequently, this test can be used when the number of variables is not small relative to the sample size, in particular, even when the number of variables exceeds the sample size. Simulations are performed to see the accuracy of the asymptotic null distribution.
Asymptotic Normality for U-statistics of Negatively Associated Random Variables

Wei Huang,Lin-Xi Zhang

DOI: https://doi.org/10.1016/j.spl.2005.12.014

IF: 0.718

2006-01-01

Statistics & Probability Letters

Abstract:Let {Xn;n⩾0} be a sequence of negatively associated random variables and Un be a U-statistic based on this sample. We establish a central limit theorem for Un when the U-statistic is degenerate or non-degenerate.
Multivariate asymptotic normality determined by high moments

Pawel HItczenko,Nick Wormald

2023-12-07

Abstract:We extend a general result showing that the asymptotic behavior of high moments, factorial or standard, of random variables, determines the asymptotically normality, from the one dimensional to the multidimensional setting. This approach differs from the usual moment method which requires that the moments of each fixed order converge. We illustrate our results by considering a joint distribution of the numbers of bins (having the same, finite, capacity) containing a prescribed number of balls in a classical allocation scheme.

Probability,Combinatorics
Stochastic ordering in multivariate extremes

Michela Corradini,Kirstin Strokorb

2024-03-07

Abstract:The article considers the multivariate stochastic orders of upper orthants, lower orthants and positive quadrant dependence (PQD) among simple max-stable distributions and their exponent measures. It is shown for each order that it holds for the max-stable distribution if and only if it holds for the corresponding exponent measure. The finding is non-trivial for upper orthants (and hence PQD order). From dimension $d\geq 3$ these three orders are not equivalent and a variety of phenomena can occur. However, every simple max-stable distribution PQD-dominates the corresponding independent model and is PQD-dominated by the fully dependent model. Among parametric models the asymmetric Dirichlet family and the Hüsler-Reiss family turn out to be PQD-ordered according to the natural order within their parameter spaces. For the Hüsler-Reiss family this holds true even for the supermodular order.

Probability
Multinomial Logistic Regression: Asymptotic Normality on Null Covariates in High-Dimensions

Kai Tan,Pierre C. Bellec

DOI: https://doi.org/10.48550/arXiv.2305.17825

2023-05-29

Abstract:This paper investigates the asymptotic distribution of the maximum-likelihood estimate (MLE) in multinomial logistic models in the high-dimensional regime where dimension and sample size are of the same order. While classical large-sample theory provides asymptotic normality of the MLE under certain conditions, such classical results are expected to fail in high-dimensions as documented for the binary logistic case in the seminal work of Sur and Candès [2019]. We address this issue in classification problems with 3 or more classes, by developing asymptotic normality and asymptotic chi-square results for the multinomial logistic MLE (also known as cross-entropy minimizer) on null covariates. Our theory leads to a new methodology to test the significance of a given feature. Extensive simulation studies on synthetic data corroborate these asymptotic results and confirm the validity of proposed p-values for testing the significance of a given feature.

Statistics Theory,Methodology,Machine Learning
Stochastic Somparisons of Order Statistics from Scaled and Interdependent Random Variables

Chen Li,Rui Fang,Xiaohu Li

DOI: https://doi.org/10.1007/s00184-015-0567-3

IF: 0.96

2015-01-01

Metrika

Abstract:This paper studies order statistics from random variables following the scale model. In the presence of the Archimedean copula or survival copula for the random variables, we obtain the usual stochastic order of the sample extremes and the second smallest order statistic, the dispersive order and the star order of the sample extremes.
Order statistics on the spacings between order statistics for the uniform distribution

Iosif Pinelis

DOI: https://doi.org/10.48550/arXiv.1909.06406

2019-09-13

Statistics Theory

Abstract:Closed-form expressions for the distributions of the order statistics on the spacings between order statistics for the uniform distribution are obtained. This generalizes a result by Fisher concerning tests of significance in the harmonic analysis of a series.
Univariate likelihood projections and characterizations of the multivariate normal distribution

Albert Vexler

DOI: https://doi.org/10.1016/j.jmva.2020.104643

IF: 1.387

2020-09-01

Journal of Multivariate Analysis

Abstract:<p>The problem of characterizing a multivariate distribution of a random vector using examination of univariate combinations of vector components is an essential issue of multivariate analysis. The likelihood principle plays a prominent role in developing powerful statistical inference tools. In this context, we raise the question: can the univariate likelihood function based on a random vector be used to provide the uniqueness in reconstructing the vector distribution? In multivariate normal (MN) frameworks, this question links to a reverse of Cochran's theorem that concerns the distribution of quadratic forms in normal variables. We characterize the MN distribution through the univariate likelihood type projections. The proposed principle is employed to illustrate simple techniques for assessing multivariate normality via well-known tests that use univariate observations. The displayed testing strategy can exhibit high and stable power characteristics in comparison to the well-known procedures in various scenarios when observed vectors are non-MN distributed, whereas their components are normally distributed random variables. In such cases, classical multivariate normality tests, such as Shapiro–Wilk's, Henze-Zirklers's and Mardia's tests, may break down completely.</p>

statistics & probability
Multivariate limit theorems in the context of long-range dependence

Murad S. Taqqu,Shuyang Bai

DOI: https://doi.org/10.48550/arXiv.1211.0576

2013-04-11

Abstract:We study the limit law of a vector made up of normalized sums of functions of long-range dependent stationary Gaussian series. Depending on the memory parameter of the Gaussian series and on the Hermite ranks of the functions, the resulting limit law may be (a) a multivariate Gaussian process involving dependent Brownian motion marginals, or (b) a multivariate process involving dependent Hermite processes as marginals, or (c) a combination. We treat cases (a), (b) in general and case (c) when the Hermite components involve ranks 1 and 2. We include a conjecture about case (c) when the Hermite ranks are arbitrary.

Probability
On asymptotic normality of certain linear rank statistics

Viktor Skorniakov

DOI: https://doi.org/10.1016/j.spl.2018.08.016

2017-09-08

Abstract:We consider asymptotic normality of linear rank statistics under various randomization rules met in clinical trials and designed for patients' allocation into treatment and placebo arms. Exposition relies on some general limit theorem due to McLeish (1974) which appears to be well suited for the problem considered and may be employed for other similar rules undis- cussed in the paper. Examples of applications include well known results as well as several new ones.

Statistics Theory
On asymptotic independence in higher dimensions

Bikramjit Das,Vicky Fasen-Hartmann

2024-06-27

Abstract:In the study of extremes, the presence of asymptotic independence signifies that extreme events across multiple variables are probably less likely to occur together. Although well-understood in a bivariate context, the concept remains relatively unexplored when addressing the nuances of joint occurrence of extremes in higher dimensions. In this paper, we propose a notion of mutual asymptotic independence to capture the behavior of joint extremes in dimensions larger than two and contrast it with the classical notion of (pairwise) asymptotic independence. Furthermore, we define $k$-wise asymptotic independence which lies in between pairwise and mutual asymptotic independence. The concepts are compared using examples of Archimedean, Gaussian and Marshall-Olkin copulas among others. Notably, for the popular Gaussian copula, we provide explicit conditions on the correlation matrix for mutual asymptotic independence to hold; moreover, we are able to compute exact tail orders for various tail events.

Statistics Theory
Distribution-free tests of multivariate independence based on center-outward quadrant, Spearman, Kendall, and van der Waerden statistics

Hongjian Shi,Mathias Drton,Marc Hallin,Fang Han

2024-09-10

Abstract:Due to the lack of a canonical ordering in ${\mathbb R}^d$ for $d>1$, defining multivariate generalizations of the classical univariate ranks has been a long-standing open problem in statistics. Optimal transport has been shown to offer a solution in which multivariate ranks are obtained by transporting data points to a grid that approximates a uniform reference measure (Chernozhukov et al., 2017; Hallin, 2017; Hallin et al., 2021), thereby inducing ranks, signs, and a data-driven ordering of ${\mathbb R}^d$. We take up this new perspective to define and study multivariate analogues of the sign covariance/quadrant statistic, Spearman's rho, Kendall's tau, and van der Waerden covariances. The resulting tests of multivariate independence are fully distribution-free, hence uniformly valid irrespective of the actual (absolutely continuous) distribution of the observations. Our results provide the asymptotic distribution theory for these new test statistics, with asymptotic approximations to critical values to be used for testing independence between random vectors, as well as a power analysis of the resulting tests in an extension of the so-called (bivariate) Konijn model. This power analysis includes a multivariate Chernoff--Savage property guaranteeing that, under elliptical generalized Konijn models, the asymptotic relative efficiency of our van der Waerden tests with respect to Wilks' classical (pseudo-)Gaussian procedure is strictly larger than or equal to one, where equality is achieved under Gaussian distributions only. We similarly provide a lower bound for the asymptotic relative efficiency of our Spearman procedure with respect to Wilks' test, thus extending the classical result by Hodges and Lehmann on the asymptotic relative efficiency, in univariate location models, of Wilcoxon tests with respect to the Student ones.

Statistics Theory
On Extreme Value Asymptotics of Projected Sample Covariances in High Dimensions with Applications in Finance and Convolutional Networks

Ansgar Steland

2023-10-12

Abstract:Maximum-type statistics of certain functions of the sample covariance matrix of high-dimensional vector time series are studied to statistically confirm or reject the null hypothesis that a data set has been collected under normal conditions. The approach generalizes the case of the maximal deviation of the sample autocovariances function from its assumed values. Within a linear time series framework it is shown that Gumbel-type extreme value asymptotics holds true. As applications we discuss long-only mimimal-variance portfolio optimization and subportfolio analysis with respect to idiosyncratic risks, ETF index tracking by sparse tracking portfolios, convolutional deep learners for image analysis and the analysis of array-of-sensors data.

Statistics Theory,Machine Learning
Orthogonal series and limit theorems for canonical U- and V-statistics of stationary connected observations

I. S. Borisov,N. Volodko,I.S.Borisov,N.Volodko

DOI: https://doi.org/10.48550/arXiv.0906.5465

2009-06-30

Probability

Abstract:The limit behavior is studied for the distributions of normalized U- and V-statistics of an arbitrary order with canonical (degenerate) kernels, based on samples of increasing sizes from a stationary sequence of observations satisfying classical mixing conditions. The corresponding limit distributions are represented as infinite multilinear forms of a centered Gaussian sequence with a known covariance matrix.
Hessian and increasing-Hessian orderings of multivariate skew-elliptical random vectors

Chuancun Yin

2023-04-18

Abstract:In this work, we establish some stochastic comparison results for multivariate skew-elliptical random vectors. These multivariate stochastic comparisons involve Hessian and increasing-Hessian orderings as well as many of their special cases. Necessary and/or sufficient conditions of the orderings are provided simply based on a comparison of the underlying model parameters.

Statistics Theory
Asymptotics for non-degenerate multivariate $U$-statistics with estimated nuisance parameters under the null and local alternative hypotheses

Alain Desgagné,Christian Genest,Frédéric Ouimet

2024-08-29

Abstract:The large-sample behavior of non-degenerate multivariate $U$-statistics of arbitrary degree is investigated under the assumption that their kernel depends on parameters that can be estimated consistently. Mild regularity conditions are given which guarantee that once properly normalized, such statistics are asymptotically multivariate Gaussian both under the null hypothesis and sequences of local alternatives. The work of Randles (1982, \emph{Ann. Statist.}) is extended in three ways: the data and the kernel values can be multivariate rather than univariate, the limiting behavior under local alternatives is studied for the first time, and the effect of knowing some of the nuisance parameters is quantified. These results can be applied to a broad range of goodness-of-fit testing contexts, as shown in two specific examples.

Statistics Theory,Probability,Applications,Methodology
Asymptotic symmetry and group invariance for randomization

Adam B Kashlak

2023-10-20

Abstract:Symmetry is a cornerstone of much of mathematics, and many probability distributions possess symmetries characterized by their invariance to a collection of group actions. Thus, many mathematical and statistical methods rely on such symmetry holding and ostensibly fail if symmetry is broken. This work considers under what conditions a sequence of probability measures asymptotically gains such symmetry or invariance to a collection of group actions. Considering the many symmetries of the Gaussian distribution, this work effectively proposes a non-parametric type of central limit theorem. That is, a Lipschitz function of a high dimensional random vector will be asymptotically invariant to the actions of certain compact topological groups. Applications of this include a partial law of the iterated logarithm for uniformly random points in an $\ell_p^n$-ball and an asymptotic equivalence between classical parametric statistical tests and their randomization counterparts even when invariance assumptions are violated.

Statistics Theory,Probability

Multivariate Order Statistics: The Intermediate Case

Asymptotic independence of bivariate order statistics

Hessian and increasing-Hessian orderings of scale-shape mixtures of multivariate skew-normal distributions and applications

A hypothesis test for independence of sets of variates in high dimensions

Asymptotic Normality for U-statistics of Negatively Associated Random Variables

Multivariate asymptotic normality determined by high moments

Stochastic ordering in multivariate extremes

Multinomial Logistic Regression: Asymptotic Normality on Null Covariates in High-Dimensions

Stochastic Somparisons of Order Statistics from Scaled and Interdependent Random Variables

Order statistics on the spacings between order statistics for the uniform distribution

Univariate likelihood projections and characterizations of the multivariate normal distribution

Multivariate limit theorems in the context of long-range dependence

On asymptotic normality of certain linear rank statistics

On asymptotic independence in higher dimensions

Distribution-free tests of multivariate independence based on center-outward quadrant, Spearman, Kendall, and van der Waerden statistics

On Extreme Value Asymptotics of Projected Sample Covariances in High Dimensions with Applications in Finance and Convolutional Networks

Orthogonal series and limit theorems for canonical U- and V-statistics of stationary connected observations

Hessian and increasing-Hessian orderings of multivariate skew-elliptical random vectors

Asymptotics for non-degenerate multivariate $U$-statistics with estimated nuisance parameters under the null and local alternative hypotheses

Asymptotic symmetry and group invariance for randomization