Quantile-Quantile Methodology -- Detailed Results

Douglas M Hawkins

DOI: https://doi.org/10.48550/arXiv.2303.03215

2023-10-16

Abstract:The linear quantile-quantile relationship provides an easy-to-implement yet effective tool for transformation to and testing for normality. Its good performance is verified in this report.

Methodology

What problem does this paper attempt to address?

Quantile‐Based Test for Heterogeneous Treatment Effects

EunYi Chung,Mauricio Olivares

DOI: https://doi.org/10.1002/jae.3093

IF: 2.46

2024-10-18

Journal of Applied Econometrics

Abstract:We introduce a permutation test for heterogeneous treatment effects based on the quantile process. However, tests based on the quantile process often suffer from estimated nuisance parameters that jeopardize their validity, even in large samples. To overcome this problem, we use Khmaladze's martingale transformation. We show that the permutation test based on the transformed statistic controls size asymptotically. Numerical evidence asserts the good size and power performance of our test procedure compared to other popular quantile‐based tests. We discuss a fast implementation algorithm and illustrate our method using experimental data from a welfare reform.

economics,social sciences, mathematical methods
Quantile Regression and Beyond in Statistical Analysis of Data

Rahim Alhamzawi,Keming Yu,Himel Mallick

DOI: https://doi.org/10.1155/2019/2635306

2019-07-22

Journal of Probability and Statistics

Abstract:Regression is used to quantify the relationship between response variables and some covariates of interest. Standard mean regression has been one of the most applied statistical methods for many decades. It aims to estimate the conditional expectation of the response variable given the covariates. However, quantile regression is desired if conditional quantile functions such as median regression are of interest. Quantile regression has emerged as a useful supplement to standard mean regression. Also, unlike mean regression, quantile regression is robust to outliers in observations and makes very minimal assumptions on the error distribution and thus is able to accommodate nonnormal errors. The value of "going beyond the standard mean regression" has been illustrated in many scientific subjects including economics, ecology, education, finance, survival analysis, microarray study, growth charts, and so on. In addition, inference on quantiles can accommodate transformation of the outcome of the interest without the problems encountered in standard mean regression. Overall, quantile regression offers a more complete statistical model than standard mean regression and now has widespread applications.
Hierarchical Linear Regression Models for Conditional Quantiles

Tian Maozai,Chen Gemai

DOI: https://doi.org/10.1007/s11425-006-2023-3

2006-01-01

Science in China Series A Mathematics

Abstract:The quantile regression has several useful features and therefore is gradually developing into a comprehensive approach to the statistical analysis of linear and nonlinear response models, but it cannot deal effectively with the data with a hierarchical structure. In practice, the existence of such data hierarchies is neither accidental nor ignorable, it is a common phenomenon. To ignore this hierarchical data structure risks overlooking the importance of group effects, and may also render many of the traditional statistical analysis techniques used for studying data relationships invalid. On the other hand, the hierarchical models take a hierarchical data structure into account and have also many applications in statistics, ranging from overdispersion to constructing min-max estimators. However, the hierarchical models are virtually the mean regression, therefore, they cannot be used to characterize the entire conditional distribution of a dependent variable given high-dimensional covariates. Furthermore, the estimated coefficient vector (marginal effects) is sensitive to an outlier observation on the dependent variable. In this article, a new approach, which is based on the Gauss-Seidel iteration and taking a full advantage of the quantile regression and hierarchical models, is developed. On the theoretical front, we also consider the asymptotic properties of the new method, obtaining the simple conditions for an n 1/2 -convergence and an asymptotic normality. We also illustrate the use of the technique with the real educational data which is hierarchical and how the results can be explained.
Global quantile regression

Tomáš Mrkvička,Konstantinos Konstantinou,Mikko Kuronen,Mari Myllymäki

DOI: https://doi.org/10.48550/arXiv.2309.04746

2023-09-09

Methodology

Abstract:Quantile regression is used to study effects of covariates on a particular quantile of the data distribution. Here we are interested in the question whether a covariate has any effect on the entire data distribution, i.e., on any of the quantiles. To this end, we treat all the quantiles simultaneously and consider global tests for the existence of the covariate effect in the presence of nuisance covariates. This global quantile regression can be used as the extension of linear regression or as the extension of distribution comparison in the sense of Kolmogorov-Smirnov test. The proposed method is based on pointwise coefficients, permutations and global envelope tests. The global envelope test serves as the multiple test adjustment procedure under the control of the family-wise error rate and provides the graphical interpretation which automatically shows the quantiles or the levels of categorical covariate responsible for the rejection. The Freedman-Lane permutation strategy showed liberality of the test for extreme quantiles, therefore we propose four alternatives that work well even for extreme quantiles and are suitable in different conditions. We present a simulation study to inspect the performance of these strategies, and we apply the chosen strategies to two data examples.
Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

Songqiao Tang,Huiyu Wang,Guanao Yan,Lixin Zhang

DOI: https://doi.org/10.1007/s00184-022-00866-1

IF: 0.96

2023-01-01

Metrika

Abstract:This article investigates detecting the presence of significant predictors in marginal quantile regression. The main idea comes from the connection between the quantile correlation and the slope parameter of the marginal quantile regression, which is quite different from other methods. By introducing the local linear model and the plug-in empirical likelihood method, consistent asymptotic distribution and its adjusted version are obtained. We not only circumvent the non-regularity encountered by post-model-selected estimators but also make the results more concise. Two adaptive resampling test procedures are proposed in practice by comparing the t-statistics with a threshold to decide whether to use the traditional centered percentile bootstrap or otherwise adapt to the asymptotic distribution under the local model. Simulation studies compare these two resampling tests with other competing methods in several cases. Results show that the approaches proposed are more robust for each quantile level and can control type I error well. Two real datasets from Forbes magazine and the HIV drug resistance database are also applied to illustrate the new methods.
Normality Assessment of Several Quantitative Data Transformation Procedures

Dago Dougba Noel

DOI: https://doi.org/10.19080/bboaj.2021.10.555786

2021-02-02

Biostatistics and Biometrics Open Access Journal

Abstract:Usually, quantitative data standardization and/or normalization procedures requested in biological and as well in biomedical data analysis with the purpose to infer about linear regression relationship between processed variables and/or conditions. Here, we embarked to understand performance of quantitative data transformation systems in terms of reducing data variability as well as assessing data distribution normality by a computational statistic approach. For this purpose, we performed several multivariate descriptive and analytical statistical tests. Even if results shown drastic reduction of data variability by applying presently data transformation procedures, it is noteworthy to underline the relative opposite attitude of Exponential (Expo) data standardization system in that sense. In addition although, results revealed variance homogeneity for data processed by both Maximum and Logarithm data transformation methods, it is noteworthy to underline a relative variance homogeneity with regard data submitted to Box-Cox, Z-score, Minimum-Maximum and Square Root data transformation methods. Further, findings exhibited high aptitude of Square Root, Box-Cox and Logarithm quantitative data standardization methods, in stabilizing processed data variability. Interestingly, results shown high performances of Logarithm and Box-Cox data standardization systems in term of adjusting data normal distribution. In addition, multiple comparison of mean by Turkey contrast test suggested the high performance in term of data normality with regard Box-Cox standardization method. In conclusion, even if our results revealed heterogenic performances of presently processed quantitative data transformation methods, it is noteworthy to underline the high performances of both Box-Cox and Logarithm methods
Testing multivariate quantile by empirical likelihood

Xuejun Ma,Shaochen Wang,Wang Zhou

DOI: https://doi.org/10.1016/j.jmva.2020.104705

IF: 1.387

2021-01-01

Journal of Multivariate Analysis

Abstract:In this paper, a new method called mean-of-quantile is introduced to estimate multivariate quantiles. The consistency and asymptotic normality of mean-of-quantile estimators are investigated. Furthermore, we apply empirical likelihood to mean-of-quantile estimators. The effectiveness of our new method is illustrated by Monte Carlo simulations and an empirical example. (C) 2020 Elsevier Inc. All rights reserved.
Quantile ratio regression

Alessio Farcomeni,Marco Geraci

DOI: https://doi.org/10.1007/s11222-024-10406-8

IF: 2.3241

2024-03-15

Statistics and Computing

Abstract:We introduce quantile ratio regression. Our proposed model assumes that the ratio of two arbitrary quantiles of a continuous response distribution is a function of a linear predictor. Thanks to basic quantile properties, estimation can be carried out on the scale of either the response or the link function. The advantage of using the latter becomes tangible when implementing fast optimizers for linear regression in the presence of large datasets. We show the theoretical properties of the estimator and derive an efficient method to obtain standard errors. The good performance and merit of our methods are illustrated by means of a simulation study and a real data analysis; where we investigate income inequality in the European Union (EU) using data from a sample of about two million households. We find a significant association between inequality, as measured by quantile ratios, and certain macroeconomic indicators; and we identify countries with outlying income inequality relative to the rest of the EU. An R implementation of the proposed methods is freely available.

statistics & probability,computer science, theory & methods
Parametric modeling of quantile regression coefficient functions

Paolo Frumento,Matteo Bottai

DOI: https://doi.org/10.1111/biom.12410

IF: 1.701

2015-09-22

Biometrics

Abstract:Estimating the conditional quantiles of outcome variables of interest is frequent in many research areas, and quantile regression is foremost among the utilized methods. The coefficients of a quantile regression model depend on the order of the quantile being estimated. For example, the coefficients for the median are generally different from those of the 10th centile. In this article, we describe an approach to modeling the regression coefficients as parametric functions of the order of the quantile. This approach may have advantages in terms of parsimony, efficiency, and may expand the potential of statistical modeling. Goodness-of-fit measures and testing procedures are discussed, and the results of a simulation study are presented. We apply the method to analyze the data that motivated this work. The described method is implemented in the qrcm R package.

statistics & probability,mathematical & computational biology,biology
On the unbiased asymptotic normality of quantile regression with fixed effects

Antonio F. Galvao,Jiaying Gu,Stanislav Volgushev

DOI: https://doi.org/10.1016/j.jeconom.2019.12.017

IF: 3.363

2020-09-01

Journal of Econometrics

Abstract:Nonlinear panel data models with fixed individual effects provide an important set of tools for describing microeconometric data. In a large class of such models (including probit, proportional hazard and quantile regression to name just a few) it is impossible to difference out the individual effects, and inference is usually justified in a 'large n large T' asymptotic framework. However, there is a considerable gap in the type of assumptions that are currently imposed in models with smooth score functions (such as probit, and proportional hazard) and quantile regression. In the present paper we show that this gap can be bridged and establish unbiased asymptotic normality for fixed effects quantile regression panels under conditions on n,T that are very close to what is typically assumed in standard nonlinear panels. Our results considerably improve upon existing theory and show that quantile regression is applicable to the same type of panel data (in terms of n,T) as other commonly used nonlinear panel data models. Thorough numerical experiments confirm our theoretical findings.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications
On the Bootstrap Quantile-Treatment-effect Test

Man-Lai Tang,Maozai Tian,Ping-Shing Chan

DOI: https://doi.org/10.1080/02664760701834725

IF: 1.416

2008-01-01

Journal of Applied Statistics

Abstract:Let {X 1, …, X n } and {Y 1, …, Y m } be two samples of independent and identically distributed observations with common continuous cumulative distribution functions F(x)=P(X≤x) and G(y)=P(Y≤y), respectively. In this article, we would like to test the no quantile treatment effect hypothesis H 0: F=G. We develop a bootstrap quantile-treatment-effect test procedure for testing H 0 under the location-scale shift model. Our test procedure avoids the calculation of the check function (which is non-differentiable at the origin and makes solving the quantile effects difficult in typical quantile regression analysis). The limiting null distribution of the test procedure is derived and the procedure is shown to be consistent against a broad family of alternatives. Simulation studies show that our proposed test procedure attains its type I error rate close to the pre-chosen significance level even for small sample sizes. Our test procedure is illustrated with two real data sets on the lifetimes of guinea pigs from a treatment-control experiment.
Quantile and Probability Curves Without Crossing

Victor Chernozhukov,Ivan Fernandez-Val,Alfred Galichon

DOI: https://doi.org/10.3982/ECTA7880

2014-07-15

Abstract:This paper proposes a method to address the longstanding problem of lack of monotonicity in estimation of conditional and structural quantile functions, also known as the quantile crossing problem. The method consists in sorting or monotone rearranging the original estimated non-monotone curve into a monotone rearranged curve. We show that the rearranged curve is closer to the true quantile curve in finite samples than the original curve, establish a functional delta method for rearrangement-related operators, and derive functional limit theory for the entire rearranged curve and its functionals. We also establish validity of the bootstrap for estimating the limit law of the the entire rearranged curve and its functionals. Our limit results are generic in that they apply to every estimator of a monotone econometric function, provided that the estimator satisfies a functional central limit theorem and the function satisfies some smoothness conditions. Consequently, our results apply to estimation of other econometric functions with monotonicity restrictions, such as demand, production, distribution, and structural distribution functions. We illustrate the results with an application to estimation of structural quantile functions using data on Vietnam veteran status and earnings.

Methodology,Econometrics,Statistics Theory
The Horvitz-Thompson Weighting Method for Quantile Regression Estimation in the Presence of Missing Covariates

Xu GUO,Wei XIONG,Maozai TIAN,Lingnan TAI,Zhaoji CHU

DOI: https://doi.org/10.3770/j.issn:2095-2651.2021.03.008

2021-01-01

Abstract:The lack of covariate data is one of the hotspots of modern statistical analysis.It often appears in surveys or interviews,and becomes more complex in the presence of heavy tailed,skewed,and heteroscedastic data.In this sense,a robust quantile regression method is more concerned.This paper presents an inverse weighted quantile regression method to explore the relationship between response and covariates.This method has several advantages over the naive estimator.On the one hand,it uses all available data and the missing covariates are allowed to be heavily correlated with the response;on the other hand,the estimator is uniform and asymptotically normal at all quantile levels.The effectiveness of this method is verified by simulation.Finally,in order to illustrate the effectiveness of this method,we extend it to the more general case,multivariate case and nonparametric case.
Testing Structural Change in Conditional Distributions via Quantile Regressions

Liangjun Su,Zhijie Xiaob

2009-01-01

Abstract:We propose tests for structural change in conditional distributions via quantile regressions. To avoid misspecification on the conditioning relationship, we construct the tests based on the residuals from local polynomial quantile regressions. In particular, the tests are based upon the cumulative sums of generalized residuals from quantile regressions and have power against local alternatives at rate n−1/2. We derive the limiting distributions for our tests under the null hypothesis of no structural change and a sequence of local alternatives. The proposed tests apply to a wide range of dynamic models, including time series regressions with m.d.s. errors, as well as models with serially correlated errors. To deal with possible correlations in the error process, we also propose a simulation method to obtain the p-values for our tests. Finally, Monte Carlo simulations suggest that our tests behave well in finite samples.
Quantile Regression for Panel Data and Its Simulation Study

Luo Youxi,Tian Maozai

DOI: https://doi.org/10.19343/j.cnki.11-1302/c.2010.10.014

2010-01-01

Abstract:The paper discusses fixed effects panel data model and gives three quantile regression estimates of the unknown parameters.Monte Carlo simulation study indicates that these quantile regression methods are effective in deal with the panel data model and do better than mean regression methods when the error distribution is non-normal.Finally,a real data is studied and some useful reference information for decision-making is obtained.
Model-Robust Designs for Quantile Regression

Linglong Kong,Douglas P. Wiens

DOI: https://doi.org/10.1080/01621459.2014.969427

2014-09-17

Abstract:We give methods for the construction of designs for linear models, when the purpose of the investigation is the estimation of the conditional quantile function and the estimation method is quantile regression. The designs are robust against misspecified response functions, and against unanticipated heteroscedasticity. The methods are illustrated by example, and in a case study in which they are applied to growth charts.

Methodology
Reprint: Hypothesis testing on high dimensional quantile regression

Zhao Chen,Vivian Xinyi Cheng,Xu Liu

DOI: https://doi.org/10.1016/j.jeconom.2023.105651

IF: 3.363

2024-01-21

Journal of Econometrics

Abstract:Quantile regression has been an important analytical tool in econometrics since it was proposed in 1970s. Many advantages make it still popular in the era of big data. This paper focuses on the testing problems of high-dimensional quantile regression, supplementing to robust methods in the literature of high-dimensional hypothesis testing. We first construct a new test statistic based on the quantile regression score function. The new test statistic avoids the inverse operation of the covariance matrix, and hence becomes applicable to high-dimensional or even ultrahigh-dimensional settings. The proposed method retains robustness for non-Gaussian and heavy-tailed distributions. We then derive the limiting distributions of the proposed test statistic under both the null and the alternative hypotheses. We further investigate the case where the design matrix follows an elliptical distribution. We examined the finite sample performance of our proposed method through Monte Carlo simulations. The numerical comparisons exhibit that our proposed tests outperform some existing methods in terms of controlling Type I error rate and power, when the data deviate from the Gaussian assumptions or are heavy-tailed. We illustrate our proposed high-dimensional quantile testing in financial econometrics, through an empirical analysis of Chinese stock market data.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications
Applications for Quantile Regression in Epidemiology

Ying Wei,Rebecca D. Kehm,Mandy Goldberg,Mary Beth Terry

DOI: https://doi.org/10.1007/s40471-019-00204-6

2019-05-20

Current Epidemiology Reports

Abstract:Purpose of ReviewTo illustrate the utility of quantile regression in epidemiology for outcomes that are continuous and when exposure effects may differ across the distribution of the outcome. Linear regression methods estimate only the effects at the mean level which may be an incomplete and biased summary of the effect of exposures for some continuous health outcomes.Recent FindingsThere are several variations of the quantile regression method including classical linear quantile regression, nonparametric quantile regression for growth trajectories, and the modified quantile regression for case–control designs. Such methods offer several applications including (1) the use of quantile regression to test whether the effects of exposure are similar across quantiles, (2) the use of quantile regression for risk prediction, and (3) the use of quantile regression to examine the effects of growth trajectories over time.SummaryQuantile regression is an important tool for understanding continuous health outcomes, especially outcomes that are not normally distributed, as it offers insight into the relation of exposures with respect to the distribution of the outcome. Quantile regression methods have the potential to deepen and expand the existing quantitative evidence from more common mean-based analyses.

public, environmental & occupational health
Nonparametric inference of quantile curves for nonstationary time series

Zhou Zhou

DOI: https://doi.org/10.1214/09-AOS769

2010-10-19

Abstract:The paper considers nonparametric specification tests of quantile curves for a general class of nonstationary processes. Using Bahadur representation and Gaussian approximation results for nonstationary time series, simultaneous confidence bands and integrated squared difference tests are proposed to test various parametric forms of the quantile curves with asymptotically correct type I error rates. A wild bootstrap procedure is implemented to alleviate the problem of slow convergence of the asymptotic results. In particular, our results can be used to test the trends of extremes of climate variables, an important problem in understanding climate change. Our methodology is applied to the analysis of the maximum speed of tropical cyclone winds. It was found that an inhomogeneous upward trend for cyclone wind speeds is pronounced at high quantile values. However, there is no trend in the mean lifetime-maximum wind speed. This example shows the effectiveness of the quantile regression technique.

Statistics Theory
Quantile regression: applications and current research areas

Keming Yu,Zudi Lu,Julian Stander

DOI: https://doi.org/10.1111/1467-9884.00363@10.1111/(ISSN)1467-985x.statistics-of-human-growth

2019-10-04

Abstract:Abstract Summary. Quantile regression offers a more complete statistical model than mean regression and now has widespread applications. Consequently, we provide a review of this technique. We begin with an introduction to and motivation for quantile regression. We then discuss some typical application areas. Next we outline various approaches to estimation. We finish by briefly summarizing some recent research areas.

statistics & probability,social sciences, mathematical methods

Quantile-Quantile Methodology -- Detailed Results

Quantile‐Based Test for Heterogeneous Treatment Effects

Quantile Regression and Beyond in Statistical Analysis of Data

Hierarchical Linear Regression Models for Conditional Quantiles

Global quantile regression

Empirical Likelihood Based Tests for Detecting the Presence of Significant Predictors in Marginal Quantile Regression

Normality Assessment of Several Quantitative Data Transformation Procedures

Testing multivariate quantile by empirical likelihood

Quantile ratio regression

Parametric modeling of quantile regression coefficient functions

On the unbiased asymptotic normality of quantile regression with fixed effects

On the Bootstrap Quantile-Treatment-effect Test

Quantile and Probability Curves Without Crossing

The Horvitz-Thompson Weighting Method for Quantile Regression Estimation in the Presence of Missing Covariates

Testing Structural Change in Conditional Distributions via Quantile Regressions

Quantile Regression for Panel Data and Its Simulation Study

Model-Robust Designs for Quantile Regression

Reprint: Hypothesis testing on high dimensional quantile regression

Applications for Quantile Regression in Epidemiology

Nonparametric inference of quantile curves for nonstationary time series

Quantile regression: applications and current research areas