A Method of the Quantile Calculation Based on the MM Algorithms

FU Yue,JIN Ying-ji,JIANG Jin-xi

DOI: https://doi.org/10.3969/j.issn.1004-4353.2010.02.008

2010-01-01

Abstract:Based on the MM algorithms,the problem of non-classified sample quantiles is studied.In addition,a new algorithm is given for the quantile calculation of excessive and time-consuming issues in the huge amount of data by random sampling methods.

What problem does this paper attempt to address?

MM Algorithms for Statistical Estimation in Quantile Regression

Yifan Cheng,Anthony Yung Cheung Kuk

DOI: https://doi.org/10.48550/arxiv.2407.12348

2024-07-17

Methodology

Abstract:Quantile regression is a robust and practically useful way to efficiently model quantile varying correlation and predict varied response quantiles of interest. This article constructs and tests MM algorithms, which are simple to code and have been suggested superior to some other prominent quantile regression methods in nonregularized problems, in an array of quantile regression settings including linear (modeling different quantile coefficients both separately and simultaneously), nonparametric, regularized, and monotone quantile regression. Applications to various real data sets and two simulation studies comparing MM to existing tested methods have corroborated our algorithms' effectiveness. We have made one key advance by generalizing our MM algorithm to efficiently fit easy-to-predict-and-interpret parametric quantile regression models for data sets exhibiting manifest complicated nonlinear correlation patterns, which has not yet been covered by current literature to the best of our knowledge.
Quantile Regression via the EM Algorithm.

Ying-hui Zhou,Zhong-Xin Ni,Yong Li

DOI: https://doi.org/10.1080/03610918.2012.746980

2014-01-01

Communications in Statistics - Simulation and Computation

Abstract:The three-parameter asymmetric Laplace distribution (ALD) has received increasing attention in the field of quantile regression due to an important feature between its location and asymmetric parameters. On the basis of the representation of the ALD as a normal-variance-mean mixture with an exponential mixing distribution, this article develops EM and generalized EM algorithms, respectively, for computing regression quantiles of linear and nonlinear regression models. It is interesting to show that the proposed EM algorithm and the MM (Majorization-Minimization) algorithm for quantile regressions are really the same in terms of computation, since the updating formula of them are the same. This provides a good example that connects the EM and MM algorithms. Simulation studies show that the EM algorithm can successfully recover the true parameters in quantile regressions.
A Weighted Quantile Regression Approach for Complex High-Dimensional Heterogeneous Data

Wei Xiong,Han Pan,Keming Yu,Maozai Tian

DOI: https://doi.org/10.1360/ssm-2022-0080

2024-01-01

Abstract:With the development of digital intelligent technology,many problems arise,such as information flooding,computing power expansion,data heterogeneity,and complexity,which bring great challenges to the theories of data modeling.In this paper,from the perspective of the mode,we propose the concept of the opti-mal quantile level and mode-based weighted quantile regression(MWQR)to maximize the utilization of sample information.The proposed MWQR method is superior to the existing methods in the following aspects:(1)The proposed method is suitable for complex and high-dimensional heterogeneous data,and the robustness can be ensured even when the error term is thick-tailed and skewed.(2)The MWQR method solves the problem of subjectivity in choosing quantile levels in quantile regression.(3)By assigning different weights to different quantile levels,the estimation efficiency is greatly improved and the computation time is reduced.(4)The entire conditional distribution of response variables can be investigated effectively in the MWQR method.Considering the advantages of the MWQR method,we apply it to partially linear additive models and propose two algorithms for robust coefficient estimation and variable selection,and the consistency and asymptotic distribution of estima-tors are also demonstrated.The numerical simulation results and empirical study of the"implicit guarantee"of urban investment bonds and plasma β-carotene concentration problems further show that the proposed method can well explore the intrinsic structure of data,significantly improves computational efficiency,and has broad application value.
Random Weighting-Based Quantile Estimation Via Importance Resampling

Wenhui Wei,Shesheng Gao,Bingbing Gao,Yongmin Zhong,Chengfan Gu,Zhaohui Gao

DOI: https://doi.org/10.1080/03610926.2018.1496256

2019-01-01

Communication in Statistics- Theory and Methods

Abstract:This paper presents a new method to estimate the quantiles of generic statistics by combining the concept of random weighting with importance resampling. This method converts the problem of quantile estimation to a dual problem of tail probabilities estimation. Random weighting theories are established to calculate the optimal resampling weights for estimation of tail probabilities via sequential variance minimization. Subsequently, the quantile estimation is constructed by using the obtained optimal resampling weights. Experimental results on real and simulated data sets demonstrate that the proposed random weighting method can effectively estimate the quantiles of generic statistics.
A Class of Finite Mixture of Quantile Regressions with Its Applications

Yuzhu Tian,Manlai Tang,Maozai Tian

DOI: https://doi.org/10.1080/02664763.2015.1094035

IF: 1.416

2016-01-01

Journal of Applied Statistics

Abstract:Mixture of linear regression models provide a popular treatment for modeling nonlinear regression relationship. The traditional estimation of mixture of regression models is based on Gaussian error assumption. It is well known that such assumption is sensitive to outliers and extreme values. To overcome this issue, a new class of finite mixture of quantile regressions (FMQR) is proposed in this article. Compared with the existing Gaussian mixture regression models, the proposed FMQR model can provide a complete specification on the conditional distribution of response variable for each component. From the likelihood point of view, the FMQR model is equivalent to the finite mixture of regression models based on errors following asymmetric Laplace distribution (ALD), which can be regarded as an extension to the traditional mixture of regression models with normal error terms. An EM algorithm is proposed to obtain the parameter estimates of the FMQR model by combining a hierarchical representation of the ALD. Finally, the iterated weighted least square estimation for each mixture component of the FMQR model is derived. Simulation studies are conducted to illustrate the finite sample performance of the estimation procedure. Analysis of an aphid data set is used to illustrate our methodologies.
Small Area Quantile Estimation

Jiahua Chen,Yukun Liu

DOI: https://doi.org/10.48550/arXiv.1705.10063

2017-05-29

Abstract:Sample surveys are widely used to obtain information about totals, means, medians, and other parameters of finite populations. In many applications, similar information is desired for subpopulations such as individuals in specific geographic areas and socio-demographic groups. When the surveys are conducted at national or similarly high levels, a probability sampling can result in just a few sampling units from many unplanned subpopulations at the design stage. Cost considerations may also lead to low sample sizes from individual small areas. Estimating the parameters of these subpopulations with satisfactory precision and evaluating their accuracy are serious challenges for statisticians. To overcome the difficulties, statisticians resort to pooling information across the small areas via suitable model assumptions, administrative archives, and census data. In this paper, we develop an array of small area quantile estimators. The novelty is the introduction of a semiparametric density ratio model for the error distribution in the unit-level nested error regression model. In contrast, the existing methods are usually most effective when the response values are jointly normal. We also propose a resampling procedure for estimating the mean square errors of these estimators. Simulation results indicate that the new methods have superior performance when the population distributions are skewed and remain competitive otherwise.

Methodology
Estimation of Distribution Algorithm Using Variety of Information

Juan Yu,Yuyao He

DOI: https://doi.org/10.1145/2627508.2627513

2014-01-01

Abstract:Former information of probability model and inferior individuals were discarded in the research of estimation of distribution algorithm usually, but they may contain useful information. In this paper, the former probability information is introduced to avoid premature convergence caused by continuously select superior individuals of current population tobuilt probability model, and the individual sampling from superior probability model is filtered by inferior probability model to avoid generating inferior individuals. The algorithm is simulated through the widely used knapsack examples, the results verify the validity of the proposed method, and give suggestion for the choice of parameter through simulation and analysis.
Efficient Quantile Regression Analysis with Missing Observations

Xuerong Chen,Alan T. K. Wan,Yong Zhou

DOI: https://doi.org/10.1080/01621459.2014.928219

2015-01-01

Abstract:This article examines the problem of estimation in a quantile regression model when observations are missing at random under independent and nonidentically distributed errors. We consider three approaches of handling this problem based on nonparametric inverse probability weighting, estimating equations projection, and a combination of both. An important distinguishing feature of our methods is their ability to handle missing response and/or partially missing covariates, whereas existing techniques can handle only one or the other, but not both. We prove that our methods yield asymptotically equivalent estimators that achieve the desirable asymptotic properties of unbiasedness, normality, and n-consistency. Because we do not assume that the errors are identically distributed, our theoretical results are valid under heteroscedasticity, a particularly strong feature of our methods. Under the special case of identical error distributions, all of our proposed estimators achieve the semiparametric efficiency bound. To facilitate the practical implementation of these methods, we develop an iterative method based on the majorize/minimize algorithm for computing the quantile regression estimates, and a bootstrap method for computing their variances. Our simulation findings suggest that all three methods have good finite sample properties. We further illustrate these methods by a real data example. Supplementary materials for this article are available online.
An Introduction to MM Algorithms for Machine Learning and Statistical

Hien D. Nguyen

DOI: https://doi.org/10.48550/arXiv.1611.03969

2016-11-12

Abstract:MM (majorization--minimization) algorithms are an increasingly popular tool for solving optimization problems in machine learning and statistical estimation. This article introduces the MM algorithm framework in general and via three popular example applications: Gaussian mixture regressions, multinomial logistic regressions, and support vector machines. Specific algorithms for the three examples are derived and numerical demonstrations are presented. Theoretical and practical aspects of MM algorithm design are discussed.

Computation,Machine Learning
Quantiles on Stream: an Application to Monte Carlo Simulation

Wei Wang,Wai-Ki Ching,Shouyang Wang,Lean Yu

DOI: https://doi.org/10.21078/jssi-2016-334-09

2016-01-01

Journal of Systems Science and Information

Abstract:AbstractMonte Carlo simulation is an efficient method to estimate quantile. However, it becomes a serious problem when a huge sample size is required but the memory is insufficient. In this paper, we apply the stream quantile algorithm to Monte Carlo simulation in order to estimate quantile with limited memory. A rigorous theoretical analysis on the properties of theϵn-approximate quantile is proposed in this paper. We prove that ifϵn=o(n-1/2), then theϵn-approximateα-quantile computed by any deterministic stream quantile algorithm is a consistent and asymptotically normal estimator of the true quantileqα. We suggest settingϵn= 1/(n1/2log10n) in practice. Two deterministic stream quantile algorithms, including of GK algorithm and ZW algorithm, are employed to illustrate the performance of theϵn-approximate quantile. The numerical example shows that the deterministic stream quantile algorithm can provide desired estimator of the true quantile with less memory.
Heteroscedasticity Detection and Estimation with Quantile Difference Method.

Wentao Xia,Wei Xiong,Maozai Tian

DOI: https://doi.org/10.1007/s11424-015-3161-x

2016-01-01

Abstract:When dealing with regression analysis, heteroscedasticity is a problem that the authors have to face with. Especially if little information can be got in advance, detection of heteroscedasticity as well as estimation of statistical models could be even more difficult. To this end, this paper proposes a quantile difference method (QDM) that can effectively estimate the heteroscedastic function. This method, being completely free from the estimation of mean regression function, is simple, robust and easy to implement. Moreover, the QDM method enables the detection of heteroscedasticity without any restrictions on error terms, consequently being widely applied. What is worth mentioning is that based on the proposed approach estimators of both mean regression function and heteroscedastic function can be obtained. In the end, the authors conduct some simulations to examine the performance of the proposed methods and use a real data to make an illustration.
Testing multivariate quantile by empirical likelihood

Xuejun Ma,Shaochen Wang,Wang Zhou

DOI: https://doi.org/10.1016/j.jmva.2020.104705

IF: 1.387

2021-01-01

Journal of Multivariate Analysis

Abstract:In this paper, a new method called mean-of-quantile is introduced to estimate multivariate quantiles. The consistency and asymptotic normality of mean-of-quantile estimators are investigated. Furthermore, we apply empirical likelihood to mean-of-quantile estimators. The effectiveness of our new method is illustrated by Monte Carlo simulations and an empirical example. (C) 2020 Elsevier Inc. All rights reserved.
A linear time algorithm for multiscale quantile simulation

Chengcheng Huang,Housen Li,Lizhi Cheng,Wei Peng

2018-01-01

Abstract:Change-point problems have appeared in a great many applications for example cancer genetics, econometrics and climate change. Modern multiscale type segmentation methods are considered to be a statistically efficient approach for multiple change-point detection, which minimize the number of change-points under a multiscale side-constraint. The constraint threshold plays a critical role in balancing the data-fit and model complexity. However, the computation time of such a threshold is quadratic in terms of sample size $n$, making it impractical for large scale problems. In this paper we proposed an $mathcal{O}(n)$ algorithm by utilizing the hidden quasiconvexity structure of the problem. It applies to all regression models in exponential family with arbitrary convex scale penalties. Simulations verify its computational efficiency and accuracy. An implementation is provided in R-package linearQ on CRAN.
A sequential design for extreme quantiles estimation under binary sampling

Michel Broniatowski,Emilie Miranda

DOI: https://doi.org/10.48550/arXiv.2004.01563

2020-04-03

Abstract:We propose a sequential design method aiming at the estimation of an extreme quantile based on a sample of dichotomic data corresponding to peaks over a given threshold. This study is motivated by an industrial challenge in material reliability and consists in estimating a failure quantile from trials whose outcomes are reduced to indicators of whether the specimen have failed at the tested stress levels. The solution proposed is a sequential design making use of a splitting approach, decomposing the target probability level into a product of probabilities of conditional events of higher order. The method consists in gradually targeting the tail of the distribution and sampling under truncated distributions. The model is GEV or Weibull, and sequential estimation of its parameters involves an improved maximum likelihood procedure for binary data, due to the large uncertainty associated with such a restricted information.

Methodology
A Survey Of Approximate Quantile Computation On Large-Scale Data

Zhiwei Chen,Aoqian Zhang

DOI: https://doi.org/10.1109/ACCESS.2020.2974919

IF: 3.9

2020-01-01

IEEE Access

Abstract:As data volume grows extensively, data profiling helps to extract metadata of large-scale data. However, one kind of metadata, order statistics, is difficult to be computed because they are not mergeable or incremental. Thus, the limitation of time and memory space does not support their computation on large-scale data. In this paper, we focus on an order statistic, quantiles, and present a comprehensive analysis of studies on approximate quantile computation. Both deterministic algorithms and randomized algorithms that compute approximate quantiles over streaming models or distributed models are covered. Then, multiple techniques for improving the efficiency and performance of approximate quantile algorithms in various scenarios, such as skewed data and high-speed data streams, are presented. Finally, we conclude with coverage of existing packages in different languages and with a brief discussion of the future direction in this area.
A Fast Algorithm for Approximate Quantiles in High Speed Data Streams

Qi Zhang,Wei Wang

DOI: https://doi.org/10.1109/SSDBM.2007.27

2007-01-01

Abstract:We present a fast algorithm for computing approx- imate quantiles in high speed data streams with deter- ministic error bounds. For data streams of size N where N is unknown in advance, our algorithm par- titions the stream into sub-streams of exponentially increasing size as they arrive. For each sub-stream which has a fixed size, we compute and maintain a multi-level summary structure using a novel algorithm. In order to achieve high speed performance, the algo- rithm uses simple block-wise merge and sample oper- ations. Overall, our algorithms for fixed-size streams and arbitrary-size streams have a computational cost of O(N log( \frac{1} { \in } log \in N)) and an average per-element update cost of O(log logN) if \in is fixed.
An Efficient Computational Method of a Moment-Independent Importance Measure Using Quantile Regression

Kaixuan Feng,Zhenzhou Lu,Chao Pang,Wanying Yun

DOI: https://doi.org/10.1016/j.ymssp.2018.02.044

IF: 8.4

2018-01-01

Mechanical Systems and Signal Processing

Abstract:The moment-independent uncertainty importance measure technique for exploring how uncertainty allocates from the output to the inputs has been widely used to help engineers estimate the degree of confidence of decision results and assess risks. The moment-independent importance measure (also called delta index) can better reflect the effect of the input on the whole distribution of the output instead of any specific moment. However, because the conditional probability density function (PDF) of the output is difficult to obtain, the computation process of delta index becomes quite complex. Therefore, an efficient computational algorithm by using the quantile regression is developed to estimate the delta index in this paper. Firstly, the non-linear quantile regression is employed to approximate the relationships between each input and the conditional quantiles of the output where only a set of input-output samples is needed. Secondly, at a certain value of the input, the conditional quantile points can be computed according to the obtained quantile regression models, which can be considered as the samples of the conditional output. Thirdly, the unconditional and conditional PDF of the output are evaluated by using the univariate kernel density estimation according to the original output samples and these quantile points respectively. Finally, the delta index is computed by estimating the area difference between the unconditional PDF and conditional PDF of the output. The number of model evaluations of this proposed method is dramatically decreased and is free of the dimensionality of the model inputs. Test examples show the performance of the proposed method and its usefulness in practice. (C) 2018 Elsevier Ltd. All rights reserved.
Approximate Processing of Massive Continuous Quantile Queries over High-Speed Data Streams

XM Lin,J Xu,Q Zhang,HJ Lu,JX Yu,XF Zhou,YD Yuan

DOI: https://doi.org/10.1109/tkde.2006.73

IF: 9.235

2006-01-01

IEEE Transactions on Knowledge and Data Engineering

Abstract:Quantile computation has many applications including data mining and financial data analysis. It has been shown that an /spl epsi/-approximate summary can be maintained so that, given a quantile query (/spl phi/,/spl epsi/), the data item at rank /spl lceil//spl phi/N/spl rceil/ may be approximately obtained within the rank error precision /spl epsi/N over all N data items in a data stream or in a sliding window. However, scalable online processing of massive continuous quantile queries with different /spl phi/ and /spl epsi/ poses a new challenge because the summary is continuously updated with new arrivals of data items. In this paper, first we aim to dramatically reduce the number of distinct query results by grouping a set of different queries into a cluster so that they can be processed virtually as a single query while the precision requirements from users can be retained. Second, we aim to minimize the total query processing costs. Efficient algorithms are developed to minimize the total number of times for reprocessing clusters and to produce the minimum number of clusters, respectively. The techniques are extended to maintain near-optimal clustering when queries are registered and removed in an arbitrary fashion against whole data streams or sliding windows. In addition to theoretical analysis, our performance study indicates that the proposed techniques are indeed scalable with respect to the number of input queries as well as the number of items and the item arrival rate in a data stream.
Adaptive Sequential Procedures for Quantile Selection with Importance Sampling

Shing Chih Tsai,Guangxin Jiang,Jun Luo

DOI: https://doi.org/10.1080/24725854.2024.2320906

2024-02-21

IISE Transactions

Abstract:In this article, we consider the problem of identifying the simulated system configuration with optimal quantile performance among a finite set of alternative systems. We first propose adaptive sequential selection procedures via direct simulation, where the point and variance estimators for quantiles are sequentially updated. For the sake of extreme quantiles, we develop adaptive quantile selection procedures using importance sampling. Our procedures apply the sample average approximation and the stochastic approximation for iteratively computing the optimal importance-sampling parameter and the importance-sampling quantile estimators. The statistical validity of the proposed selection procedures is proven in the asymptotic regime. We particularly investigate the consistency and the central limit convergence using both sample average and stochastic approximation for quantile estimation during the adaptive procedures. Empirical results and an illustrative example show the efficiency of the developed procedures.

engineering, industrial,operations research & management science
Randomized Quantile Regression Estimation for Heteroskedastic Non Parametric Model

Wei Xiong,Maozai Tian,Man-Lai Tang

DOI: https://doi.org/10.1080/03610926.2015.1096393

2016-01-01

Abstract:In this paper, we propose robust randomized quantile regression estimators for the mean and (condition) variance functions of the popular heteroskedastic non parametric regression model. Unlike classical approaches which consider quantile as a fixed quantity, our method treats quantile as a uniformly distributed random variable. Our proposed method can be employed to estimate the error distribution, which could significantly improve prediction results. An automatic bandwidth selection scheme will be discussed. Asymptotic properties and relative efficiencies of the proposed estimators are investigated. Our empirical results show that the proposed estimators work well even for random errors with infinite variances. Various numerical simulations and two real data examples are used to demonstrate our methodologies.

A Method of the Quantile Calculation Based on the MM Algorithms

MM Algorithms for Statistical Estimation in Quantile Regression

Quantile Regression via the EM Algorithm.

A Weighted Quantile Regression Approach for Complex High-Dimensional Heterogeneous Data

Random Weighting-Based Quantile Estimation Via Importance Resampling

A Class of Finite Mixture of Quantile Regressions with Its Applications

Small Area Quantile Estimation

Estimation of Distribution Algorithm Using Variety of Information

Efficient Quantile Regression Analysis with Missing Observations

An Introduction to MM Algorithms for Machine Learning and Statistical

Quantiles on Stream: an Application to Monte Carlo Simulation

Heteroscedasticity Detection and Estimation with Quantile Difference Method.

Testing multivariate quantile by empirical likelihood

A linear time algorithm for multiscale quantile simulation

A sequential design for extreme quantiles estimation under binary sampling

A Survey Of Approximate Quantile Computation On Large-Scale Data

A Fast Algorithm for Approximate Quantiles in High Speed Data Streams

An Efficient Computational Method of a Moment-Independent Importance Measure Using Quantile Regression

Approximate Processing of Massive Continuous Quantile Queries over High-Speed Data Streams

Adaptive Sequential Procedures for Quantile Selection with Importance Sampling

Randomized Quantile Regression Estimation for Heteroskedastic Non Parametric Model