Statistical Decision Analysis of Equal Population

YANG Yan-qiu,SONG Li-xin

DOI: https://doi.org/10.3969/j.issn.1674-3873.2007.04.022

2007-01-01

Abstract:This paper transfers the non-parametric hypothesis test of two or more equal population into the statistical decision problems which be reseaching the best decision functions.

What problem does this paper attempt to address?

Non-parametric Tests for the Tail Equivalence Via Empirical Likelihood

Yuexiang Jiang,Haoze Sun,Yi Zhang,Huaigang Long

DOI: https://doi.org/10.1080/03610926.2016.1242736

2017-01-01

Abstract:In this paper, the problem of whether the left tail and the right tail of a distribution share the same extreme value index (EVI) is addressed and we propose two different test statistics. The first one is based on the result of the joint asymptotic normality of the two Hill estimators for the EVIs of both tails. And therefore, we can construct a quotient-type test statistic, which is asymptotic (2)(1) distributed after some standardization. The second test statistic proposed in this paper is inspired by the two-sample empirical likelihood methodology, and we prove its non parametric version of Wilk's theorem. At last, we compare the efficiencies of our two test statistics and the maximum likelihood (ML) ratio test statistic proposed by Jondeau and Rockinger (2003) in terms of empirical first type error and power through a number of simulation studies, which indicate that the performance of the ML ratio test statistic is worse than our two test statistics in most cases.
Testing two variances for superiority/non-inferiority and equivalence: Using the exhaustion algorithm for sample size allocation with cost

Jiin-Huarng Guo,Wei-Ming Luh

DOI: https://doi.org/10.1111/bmsp.12172

Abstract:The equality of two group variances is frequently tested in experiments. However, criticisms of null hypothesis statistical testing on means have recently arisen and there is interest in other types of statistical tests of hypotheses, such as superiority/non-inferiority and equivalence. Although these tests have become more common in psychology and social sciences, the corresponding sample size estimation for these tests is rarely discussed, especially when the sampling unit costs are unequal or group sizes are unequal for two groups. Thus, for finding optimal sample size, the present study derived an initial allocation by approximating the percentiles of an F distribution with the percentiles of the standard normal distribution and used the exhaustion algorithm to select the best combination of group sizes, thereby ensuring the resulting power reaches the designated level and is maximal with a minimal total cost. In this manner, optimization of sample size planning is achieved. The proposed sample size determination has a wide range of applications and is efficient in terms of Type I errors and statistical power in simulations. Finally, an illustrative example from a report by the Health Survey for England, 1995-1997, is presented using hypertension data. For ease of application, four R Shiny apps are provided and benchmarks for setting equivalence margins are suggested.
A Novel Decision-Making Method for Selecting Superintendent Based on a q-Rung Dual Hesitant Fuzzy Power Partitioned Bonferroni Mean Operator

Tiedong Chen,Long Ye

DOI: https://doi.org/10.3390/sym14030590

2022-03-16

Symmetry

Abstract:The q-rung dual hesitant fuzzy (q-RDHF) set is famous for expressing information composed of asymmetry evaluations, because it allows for several possible evaluations in both the membership degree and non-membership degree. Compared with some existing extended fuzzy theories, the q-RDHF set is more superior and flexible because it can handle asymmetric assessments. In order to assemble the evaluation information expressed by q-RDHF elements, this paper aims to propose new operators to integrate q-RDHF elements. The partitioned Bonferroni mean (PBM) operator is well-known for its advantages in coping with the inhomogeneous relationship between asymmetry input arguments. In this paper, we combine the PBM operator with the power average operator, and propose a family of q-RDHF power PBM operators. Some theorems and special cases for the new proposed operators are discussed. Furthermore, we provide a general framework for dealing with multiple attribute decision-making (MADM) problems using the novel proposed method. To better show the calculation details, a numerical case study of the application of the proposed method in a superintendent selection problem is introduced. In addition, we utilize the proposed method to compare it with some existing methods in order to show its flexibility and superiority. The results show that our method is much more advantageous when considering flexible actual situations. Finally, the conclusion is given. The main contributions of this study are to propose an appropriate method to solve unbalanced and asymmetry information in a q-RDHF environment, and to apply it into a realistic superintendent selection problem.
Log-Rank-Type Tests for Equality of Distributions in High-Dimensional Spaces.

Linxi Liu,Yang Meng,Xiaoru Wu,Zhiliang Ying,Tian Zheng

DOI: https://doi.org/10.1080/10618600.2022.2051530

2022-01-01

Journal of Computational and Graphical Statistics

Abstract:Motivated by applications in high-dimensional settings, we propose a novel approach for testing the equality of two or more populations by constructing a class of intensity centered score processes. The resulting tests are analogous in spirit to the well-known class of weighted log-rank statistics that are widely used in survival analysis. The test statistics are nonparametric, computationally simple, and applicable to high-dimensional data. We establish the usual large sample properties by showing that the underlying log-rank score process converges weakly to a Gaussian random field with zero mean under the null hypothesis and with a drift under the contiguous alternatives. For the Kolmogorov-Smirnov-type and the Cramervon Mises-type statistics, we also establish the consistency result for any fixed alternative. Cutoff points for the test statistics are obtained by permutations or a simulation-based resampling method. The new approach is applied to a study of brain activation measured by functional magnetic resonance imaging when performing two linguistic tasks and also to a prostate cancer DNA microarray dataset. Supplementary materials for this article are available online.
Statistical tests under Dallal’s model: Asymptotic and exact methods

Zhiming Li,Changxing Ma,Mingyao Ai

DOI: https://doi.org/10.1371/journal.pone.0242722

IF: 3.7

2020-11-30

PLoS ONE

Abstract:This paper proposes asymptotic and exact methods for testing the equality of correlations for multiple bilateral data under Dallal’s model. Three asymptotic test statistics are derived for large samples. Since they are not applicable to small data, several conditional and unconditional exact methods are proposed based on these three statistics. Numerical studies are conducted to compare all these methods with regard to type I error rates (TIEs) and powers. The results show that the asymptotic score test is the most robust, and two exact tests have satisfactory TIEs and powers. Some real examples are provided to illustrate the effectiveness of these tests.

multidisciplinary sciences
Identification And Statistical Decision Theory

Charles F. Manski

DOI: https://doi.org/10.1017/s0266466624000197

IF: 1.968

2024-06-02

Econometric Theory

Abstract:Econometricians have usefully separated study of estimation into identification and statistical components. Identification analysis, which assumes knowledge of the probability distribution generating observable data, places an upper bound on what may be learned about population parameters of interest with finite-sample data. Yet Wald's statistical decision theory studies decision-making with sample data without reference to identification, indeed without reference to estimation. This paper asks if identification analysis is useful to statistical decision theory. The answer is positive, as it can yield an informative and tractable upper bound on the achievable finite-sample performance of decision criteria. The reasoning is simple when the decision-relevant parameter (true state of nature) is point-identified. It is more delicate when the true state is partially identified and a decision must be made under ambiguity. Then the performance of some criteria, such as minimax regret, is enhanced by randomizing choice of an action in a controlled manner. I find it useful to recast choice of a statistical decision function as selection of choice probabilities for the elements of the choice set.

economics,social sciences, mathematical methods,mathematics, interdisciplinary applications,statistics & probability
Equivalence Test in Multi-dimensional Space with Applications in A/B Testing

Jing Miao,Hongyuan Yuan,Zhenyu Yan

DOI: https://doi.org/10.48550/arXiv.1810.04630

2018-09-25

Abstract:In this paper, we provide a statistical testing framework to check whether a random sample splitting in a multi-dimensional space is carried out in a valid way, which could be directly applied to A/B testing and multivariate testing to ensure the online traffic split is truly random with respect to the covariates. We believe this is an important step of quality control that is missing in many real world online experiments. Here, we propose a randomized chi-square test method, compared with propensity score and distance components (DISCO) test methods, to test the hypothesis that the post-split categorical data sets have the same multi-dimensional distribution. The methods can be easily generalized to continuous data. We also propose a resampling procedure to adjust for multiplicity which in practice often has higher power than some existing method such as Holm's procedure. We try the three methods on both simulated and real data sets from Adobe Experience Cloud and show that each method has its own advantage while all of them establish promising power. To our knowledge, we are among the first ones to formulate the validity of A/B testing into a post-experiments statistical testing problem. Our methodology is non-parametric and requires minimum assumption on the data, so it can also have a wide range of application in other areas such as clinical trials, medicine, and recommendation system where random data splitting is needed.

Methodology
Statistical Tests under Dallal's Model: Asymptotic and Exact Methods.

Zhiming Li,Changxing Ma,Mingyao Ai

DOI: https://doi.org/10.1371/journal.pone.0242722

IF: 3.7

2020-01-01

PLoS ONE

Abstract:This paper proposes asymptotic and exact methods for testing the equality of correlations for multiple bilateral data under Dallal's model. Three asymptotic test statistics are derived for large samples. Since they are not applicable to small data, several conditional and unconditional exact methods are proposed based on these three statistics. Numerical studies are conducted to compare all these methods with regard to type I error rates (TIEs) and powers. The results show that the asymptotic score test is the most robust, and two exact tests have satisfactory TIEs and powers. Some real examples are provided to illustrate the effectiveness of these tests.
A novel statistical method for comparing effectiveness of two treatments-simulated randomized controlled trials

Weili Yan,Shaoke Chen,Yi Cheng,Chongfan Zhang

DOI: https://doi.org/10.3969/j.issn.1673-5501.2013.01.003

2013-01-01

Abstract:Objective To develop a new statistical method for comparing effectiveness of two treatments for the same disease indication.A statistical method needs to be developed to compare effectiveness of different treatments by using existing clinical data when lacking of evidence from randomized controlled trials.Methods Datasets including an outcome variable and a confounder for two treatments were simulated.Subjects in each dataset were randomly divided into two arms for 100 times,and the means were compared by using student-t tests and Per-protocol analysis strategy was applied.Subjects with assigned treatment by randomization that was contradictory to the actual received treatment were considered drop-out of conventional RCTs,and were excluded from comparisons of means.The ratio of the frequency of hypothesis tests that rejected H0 to the frequency of hypothesis tests that did not reject H0,called odds,was used to predict the probability of significant tests for group difference.To document the consistency and reliability of the method,the distribution of odds and its 95% CI,and the confounding effect were described in simulated datasets with various between-group mean differences and statistical power(ranging from 0.5 to 0.85) with varied sample sizes(n=50,100,500,and 1 000).Stata 11.0 was used to program and perform the analysis.Results The odds and its 95%CI of simulated RCTs were perfectly and linearly correlated with the change of between-group mean differences and statistical power,by difference sample size.A conclusion could be made based on the hypothesis of the simulated randomized controlled trials(sRCT).The probability of loss of balance of confounding was over 95% for equal and unequal sample size of two arms after excluding misclassified subjects.Conclusions The proposed novel analytical method,simulated RCTs based on real clinical treatment data,can be used to compare effectiveness of two treatments when evidence from RCTs is unavailable.
On Testing the Mean Equivalence of Treatments from Correlated Normal Populations

Hubert J. Chen,Shu-Fei Wu,Pei-Chi Shao,Wen-Gine Wang

DOI: https://doi.org/10.1080/03610918.2014.889159

2016-06-02

Abstract:Let there be k equally correlated treatment populations under consideration, a Studentized range test is proposed to test the hypothesis of average mean equivalence against the alternative hypothesis of inequivalence. The maximum level and minimum power at some least favorable configurations of means are used to calculate the critical value and the required sample size simultaneously when testing a null against an alternative hypothesis. The range test is applied to a real world problem to find out if the stress levels among children at four time periods due to a newly built nearby airport are equivalent.

statistics & probability
A class of nonparametric tests for the two-sample problem based on order statistics

Kadir Karakaya,Sümeyra Sert,Ihab Abusaif,Coşkun Kuş,Hon Keung Tony Ng,Haikady N. Nagaraja

DOI: https://doi.org/10.1080/10485252.2024.2376089

2024-07-27

Journal of Nonparametric Statistics

Abstract:In this paper, a new class of distribution-free statistics based on order statistics from two independent samples is introduced to test the equality of two continuous distributions. The null distributions are obtained, and the symmetry property of the proposed test statistics is studied. The exact power functions of the new class of tests under the Lehmann alternative family are derived. Extensions of the proposed class of test statistics to situations with unequal sample sizes are discussed. We also study the power performance of the proposed test under the location-shift and scale-shift alternatives using Monte Carlo simulations. We observe that the power performance of the new class of test procedures is comparable to some commonly used nonparametric tests under various scenarios, which indicates that the new class of test procedures can be a good alternative to those classic nonparametric tests for the two-sample problem.

statistics & probability
Evaluating Statistical Hypotheses Using Weakly-Identifiable Estimating Functions.

Guanqun Cao,David Todem,Lijian Yang,Jason P. Fine

DOI: https://doi.org/10.1111/j.1467-9469.2012.00811.x

2012-01-01

Scandinavian Journal of Statistics

Abstract:Many statistical models arising in applications contain non- and weakly-identified parameters. Due to identifiability concerns, tests concerning the parameters of interest may not be able to use conventional theories and it may not be clear how to assess statistical significance. This paper extends the literature by developing a testing procedure that can be used to evaluate hypotheses under non- and weakly-identifiable semiparametric models. The test statistic is constructed from a general estimating function of a finite dimensional parameter model representing the population characteristics of interest, but other characteristics which may be described by infinite dimensional parameters, and viewed as nuisance, are left completely unspecified. We derive the limiting distribution of this statistic and propose theoretically justified resampling approaches to approximate its asymptotic distribution. The methodology's practical utility is illustrated in simulations and an analysis of quality-of-life outcomes from a longitudinal study on breast cancer.
Test for the statistical significance of a treatment effect in the presence of hidden sub-populations

Bikram Karmakar,Kumaresh Dhara,Kushal Kumar Dey,Analabha Basu,Anil Ghosh

DOI: https://doi.org/10.48550/arXiv.1211.0032

2012-10-31

Computation

Abstract:For testing the statistical significance of a treatment effect, we usually compare between two parts of a population, one is exposed to the treatment, and the other is not exposed to it. Standard parametric and nonparametric two-sample tests are often used for this comparison. But direct applications of these tests can yield misleading results, especially when the population has some hidden sub-populations, and the impact of this sub-population difference on the study variables dominates the treatment effect. This problem becomes more evident if these subpopulations have widely different proportions of representatives in the samples taken from these two parts, which are often referred to as the treatment group and the control group. In this article, we make an attempt to overcome this problem. Our propose methods use suitable clustering algorithms to find the hidden sub-populations and then eliminate the sub-population effect by using suitable transformations. Standard two-sample tests, when they are applied on the transformed data, yield better results. Some simulated and real data sets are analyzed to show the utility of the proposed methods.
Statistical Power Analysis for Comparing Means with Binary or Count Data Based on Analogous ANOVA

Yujiao Mai,Zhiyong Zhang

DOI: https://doi.org/10.1007/978-3-319-56294-0_33

2017-01-01

Abstract:Comparison of population means is essential in quantitative research. For comparing means of three or more groups, analysis of variance (ANOVA) is the most frequently used statistical approach. Typically, ANOVA is used for continuous data, but discrete data are also common in practice. To compare means of binary or count data, the classical ANOVA and the corresponding power analysis are problematic, because the assumption of normality is violated. To address the issue, this study introduces an analogous ANOVA approach for binary or count data, as well as the corresponding methods for statistical power analysis. We first introduce an analogous ANOVA table and a likelihood ratio test statistic for comparing means with binary or count data. With the test statistic, we then define an effect size and propose a method to calculate statistical power. Finally, we develop and show software to conduct the proposed power analysis for both binary and count data.
A bootstrap semiparametric homogeneity test for the distributions of multigroup proportional data, with applications to analysis of quality of life outcomes in clinical trials

Chunlin Wang,Dongsheng Tu

DOI: https://doi.org/10.1002/sim.8507

2020-02-25

Statistics in Medicine

Abstract:<p>This article is concerned about the test for the difference in the distributions of multigroup proportional data, which is motivated by the problem of comparing the distributions of quality of life (QoL) outcomes among different treatment groups in clinical trials. The proportional data, such as QoL outcomes assessed by answers to questions on a questionnaire, are bounded in a closed interval such as [0,1] with continuous observations in (0,1) and, in addition, excess observations taking the boundary values 0 and/or 1. Common statistical procedures used in practice, such as <i>t</i>‐ and rank‐based tests, may not be very powerful since they ignore the specific feature of the proportional data. In this article, we propose a three‐component mixture model for the proportional data and a density ratio model for the distributions of continuous observations in (0,1). A semiparametric test statistic for the homogeneity of distributions of multigroup proportional data is derived based on the empirical likelihood ratio principle and shown to be asymptotically distributed as a chi‐squared random variable under null hypothesis. A nonparametric bootstrap procedure is proposed to further improve the performance of the semiparametric test. Simulation studies are performed to evaluate the empirical type I error and power of the proposed test procedure and compare it with likelihood ratio tests (LRTs) under parametric distribution assumptions, rank‐based Kruskal‐Wallis test, and Wald‐type test. The proposed test procedure is also applied to the analysis of QoL outcomes from a clinical trial on colorectal cancer that motivated our study.</p>

public, environmental & occupational health,medicine, research & experimental,medical informatics,mathematical & computational biology,statistics & probability
Statistical Decision Theory Respecting Stochastic Dominance

Charles F. Manski,Aleksey Tetenov

DOI: https://doi.org/10.48550/arXiv.2308.05171

2023-08-10

Abstract:The statistical decision theory pioneered by Wald (1950) has used state-dependent mean loss (risk) to measure the performance of statistical decision functions across potential samples. We think it evident that evaluation of performance should respect stochastic dominance, but we do not see a compelling reason to focus exclusively on mean loss. We think it instructive to also measure performance by other functionals that respect stochastic dominance, such as quantiles of the distribution of loss. This paper develops general principles and illustrative applications for statistical decision theory respecting stochastic dominance. We modify the Wald definition of admissibility to an analogous concept of stochastic dominance (SD) admissibility, which uses stochastic dominance rather than mean sampling performance to compare alternative decision rules. We study SD admissibility in two relatively simple classes of decision problems that arise in treatment choice. We reevaluate the relationship between the MLE, James-Stein, and James-Stein positive part estimators from the perspective of SD admissibility. We consider alternative criteria for choice among SD-admissible rules. We juxtapose traditional criteria based on risk, regret, or Bayes risk with analogous ones based on quantiles of state-dependent sampling distributions or the Bayes distribution of loss.

Econometrics,Statistics Theory
Statistical Tests for Proportion Difference in One-to-Two Matched Binary Diagnostic Data: Application to Environmental Testing of Salmonella in the United States

Hui Lin,Adam Zhu,Chong Wang

DOI: https://doi.org/10.3390/math12050741

IF: 2.4

2024-03-02

Mathematics

Abstract:Pooled sample testing is an effective strategy to reduce the cost of disease surveillance in human and animal medicine. Testing pooled samples commonly produces matched observations with dichotomous responses in medical and epidemiological research. Although standard approaches exist for one-to-one paired binary data analyses, there is not much work on one-to-two or one-to-N matched binary data in the current statistical literature. The existing Miettinen's test assumes that the multiple observations from the same matched set are mutually independent. In this paper, we propose exact and asymptotic tests for one-to-two matched binary data. Our methods are markedly different from the previous studies in that we do not rely on the mutual independence assumption. The emphasis on the interdependence of observations within a matched set is inherent and attractive in both human health and veterinary medicine. It can be applied to all kinds of diagnostic studies with a one-to-two matched data structure. Our methods can be generalized to the one-to-N matched case. We discuss applications of the proposed methods to the environmental testing of salmonella in the United States.

mathematics
Two-sample Nonparametric Stochastic Order Inference with an Application in Plant Physiology

Yishi Wang,Ann E. Stapleton,Cuixian Chen

DOI: https://doi.org/10.1080/00949655.2018.1482492

IF: 1.225

2018-01-01

Journal of Statistical Computation and Simulation

Abstract:In this paper, a new nonparametric methodology is developed for testing whether the changing pattern of a response variable over multiple ordered sub-populations from one treatment group differs with the one from another treatment group. The question is formalized into a nonparametric two-sample comparison problem for the stochastic order among subsamples, through U-statistics with accommodations for zero-inflated distributions. A novel bootstrap procedure is proposed to obtain the critical values with given type I error. Following the procedure, bootstrapped p-values are obtained through simulated samples. It is proven that the distribution of the test statistics is independent from the underlying distributions of the subsamples, when certain sufficient statistics provided. Furthermore, this study also develops a feasible framework for power studies to determine sample sizes, which is necessary in real-world applications. Simulation results suggest that the test is consistent. The methodology is illustrated using a biological experiment with a split-plot design, and significant differences in changing patterns of seed weight between treatments are found with relative small subsample sizes.
Statistical Inference of the Class of Nonparametric Tests for the Panel Count and Current Status Data from the Perspective of the Saddlepoint Approximation

Abd El-Raheem M. Abd El-Raheem,Mona Hosny,Ehab F. Abd-Elfattah

DOI: https://doi.org/10.1155/2023/9111653

2023-01-12

Journal of Mathematics

Abstract:Many statisticians resort to using the asymptotic normal approximation method to carry out statistical inference for many statistical tests, especially nonparametric ones. In this article, the saddlepoint approximation method is proposed as an alternative to the asymptotic normal approximation method to carry out statistical inference for a number of nonparametric tests for an important type of data that appears frequently in many clinical studies such as cancer and tumorigenicity studies. In clinical trials, there are many strategies through which treatments are assigned to patients. Equal allocation of both treatments is a largely prevalent approach in clinical trials to eliminate experimental bias and increase power. Accordingly, the statistical analysis is carried out based on the truncated binomial design, which is one of the designs that achieve a perfect balance between the two treatments. To clarify the accuracy of the proposed approximation method, two sets of real data are analyzed, and for the same purpose, a comprehensive simulation study is carried out.

mathematics
Comparison of Statistical Methods for Analysis of Threshold Model of Two-Stage Clustered Randomized Data

YU Bing,ZHAO Nai-qing,Lynn Sui-heng

DOI: https://doi.org/10.3969/j.issn.1672-8467.2008.01.016

2008-01-01

Abstract:Objective To compare the performance of three statistical methods, namely probit regression, generalized estimating equations and probit-normal regression, for analysis of two-stage clustered randomized data. Methods Bias of estimates and coverage of 95% confidence intervals were compared across the three statistical methods through computer simulations according to a pupil based somatic study under different values of the regression coefficient parameters and intraclass correlation coefficient. Results Under various circumstances, probit-normal regression gave the least bias and the best coverage. Conclusions Probit-normal regression is a sensitive and reliable statistical method to analyze two-stage clustered randomized data.

Statistical Decision Analysis of Equal Population

Non-parametric Tests for the Tail Equivalence Via Empirical Likelihood

Testing two variances for superiority/non-inferiority and equivalence: Using the exhaustion algorithm for sample size allocation with cost

A Novel Decision-Making Method for Selecting Superintendent Based on a q-Rung Dual Hesitant Fuzzy Power Partitioned Bonferroni Mean Operator

Log-Rank-Type Tests for Equality of Distributions in High-Dimensional Spaces.

Statistical tests under Dallal’s model: Asymptotic and exact methods

Identification And Statistical Decision Theory

Equivalence Test in Multi-dimensional Space with Applications in A/B Testing

Statistical Tests under Dallal's Model: Asymptotic and Exact Methods.

A novel statistical method for comparing effectiveness of two treatments-simulated randomized controlled trials

On Testing the Mean Equivalence of Treatments from Correlated Normal Populations

A class of nonparametric tests for the two-sample problem based on order statistics

Evaluating Statistical Hypotheses Using Weakly-Identifiable Estimating Functions.

Test for the statistical significance of a treatment effect in the presence of hidden sub-populations

Statistical Power Analysis for Comparing Means with Binary or Count Data Based on Analogous ANOVA

A bootstrap semiparametric homogeneity test for the distributions of multigroup proportional data, with applications to analysis of quality of life outcomes in clinical trials

Statistical Decision Theory Respecting Stochastic Dominance

Statistical Tests for Proportion Difference in One-to-Two Matched Binary Diagnostic Data: Application to Environmental Testing of Salmonella in the United States

Two-sample Nonparametric Stochastic Order Inference with an Application in Plant Physiology

Statistical Inference of the Class of Nonparametric Tests for the Panel Count and Current Status Data from the Perspective of the Saddlepoint Approximation

Comparison of Statistical Methods for Analysis of Threshold Model of Two-Stage Clustered Randomized Data