Abstract:A wide variety of methods are available to estimate the between‐study variance under the univariate random‐effects model for meta‐analysis. Some, but not all, of these estimators have been extended so that they can be used in the multivariate setting. We begin by extending the univariate generalised method of moments, which immediately provides a wider class of multivariate methods than was previously available. However, our main proposal is to use this new type of estimator to derive multivariate multistep estimators of the between‐study covariance matrix. We then use the connection between the univariate multistep and Paule–Mandel estimators to motivate taking the limit, where the number of steps tends toward infinity. We illustrate our methodology using two contrasting examples and investigate its properties in a simulation study. We conclude that the proposed methodology is a fully viable alternative to existing estimation methods, is well suited to sensitivity analyses that explore the use of alternative estimators, and should be used instead of the existing DerSimonian and Laird‐type moments based estimator in application areas where data are expected to be heterogeneous. However, multistep estimators do not seem to outperform the existing estimators when the data are more homogeneous. Advantages of the new multivariate multistep estimator include its semi‐parametric nature and that it is computationally feasible in high dimensions. Our proposed estimation methods are also applicable for multivariate random‐effects meta‐regression, where study‐level covariates are included in the model.

New variances for various kappa coefficients based on the unbiased estimator of the expected index of agreements

Estimators of various kappa coefficients based on the unbiased estimator of the expected index of agreements

Toward improved inference for Krippendorff's Alpha agreement coefficient

Measures of Agreement with Multiple Raters: Fréchet Variances and Inference

High Agreement and High Prevalence: The Paradox of Cohen’s Kappa

Bounds for distributional approximation in the multivariate delta method by Stein's method

Min-Mid-Max Scaling, Limits of Agreement, and Agreement Score

Improved coverage factors for expanded measurement uncertainty calculated from two estimated variance components

Covariance Expressions for Multifidelity Sampling with Multioutput, Multistatistic Estimators: Application to Approximate Control Variates

Minimum Kernel Discrepancy Estimators

kNN Algorithm for Conditional Mean and Variance Estimation with Automated Uncertainty Quantification and Variable Selection

Variance components and generalized Sobol' indices

Testing equality between several populations covariance operators

Relationships of Cohen's Kappa, Sensitivity, and Specificity for Unbiased Annotations

Multistep estimators of the between‐study covariance matrix under the multivariate random‐effects model for meta‐analysis

Estimating an Inverse Gamma distribution

An Extension of Greenwood's Formula to Variances

A Monte Carlo Method for Variance Estimation for Estimators Based on Induced Smoothing.

Deterministic Inequalities for Smooth M-estimators

Two more ways of spelling Gini Coefficient with Applications

Unbiased Monte Carlo estimation for the expected value of partial perfect information