Abstract:Hierarchical linear models are widely used in many research disciplines and estimation issues for such models are generally well addressed. Design issues are relatively much less discussed for hierarchical linear models but there is an increasing interest as these models grow in popularity. This paper discusses the G-optimality for predicting individual parameters in such models and establishes an equivalence theorem for confirming the G-optimality of an approximate design. Because the criterion is non-differentiable and requires solving multiple nested optimization problems, it is much harder to find and study G-optimal designs analytically. We propose a nature-inspired meta-heuristic algorithm called competitive swarm optimizer (CSO) to generate G-optimal designs for linear mixed models with different means and covariance structures. We further demonstrate that CSO is flexible and generally effective for finding the widely used locally D-optimal designs for nonlinear models with multiple interacting factors and some of the random effects are correlated. Our numerical results for a few examples suggest that G and D-optimal designs may be equivalent and we establish that D and G-optimal designs for hierarchical linear models are equivalent when the models have only a random intercept only. The challenging mathematical question of whether their equivalence applies more generally to other hierarchical models remains elusive.

A note on the de la Garza phenomenon for locally optimal designs

Design admissibility and de la Garza phenomenon in multi-factor experiments

Change point estimators by local polynomial fits under a dependence assumption

A note on optimal designs for estimating the slope of a polynomial regression

A note on locally optimal designs for generalized linear models with restricted support

Minimizing the Condition Number to Construct Design Points for Polynomial Regression Models

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Experimental Design for Any $p$-Norm

Locally $D$-optimal Designs for a Wider Class of Non-linear Models on the $k$-dimensional Ball with applications to logit and probit models

Optimal designs for estimating individual coefficients in polynomial regression with no intercept

Spurious local minima in nonconvex sum-of-squares optimization

The Asymptotics of Optimal Designs for Polynomial Regression

A Note on Minimax Robustness of Designs Against Correlated or Heteroscedastic Responses

The semi-algebraic geometry of saturated optimal designs for the Bradley-Terry model

Optimal Designs for Regression on Lie Groups

G-optimal designs for hierarchical linear models: an equivalence theorem and a nature-inspired meta-heuristic algorithm

Optimal discriminating designs for several competing regression models

Adaptive discretization algorithms for locally optimal experimental design

Asymptotic compatibility of parametrized optimal design problems

Optimal design for linear models via gradient flow