Abstract:Subsampling is commonly used to overcome computational and economical bottlenecks in the analysis of finite populations and massive datasets. Existing methods are often limited in scope and use optimality criteria (e.g., A-optimality) with well-known deficiencies, such as lack of invariance to the measurement-scale of the data and parameterisation of the model. A unified theory of optimal subsampling design is still lacking. We present a theory of optimal design for general data subsampling problems, including finite population inference, parametric density estimation, and regression modelling. Our theory encompasses and generalises most existing methods in the field of optimal subdata selection based on unequal probability sampling and inverse probability weighting. We derive optimality conditions for a general class of optimality criteria, and present corresponding algorithms for finding optimal sampling schemes under Poisson and multinomial sampling designs. We present a novel class of transformation- and parameterisation-invariant linear optimality criteria which enjoy the best of two worlds: the computational tractability of A-optimality and invariance properties similar to D-optimality. The methodology is illustrated on an application in the traffic safety domain. In our experiments, the proposed invariant linear optimality criteria achieve 92-99% D-efficiency with 90-95% lower computational demand. In contrast, the A-optimality criterion has only 46% and 60% D-efficiency on two of the examples.

A note on locally optimal designs for generalized linear models with restricted support

Locally $D$-optimal Designs for a Wider Class of Non-linear Models on the $k$-dimensional Ball with applications to logit and probit models

Orthogonal Array Based Locally D-Optimal Designs for Binary Responses in the Presence of Factorial Effects

D-optimal Designs for Multinomial Logistic Models

A note on the de la Garza phenomenon for locally optimal designs

Covariate-adjusted response-adaptive designs for generalized linear models

The adaptive Wynn-algorithm in generalized linear models with univariate response

Designs for Generalized Linear Models

D ‐optimal designs for multi‐response linear models with two groups

Optimal Subsampling Algorithms for Big Data Generalized Linear Models.

Optimal Subsampling Algorithms for Big Data Generalized Linear Models

Strong Consistency of Maximum Quasi-Likelihood Estimators in Generalized Linear Models with Fixed and Adaptive Designs

G-optimal designs for hierarchical linear models: an equivalence theorem and a nature-inspired meta-heuristic algorithm

Optimal design for linear models via gradient flow

Optimal designs for linear regression models with skew-normal errors

Optimal exact designs of experiments via Mixed Integer Nonlinear Programming

Optimal subsampling designs

Optimal designs for linear models with Fredholm-type errors

Local linear M-estimation for spatial processes in fixed-design models

Optimal Design Measures under Asymmetric Errors, with Application to Binary Design Points

A note on optimal designs for estimating the slope of a polynomial regression