Abstract:That parametrization and population-level sparsity are intrinsically linked raises the possibility that relevant models, not obviously sparse in their natural formulation, exhibit a population-level sparsity after reparametrization. In covariance models, positive-definiteness enforces additional constraints on how sparsity can legitimately manifest. It is therefore natural to consider reparametrization maps in which sparsity respects positive definiteness. The main purpose of this paper is to provide insight into structures on the physically-natural scale that induce and are induced by sparsity after reparametrization. In a sense the richest of the four structures initially uncovered turns out to be that of the joint-response graphs studied by Wermuth & Cox (2004), while the most restrictive is that induced by sparsity on the scale of the matrix logarithm, studied by Battey (2017). This points to a class of reparametrizations for the chain-graph models (Andersson et al., 2001), with undirected and directed acyclic graphs as special cases. While much of the paper is focused on exact zeros after reparametrization, an important insight is the interpretation of approximate zeros, which explains the modelling implications of enforcing sparsity after reparameterization: in effect, the relation between two variables would be declared null if relatively direct regression effects were negligible and other effects manifested through long paths. The insights have a bearing on methodology, some aspects of which are discussed in the supplementary material where an estimator with high-dimensional statistical guarantees is presented.

Introduction to Implicit Regression

Implicit Regression: Detecting Constants and Inverse Relationships with Bivariate Random Error

Regressions with Berkson errors in covariates - A nonparametric approach

Lattice Designs in Standard and Simple Implicit Multi-linear Regression

Bayesian variable selection in linear regression models with instrumental variables

Penalized Independence Rule for Testing High-Dimensional Hypotheses

Implicit predictors in regularized data-driven predictive control

Regression from Dependent Observations

Implicit Copulas: An Overview

Indirect multivariate response linear regression

A Fully Nonparametric Modelling Approach to Binary Regression

Regression with an Imputed Dependent Variable

Simple or complex statistical models: Non-traditional regression models with intuitive interpretations

Uncertain Regression Analysis: an Approach for Imprecise Observations

On the Ambiguity of Interaction and Nonlinear Main Effects in a Regime of Dependent Covariates

Regression with Highly Correlated Predictors: Variable Omission Is Not the Solution

Interpretation of Linear Regression Coefficients under Mean Model Miss-Specification

Regression graphs and sparsity-inducing reparametrizations

Models as Approximations I: Consequences Illustrated with Linear Regression

On application of a response propensity model to estimation from web samples

Nonlinear Regression Modelling: A Primer with Applications and Caveats