Abstract:We consider the multivariate max-linear regression problem where the model parameters need to be estimated from independent samples of the (noisy) observations . The max-linear model vastly generalizes the conventional linear model, and it can approximate any convex function to an arbitrary accuracy when the number of linear models is large enough. However, the inherent nonlinearity of the max-linear model renders the estimation of the regression parameters computationally challenging. Particularly, no estimator based on convex programming is known in the literature. We formulate and analyze a scalable convex program given by anchored regression (AR) as the estimator for the max-linear regression problem. Under the standard Gaussian observation setting, we present a non-asymptotic performance guarantee showing that the convex program recovers the parameters with high probability. When the linear components are equally likely to achieve the maximum, our result shows a sufficient number of noise-free observations for exact recovery scales as up to a logarithmic factor. This sample complexity coincides with that by alternating minimization (Ghosh et al., 2021). Moreover, the same sample complexity applies when the observations are corrupted with arbitrary deterministic noise. We provide empirical results that show that our method performs as our theoretical result predicts, and is competitive with the alternating minimization algorithm particularly in presence of multiplicative Bernoulli noise. Furthermore, we also show empirically that a recursive application of AR can significantly improve the estimation accuracy.

Maximal Correlation Regression

On the Asymptotic Sample Complexity of HGR Maximal Correlation Functions in Semi-supervised Learning

Feature selection based on network maximal correlation

Towards the Global Solution of the Maximal Correlation Problem

On the Sample Complexity of HGR Maximal Correlation Functions for Large Datasets

Tensor Maximal Correlation Problems

An Efficient Algorithm for Information Decomposition and Extraction.

Network Maximal Correlation

On the maximal correlation of some stochastic processes

A minimax optimal approach to high-dimensional double sparse linear regression

Fairness-Aware Neural Réyni Minimization for Continuous Features

On the minimax robustness against correlation and heteroscedasticity of ordinary least squares among generalized least squares estimators of regression

Max-Linear Regression by Convex Programming

Computing Absolute Maximum Correlation

Learning with the Maximum Correntropy Criterion Induced Losses for Regression.

High-Dimensional Least-Squares with Perfect Positive Correlation

A Local Characterization for Wyner Common Information

Attribute Selection Algorithm using Correlation based on Maximal Connected Subgraph

Person Recognition with HGR Maximal Correlation on Multimodal Data.

On Conditional Correlations

Riemannian trust-region method for the maximal correlation problem