Abstract:Regression analysis has been widely used for face recognition. This paper mainly discuss the following regularized matrix regression problem: Given a set of k image matrices <math>A1,A2,…,Ak∈Rm×n</math> and an image matrix <math>B∈Rm×n,</math> find <math>x=(x1,x2,…,xk)T</math> <math>∈Rk</math> such that <math>minx∈Rk∥x1A1+x2A2+⋯+xkAk−B∥F2+λ2∥x∥22,</math> where <math>x1,x2,…,xk</math> are also a set of representation coefficients, λ is the model parameter, and <math>∥A∥F</math> represents the Frobenius norm of matrix A.Yuan and Liao [S.F. Yuan, A.P. Liao, Least squares Hermitian solution of the complex matrix equation AXB + CXD = E with the least norm. J. Frankl. Inst. 351 (2014), pp. 4978–4997] introduced a new product for matrices and vectors, and solved the least squares Hermitian problem of complex matrix equation <math>AXB+CXD=E.</math> In this paper, we deeply investigate this product and its relative properties about matrix trace, norm, and determinant. We then provide a direct method to get the close form solution for solving the regularized image matrix regression problem in face recognition.

A Frobenius norm regularization method for convolutional kernels to avoid unstable gradient problem

A Frobenius Norm Regularization Method for Convolutional Kernel Tensors in Neural Networks

Regularization for convolutional kernel tensors to avoid unstable gradient problem in convolutional neural networks

Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning.

Nuclear Norm Regularization for Deep Learning

Penalizing Gradient Norm for Efficiently Improving Generalization in Deep Learning

Early Stopping of Untrained Convolutional Neural Networks

Regularized Gauss-Newton for Optimizing Overparameterized Neural Networks

Generalizing and Improving Jacobian and Hessian Regularization

Smoothing Proximal Gradient Method for General Structured Sparse Learning

Tight and Efficient Upper Bound on Spectral Norm of Convolutional Layers

An Adaptive Gradient Regularization Method

A Smoothing Proximal Gradient Algorithm for Nonsmooth Convex Regression with Cardinality Penalty.

A direct method to Frobenius norm-based matrix regression

Enhancing Generalization in Convolutional Neural Networks through Regularization with Edge and Line Features

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

Regularizing Deep Neural Networks with Stochastic Estimators of Hessian Trace

Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel

SVD-free Convex-Concave Approaches for Nuclear Norm Regularization.

Convergence rates for critical point regularization

Matrix Completion via Nonconvex Regularization: Convergence of the Proximal Gradient Algorithm.