Abstract:The portfolio optimization model has limited impact in practice because of estimation issues when applied to real data. To address this, we adapt two machine learning methods, regularization and cross-validation, for portfolio optimization. First, we introduce performance-based regularization (PBR), where the idea is to constrain the sample variances of the estimated portfolio risk and return, which steers the solution toward one associated with less estimation error in the performance. We consider PBR for both mean-variance and mean-conditional value-at-risk (CVaR) problems. For the mean-variance problem, PBR introduces a quartic polynomial constraint, for which we make two convex approximations: one based on rank-1 approximation and another based on a convex quadratic approximation. The rank-1 approximation PBR adds a bias to the optimal allocation, and the convex quadratic approximation PBR shrinks the sample covariance matrix. For the mean-CVaR problem, the PBR model is a combinatorial optimization problem, but we prove its convex relaxation, a quadratically constrained quadratic program, is essentially tight. We show that the PBR models can be cast as robust optimization problems with novel uncertainty sets and establish asymptotic optimality of both sample average approximation (SAA) and PBR solutions and the corresponding efficient frontiers. To calibrate the right-hand sides of the PBR constraints, we develop new, performance-based k-fold cross-validation algorithms. Using these algorithms, we carry out an extensive empirical investigation of PBR against SAA, as well as L1 and L2 regularizations and the equally weighted portfolio. We find that PBR dominates all other benchmarks for two out of three Fama–French data sets. This paper was accepted by Yinyu Ye, optimization.

NONCONVEX L-1/2 REGULARIZATION FOR SPARSE PORTFOLIO SELECTION

Sparse Portfolio Selection via Quasi-Norm Regularization

Robust Minimum Variance Portfolio with L-infinity Constraints

Sparse Portfolio Rebalancing Model Based on Inverse Optimization

Cardinality Constrained Portfolio Optimization via Alternating Direction Method of Multipliers

Sparse portfolio selection with uncertain probability distribution

A sparse chance constrained portfolio selection model with multiple constraints

A descent algorithm for constrained LAD-Lasso estimation with applications in portfolio selection

Portfolio Optimization with Sparse Multivariate Modelling

Penalty method for the sparse portfolio optimization problem

Sparse and stable Markowitz portfolios

Regularization methods for sparse ESG-valued multi-period portfolio optimization with return prediction using machine learning

Machine Learning and Portfolio Optimization

Feature Selection with &Lt;inline-Formula> &Lt;tex-Math Notation="latex">$\ell_{2,1-2}$ &Lt;/tex-Math> &Lt;/inline-Formula> Regularization

Nonconvex Sparse Logistic Regression with Weakly Convex Regularization

A new penalized least absolute deviation model for high dimensional sparse linear regression and an efficient sequential linear programming algorithm

Reduced-Space Iteratively Reweighted Second-Order Methods for Nonconvex Sparse Regularization

Statistical Proxy based Mean-Reverting Portfolios with Sparsity and Volatility Constraints

Sparse Extended Mean-Variance-CVaR Portfolios with Short-selling

Sparsity and Stability for Minimum-Variance Portfolios

OPTIMAL LOT SOLUTION TO CARDINALITY CONSTRAINED MEAN–VARIANCE FORMULATION FOR PORTFOLIO SELECTION