Abstract:The portfolio optimization model has limited impact in practice because of estimation issues when applied to real data. To address this, we adapt two machine learning methods, regularization and cross-validation, for portfolio optimization. First, we introduce performance-based regularization (PBR), where the idea is to constrain the sample variances of the estimated portfolio risk and return, which steers the solution toward one associated with less estimation error in the performance. We consider PBR for both mean-variance and mean-conditional value-at-risk (CVaR) problems. For the mean-variance problem, PBR introduces a quartic polynomial constraint, for which we make two convex approximations: one based on rank-1 approximation and another based on a convex quadratic approximation. The rank-1 approximation PBR adds a bias to the optimal allocation, and the convex quadratic approximation PBR shrinks the sample covariance matrix. For the mean-CVaR problem, the PBR model is a combinatorial optimization problem, but we prove its convex relaxation, a quadratically constrained quadratic program, is essentially tight. We show that the PBR models can be cast as robust optimization problems with novel uncertainty sets and establish asymptotic optimality of both sample average approximation (SAA) and PBR solutions and the corresponding efficient frontiers. To calibrate the right-hand sides of the PBR constraints, we develop new, performance-based k-fold cross-validation algorithms. Using these algorithms, we carry out an extensive empirical investigation of PBR against SAA, as well as L1 and L2 regularizations and the equally weighted portfolio. We find that PBR dominates all other benchmarks for two out of three Fama–French data sets. This paper was accepted by Yinyu Ye, optimization.

A general approach to smooth and convex portfolio optimization using lower partial moments

Nonparametric mean-lower partial moment model and enhanced index investment

Portfolio selection under model uncertainty: a penalized moment-based optimization approach

Effects of Higher Order Moments on the Newsvendor Problem

Sparse Non-Convex Optimization For Higher Moment Portfolio Management

Portfolio optimization under multivariate affine generalized hyperbolic distributions

Solving High-Order Portfolios via Successive Convex Approximation Algorithms

Kernel Smoothing for Nested Estimation with Application to Portfolio Risk Measurement.

Dynamic Mean-LPM and Mean-CVaR Portfolio Optimization in Continuous-time

Multi-Moments Method for Portfolio Management: Generalized Capital Asset Pricing Model in Homogeneous and Heterogeneous markets

Efficient and Scalable Parametric High-Order Portfolios Design via the Skew-t Distribution

Global Optimization for the Portfolio Selection Model with High-Order Moments

Study of the dynamic mean-variance portfolio optimization with regard to bankruptcy

Partial moments and indexation investment strategies

Optimal portfolio with relative performance and partial information: A mean‐field game approach

A theoretical generalization of the Markowitz model incorporating skewness and kurtosis

The Effectiveness of Incorporating Higher Moments in Portfolio Strategies: Evidence from the Chinese Commodity Futures Markets

Robust Minimum Variance Portfolio with L-infinity Constraints

Machine Learning and Portfolio Optimization

Sparse portfolio selection with uncertain probability distribution

Robust mean-risk portfolio optimization using machine learning-based trade-off parameter