Abstract:The portfolio optimization model has limited impact in practice because of estimation issues when applied to real data. To address this, we adapt two machine learning methods, regularization and cross-validation, for portfolio optimization. First, we introduce performance-based regularization (PBR), where the idea is to constrain the sample variances of the estimated portfolio risk and return, which steers the solution toward one associated with less estimation error in the performance. We consider PBR for both mean-variance and mean-conditional value-at-risk (CVaR) problems. For the mean-variance problem, PBR introduces a quartic polynomial constraint, for which we make two convex approximations: one based on rank-1 approximation and another based on a convex quadratic approximation. The rank-1 approximation PBR adds a bias to the optimal allocation, and the convex quadratic approximation PBR shrinks the sample covariance matrix. For the mean-CVaR problem, the PBR model is a combinatorial optimization problem, but we prove its convex relaxation, a quadratically constrained quadratic program, is essentially tight. We show that the PBR models can be cast as robust optimization problems with novel uncertainty sets and establish asymptotic optimality of both sample average approximation (SAA) and PBR solutions and the corresponding efficient frontiers. To calibrate the right-hand sides of the PBR constraints, we develop new, performance-based k-fold cross-validation algorithms. Using these algorithms, we carry out an extensive empirical investigation of PBR against SAA, as well as L1 and L2 regularizations and the equally weighted portfolio. We find that PBR dominates all other benchmarks for two out of three Fama–French data sets. This paper was accepted by Yinyu Ye, optimization.

Mean–variance portfolio optimization using machine learning-based stock price prediction

Prediction based mean-value-at-risk portfolio optimization using machine learning regression algorithms for multi-national stock markets

How to Make Machine Select Stocks Like Fund Managers? Use Scoring and Screening Model

Markowitz Mean-Variance Portfolio Optimization with Predictive Stock Selection Using Machine Learning

Portfolio optimization with return prediction using deep learning and machine learning

A Novel Two-Stage Method for Well-Diversified Portfolio Construction Based on Stock Return Prediction Using Machine Learning

A Hybrid Approach for Portfolio Construction: Combing Two-Stage Ensemble Forecasting Model with Portfolio Optimization

Portfolio Optimization Strategies: New Approaches Based on Machine Learning Forecasting

Average variance portfolio optimization using machine learning-based stock price prediction case of renewable energy investments

An Intelligent Fusion Model with Portfolio Selection and Machine Learning for Stock Market Prediction

Anatomy of Machines for Markowitz: Decision-Focused Learning for Mean-Variance Portfolio Optimization

Stock Prices Forecasting and Optimization Strategies Based on Support Vector Machines

Stock Trend Prediction and Analysis Based on Machine Learning

Optimization of Machine Learning Based Stock Prediction

Financial Trading Strategy System Based on Machine Learning

A hybrid approach for portfolio selection with higher-order moments: Empirical evidence from Shanghai Stock Exchange.

Supervised classification-based stock prediction and portfolio optimization

Enhancing Portfolio Optimization: A Two-Stage Approach with Deep Learning and Portfolio Optimization

HM-SMF: An Efficient Strategy Optimization using a Hybrid Machine Learning Model for Stock Market Prediction

Machine Learning and Portfolio Optimization

Stock portfolio optimization based on factor analysis and second-order memetic differential evolution algorithm